Canberra Government Agencies Race to Purge Duplicate Images From Digital Archives This Week

Federal and ACT government agencies accelerated efforts this week to tackle a long-running problem in their digital asset libraries: thousands of duplicate images clogging storage systems, inflating IT costs and complicating freedom-of-information requests. The push, which gained momentum after a cross-agency review flagged the issue in late June, is now being treated as an operational priority rather than a housekeeping afterthought.

The timing matters. With the federal budget locking in a digital infrastructure modernisation program worth hundreds of millions of dollars across the public service, agencies face renewed pressure to demonstrate they are managing existing assets efficiently before receiving new capital. Duplicate image files — identical or near-identical photographs, scanned documents and graphics stored multiple times across separate drives and cloud folders — represent one of the most common and least glamorous sources of digital waste inside large bureaucracies.

What's Happening on the Ground in Canberra

At the Australian National University in Acton, the university's library and digital collections team has been running a deduplication audit since May, targeting its digitised image holdings across multiple research repositories. Staff have been using automated detection software to flag files with matching hash values — a standard method for identifying byte-for-byte duplicates — before human reviewers assess near-duplicates where image quality or metadata differs slightly.

The ACT Government's Shared Services directorate, which manages digital storage contracts for agencies including Access Canberra and the Chief Minister, Treasury and Economic Development Directorate, confirmed this week that a territory-wide review of image asset libraries is underway. The work is being coordinated out of the Dickson-based ICT operations hub and is expected to conclude by September 30, 2026. No specific cost figures have been made public, but the directorate has previously indicated that storage rationalisation across the ACT public service is part of its broader digital transformation agenda.

The University of Canberra's Faculty of Arts and Design, which maintains extensive photographic archives for teaching and research purposes, has also begun a similar exercise, focusing on image collections held in its Bruce campus servers. Staff there have been working through roughly 18 months of backlogged uploads — a period that coincided with rapid expansion of online teaching during and after the pandemic years.

Why Duplicates Accumulate and What It Costs

The problem is structural. When multiple staff members download the same photograph from a content management system, rename it and save it to a shared drive, three or four versions of the same file can exist within days. Multiply that across a department of several hundred employees over several years and the numbers compound fast. Industry benchmarks cited in federal government cloud strategy documents suggest duplicates can account for between 20 and 30 per cent of total unstructured data held in large organisations, though the figure varies widely depending on how well file-naming and upload protocols have been enforced.

Cloud storage costs are not trivial at government scale. Microsoft Azure and AWS, the two platforms most commonly used by Australian federal agencies, price bulk storage in tiers, and agencies that allow libraries to bloat can find themselves paying for the next pricing tier unnecessarily. For a mid-sized Commonwealth department storing tens of terabytes of media files, the difference between a clean library and a poorly managed one can translate to tens of thousands of dollars annually in avoidable charges.

The practical consequences extend beyond cost. When an FOI request asks for all images related to a specific event or program, duplicates slow down retrieval, create version-control confusion and, in some cases, have led to incorrect or outdated images being provided in response to official requests.

For Canberra residents and public servants watching this week's activity, the immediate takeaway is straightforward: if your agency or institution has not already run a deduplication audit on its image libraries, the window to do so before the end of the 2025–26 financial year close-out period has passed, but the September quarter offers a clear second checkpoint. Teams managing digital assets are advised to check whether their content management platforms — including SharePoint, which is standard across most ACT government agencies — have native deduplication tools enabled, as many organisations have paid for the capability without activating it.