The Hidden Numbers Behind Canberra's Duplicate Image Problem in Government Digital Archives

Canberra's government digital repositories contain an estimated tens of thousands of duplicate image files, inflating storage costs and slowing down records management systems across multiple ACT and federal agencies based in the parliamentary triangle and surrounding suburbs. The scale of the problem has come into sharper focus this year as agencies face renewed pressure to audit their digital holdings ahead of a broader data governance push scheduled for the second half of 2026.

The timing matters. The federal government's digital records framework, administered through the National Archives of Australia on Queen Victoria Terrace in Parkes, requires agencies to conduct periodic reviews of their stored assets. With cloud storage pricing shifting upward across the industry — enterprise-grade object storage now commonly running at between $0.02 and $0.04 per gigabyte per month depending on contract tier — even a modest accumulation of duplicate image data across a large agency can translate into tens of thousands of dollars in avoidable annual expenditure.

What the numbers actually show

Digital asset audits conducted in comparable government environments in other Australian jurisdictions have found duplicate image rates of between 18 and 34 percent of total stored image files, according to published findings from state government efficiency reviews in recent years. Applied conservatively to the ACT public service, which employs roughly 23,000 people across directorates concentrated in Civic, Barton and Phillip, even an 18 percent duplication rate across departmental shared drives represents a meaningful and largely invisible drain on IT budgets.

The Australian National University, based in Acton, and the University of Canberra in Bruce both operate digital asset management systems for research image libraries running into the hundreds of thousands of files. University IT administrators have long grappled with the same core problem: researchers uploading the same high-resolution image files multiple times across different project folders, with no automated deduplication running at the storage layer.

The mechanics are straightforward. When a staff member exports a photograph from a camera, uploads it to a shared drive, emails it to a colleague, attaches it to a report, and archives that report, a single image can produce four or five separate stored copies inside the same organisation — none of them flagged as redundant by default file systems. Multiply that across a directorate that processes thousands of images a year for publications, social media, Freedom of Information responses and internal briefings, and the numbers compound quickly.

Detection, cost and what agencies can do

Deduplication software uses a method called hashing — generating a unique numerical fingerprint for each file — to identify identical images regardless of their filename or storage location. Tools capable of running this process across enterprise-scale storage environments are available at annual licence costs ranging from a few hundred dollars for small deployments to well above $10,000 for whole-of-government rollouts. The ACT Government Shared Services centre, which manages IT infrastructure for multiple ACT directorates from its operations base in Fyshwick, is understood to have assessed several such tools as part of broader digital efficiency work, though no formal public procurement outcome has been announced.

For agencies sitting on years of unaudited image libraries, the practical starting point is a baseline audit — running a hash-based scan across all image directories to generate a duplication report before any files are deleted. Best practice, as documented in guidance published by the Digital Transformation Agency in Sydney and applicable to ACT-based federal entities, calls for retaining one confirmed original and archiving a deletion log rather than simply purging files without record.

The financial case for acting is not complicated. Storage that costs $0.03 per gigabyte per month adds up to $360 per terabyte per year. An agency holding five terabytes of image data with a 25 percent duplication rate is paying roughly $450 annually to store files it already has. Across a dozen agencies in a government city the size of Canberra, the aggregate figure becomes worth a line in a budget review. The audit takes days. The savings run indefinitely.