How Canberra's Government Agencies Got Buried in Duplicate Images — and What It's Costing Them

Walk into any IT services meeting at a Canberra federal agency today and one problem comes up faster than almost any other: the image duplication crisis quietly draining storage budgets and making records management a bureaucratic nightmare. Agencies across the Parliamentary Triangle are running digital asset libraries bloated with duplicate photographs, scanned documents and graphic files — sometimes storing the same image dozens of times across different servers, SharePoint instances and legacy archive systems.

The problem did not appear overnight. It is the accumulated result of decisions made across roughly three decades of digitisation, spanning rushed scanning programs in the late 1990s and early 2000s, a wave of machinery-of-government changes under successive federal administrations, and the COVID-era scramble to move on-premises infrastructure to cloud platforms without adequate deduplication protocols in place.

How Canberra Ended Up Here

The origins trace back to the establishment of the National Archives of Australia's digital preservation programs in the early 2000s, when agencies were encouraged to digitise paper records rapidly but given little standardised guidance on file naming conventions or metadata tagging. Departments scanning files at locations like the Gungahlin Service Centre or the Belconnen offices of Services Australia created separate local copies of assets that already existed in central repositories — sometimes intentionally, because staff didn't trust that centralised systems would stay accessible, sometimes through sheer administrative oversight.

The problem compounded each time a federal agency was restructured. When the Department of Human Services merged into Services Australia in 2019, for example, two entirely separate image libraries — built on different platforms, managed by different vendor contracts — were nominally brought together. In practice, deduplication was deferred. The same dynamic played out at the Australian Public Service Commission, whose Civic Square offices hold records inherited from predecessor bodies stretching back years.

ACT government agencies have their own version of the same story. The ACT Government's Shared Services ICT division, which supports departments including Transport Canberra and the ACT Education Directorate, has flagged duplicate digital assets as a cost pressure in its infrastructure planning cycles. Records held at the Telstra Building in Phillip and at the Nishi Building offices along NewActon precinct have been flagged in internal planning documents as areas where consolidation is overdue — though the pace of that work has been slow.

The Cost Is Real, If Hard to Pin Down Precisely

Cloud storage is not free. Microsoft Azure and Amazon Web Services both charge Australian government customers for data volume, and industry benchmarks suggest that enterprise organisations typically find between 20 and 40 percent of their stored images are duplicates or near-duplicates when they conduct a proper audit. For agencies running petabytes of records — as the Australian Taxation Office and the Department of Home Affairs both do — that redundancy translates directly into six-figure annual overspend on storage contracts alone.

The Australian National University's 3A Institute, based on the Acton campus, has contributed research into data governance frameworks that touch on exactly this kind of structural inefficiency. The University of Canberra's Faculty of Science and Technology, located on Kirinari Street in Bruce, has similarly produced graduate work examining metadata standards in public sector archives. Neither institution has been brought formally into the remediation effort at scale.

The Australian Government's Digital Transformation Agency released its Data and Digital Government Strategy in 2023, which set targets for agencies to improve data quality and reduce redundancy — but implementation timelines vary widely across the public service, and enforcement mechanisms are limited.

What happens next depends largely on whether the current round of agency portfolio budget statements, due to flow through to departmental ICT plans by the end of the 2026–27 financial year, actually earmarks funding for deduplication tooling and audits. Agencies that haven't started should look at open-source perceptual hashing tools and established vendor products that can scan SharePoint and cloud storage environments without requiring significant downtime. The National Archives has published guidance on digital preservation standards that provides a starting framework. For public servants in Canberra working with image libraries right now, the practical advice is straightforward: don't wait for a top-down directive. Run a sample audit on your own team's shared drives first. The scale of what you find will make the case for more resources better than any policy paper.