Canberra's Duplicate Image Problem: What Happens Next and the Key Decisions Ahead

Federal agencies based in Canberra are sitting on digital photo libraries running into the tens of millions of files, and a significant portion of that storage — across departments occupying the Barton and Parkes precincts — is eaten up by duplicate images accumulated over years of poor file management, staff turnover, and incompatible systems. The problem is not new, but the pressure to act is.

The reason the issue has sharpened now is money. The Australian Government's whole-of-government cloud storage contracts, managed through the Digital Transformation Agency on King Avenue in Barton, have grown substantially more expensive as archive sizes ballooned after the pandemic-era shift to remote work. Departments that moved to shared drives and collaboration platforms between 2020 and 2022 often did so without standardised naming conventions or deduplication protocols, leaving behind a tangle of near-identical files that no automated system has cleanly resolved.

The Canberra Agencies Caught in the Middle

The Australian National University in Acton and the University of Canberra in Bruce both face versions of the same institutional headache on the research side. ANU's research data services team has publicly acknowledged working through a backlog of legacy image repositories from scientific projects, some dating to the early 2010s, where multiple researchers independently saved copies of the same raw data imagery to different servers. UC's library and digital collections unit is dealing with a parallel challenge in its special collections digitisation program, where scanning batches occasionally produced duplicate TIFF files that were archived without cross-checking.

For the federal public service, the stakes are higher because the files involved often include sensitive ministerial photography, policy communication assets, and freedom-of-information request materials. Deleting the wrong version of a duplicate — even one that looks identical — can mean losing metadata, version history, or an original with superior resolution. The National Archives of Australia, headquartered on Queen Victoria Terrace in Parkes, sets the retention rules that govern what agencies can and cannot destroy, and its General Disposal Authority frameworks require agencies to demonstrate a file has no enduring value before it is removed. That process takes time and sign-off that most IT teams are not resourced to provide at scale.

The Decisions That Will Define the Next Phase

Three choices are converging simultaneously, and none of them are straightforward. First, agencies must decide whether to invest in automated deduplication software — tools that scan for hash-identical or perceptually similar images — or to allocate staff time to manual review. Industry pricing for enterprise-grade deduplication tools typically starts around $15,000 annually for mid-sized organisations, a figure that puts some smaller statutory bodies in the ACT in a difficult position heading into the 2026-27 budget cycle, which begins this month.

Second, there is the question of governance: who has the authority to approve deletion at scale? Inside the Australian Public Service, that authority is rarely vested in IT alone. Records managers, legal teams, and in some cases ministerial offices all have a stake. The Digital Transformation Agency has been developing updated guidance under its data and digital frameworks, but finalised operational standards for image deduplication specifically have not yet been released as of early July 2026.

Third — and perhaps most consequential — is the archival integrity question. When two files are functionally identical but carry different metadata histories, which one survives? The answer shapes how future researchers, historians, and FOI applicants will be able to reconstruct government activity. The National Archives has flagged this as a live concern in its broader digital preservation strategy work, though no binding directive specific to image duplication has been issued to date.

For public servants working out of buildings along London Circuit or in the Woden Town Centre offices of Services Australia and the Department of Social Services, the practical near-term reality is likely an agency-by-agency patchwork. Some will invest in tooling. Others will defer the problem into the next financial year. What the next six months will almost certainly produce is a clearer sense of which departments treated this as a governance problem — and which ones treated it as a storage bill.