ACT government agencies and federal departments headquartered in Canberra are staring down a critical fork in the road over how to handle tens of thousands of duplicate digital images clogging their records management systems — and the clock on a series of consequential decisions is ticking louder than most public servants want to admit.
The issue has sharpened this year because the National Archives of Australia, based on Queen Victoria Terrace in Parkes, has been tightening its digital preservation standards ahead of compliance reviews scheduled for the second half of 2027. Agencies that cannot demonstrate clean, deduplicated digital records risk failing those reviews, which carry administrative and reputational costs for departments already under scrutiny over efficiency spending.
At its core, the duplicate image problem sounds mundane — the same scanned document, photograph or graphic saved under multiple file names across multiple servers — but the downstream consequences for records integrity, storage costs, and freedom-of-information processing times are anything but. For a city whose entire economic engine runs on the public service, getting this right matters in ways it simply does not in other Australian capitals.
The Local Stakes: From Civic to Gungahlin
Two institutions illustrate the challenge at either end of Canberra's geography. The Australian National University in Acton holds one of the largest collections of digitised historical photographs in the southern hemisphere through its archives and the Noel Butlin Archives Centre. Managing duplicates in collections of that scale — where a single glass-plate negative may have been scanned multiple times over two decades of digitisation projects — requires both sophisticated software and human curatorial decisions about which version is the canonical record.
Out in Gungahlin, where the ACT government has been consolidating suburban service centres, the problem is more prosaic but no less pressing. Digital intake processes at service counters routinely generate duplicate images of identity documents, tenancy agreements and planning forms. Staff at those counters are not archivists; they are processing high volumes of daily transactions, and the deduplication burden falls upstream on ICT teams already stretched across a territory government of roughly 23,000 employees.
The University of Canberra's Health Research Institute in Bruce has been developing automated image-matching tools as part of broader research into digital records management, though the commercialisation pathway for that work remains unclear.
Data, Costs and the Decision Points Ahead
Storage is not cheap. Enterprise cloud storage for Australian government agencies running on whole-of-government contracts through the Digital Transformation Agency typically costs between $0.02 and $0.05 per gigabyte per month depending on tier — figures that compound fast when duplicate image files number in the millions. A conservative agency with five million duplicate image files averaging two megabytes each is carrying roughly 10 terabytes of redundant data, translating to several thousand dollars in unnecessary monthly storage costs alone, before accounting for the labour costs of searching and retrieving records polluted by duplicates.
The ACT government's Digital Strategy 2025–2028, released by the Chief Minister, Treasury and Economic Development Directorate, identifies records deduplication as a second-tier priority under its data quality workstream — important enough to name, but not yet funded with dedicated project resources.
Three decisions will define how this plays out over the next 18 months. First, agencies must choose between retrospective bulk deduplication — running automated tools across existing archives — and a forward-only approach that cleans intake processes but leaves historic backlogs untouched. The retrospective path is more expensive and disruptive; the forward-only path is cheaper but leaves compliance exposure in place. Second, those opting for automated tools must select and procure them, a process that under ACT government procurement rules above $25,000 requires a competitive tender. Third, any agency touching records that fall under the Archives Act 1983 must coordinate with the National Archives before deleting any file flagged as a duplicate, or risk destroying a record with legal standing.
For Canberra's public service workforce — concentrated along the Northbourne Avenue corridor and spreading into Barton and Woden — the practical advice from records management specialists is consistent: start with an audit before committing to any tool or approach, document every decision with a dated business case, and loop in the National Archives early rather than late. The mid-2027 deadline feels distant. It is not.