Canberra's Digital Archive Problem: The Hidden Numbers Behind Duplicate Image Sprawl

ACT government agencies, federal departments clustered along Northbourne Avenue, and the two major universities are collectively managing digital image libraries where duplication rates routinely run between 30 and 60 per cent of total stored files, according to industry benchmarks published by data management firm Iron Mountain in its 2025 enterprise storage report. The problem has a dollar figure attached to it, and in Canberra — a city whose economy is almost entirely built around public administration and research — that figure is getting harder to ignore.

The timing matters. The ACT Government's Digital Strategy 2025–2028, released by the Chief Minister, Treasury and Economic Development Directorate, sets a target of reducing redundant data holdings across directorates by 2027. Cloud storage contracts across federal agencies are up for renewal cycles throughout this financial year, and departments are under pressure from the Department of Finance to demonstrate cost discipline on infrastructure spending. Duplicate image files — product shots, headshots, satellite imagery, policy document scans — are among the most common and least scrutinised sources of storage waste.

At the Australian National University in Acton, the university library and research data services teams manage holdings that span decades of digitised material. The ANU's research data repository, known internally as the ANU Data Commons, holds records running into the terabytes. The University of Canberra at Bruce faces a parallel challenge with its health research imaging collections. Neither institution has publicly released figures on duplication rates within those holdings, but a 2024 audit framework published by the Australian Research Data Commons recommended that institutions apply deduplication tooling before migrating legacy collections — a signal that the problem is widespread enough to warrant sector-wide guidance.

What the Numbers Actually Show

Enterprise storage costs in Australia averaged approximately $0.023 per gigabyte per month on hyperscale cloud platforms as of the first quarter of 2026, based on published pricing from AWS and Microsoft Azure. That sounds trivial. Scale it to an agency holding 500 terabytes of image assets with a 40 per cent duplication rate, and the redundant portion alone costs roughly $4,400 every month — more than $52,000 a year — for files that are, by definition, exact or near-exact copies of something already stored elsewhere. For a large federal department on Constitution Avenue, multiply that by an order of magnitude.

The ACT's own digital records, including spatial data collected by the Environment, Planning and Sustainable Development Directorate for projects like the Light Rail Stage 2 corridor through Civic and into Woden, generate continuous image outputs: aerial surveys, construction progress photography, environmental monitoring stills. Each project phase produces new batches, and without automated deduplication workflows, version control failures mean older copies persist alongside newer ones. The Suburban Land Agency, which oversees residential releases in Gungahlin and Belconnen, faces the same issue with land parcel imagery updated each time a development application moves through the system.

Fixing It: Tools, Timelines and the Practical Path Forward

Deduplication is not a new technology. Hash-based comparison tools — software that generates a unique fingerprint for each image file and flags identical or near-identical matches — have been commercially available since the early 2000s. The obstacle in Canberra's public sector context is governance, not capability. Agencies must establish clear data custodianship rules before running deduplication passes, because deleting a file that turns out to be the only surviving copy of a ministerial briefing photograph from 2019, for example, creates its own compliance problem under the Territory Records Act 2002.

The practical advice from the Australian Research Data Commons framework is straightforward: audit before you migrate, tag before you delete, and build deduplication into ingestion workflows so the problem stops compounding. For Canberra organisations beginning a storage review now, the window before end-of-financial-year contract renewals closes in August 2026 — which means procurement teams have roughly six weeks to incorporate deduplication requirements into new cloud storage tenders. The savings are real, the tools exist, and the regulatory framework already supports the work. The only question is whether anyone assigns it a priority above zero.