Canberra's Duplicate Image Problem: How the Capital Stacks Up Against Wellington, Ottawa and Edinburgh

Federal agencies headquartered in Canberra are sitting on tens of thousands of duplicate digital images across their internal content management systems, a problem that has quietly ballooned alongside years of remote-work uploads, machinery-of-government reshuffles and the rushed digitisation drives of the early 2020s. The issue is not cosmetic. Duplicate image files inflate storage costs, slow search functionality and create compliance headaches under the Archives Act 1983, which requires agencies to manage records — including visual assets — with clear provenance and version control.

The timing is pointed. Sydney just recorded its hottest June since 1859, and federal environment and climate agencies, which produce large volumes of satellite imagery, heat-mapping graphics and infographics for public communication, are among the heaviest generators of duplicated visual content. When the same Bureau of Meteorology graphic gets saved, re-exported and re-uploaded by a dozen different officers across shared drives and SharePoint libraries, the deduplication task compounds quickly.

What Canberra Is Actually Doing About It

The Australian National University's digital preservation team in Acton has been working since early 2025 on frameworks for identifying and consolidating duplicate image records within its research data repositories — an effort that mirrors, at smaller scale, what the National Archives of Australia at its Mitchell facility in Hume is grappling with across the broader Commonwealth record estate. The National Archives declined to provide specific figures on the scope of its current deduplication backlog when contacted this week. ANU's library and digital collections unit, based on Chifley Drive, has adopted a hashing-based detection method — essentially generating a unique digital fingerprint for each image file — to flag identical or near-identical files before they are ingested into long-term storage.

The ACT government is dealing with a parallel, if smaller, version of the same problem. The ACT Digital Strategy 2025–2028, published by the ACT Government's digital office, identifies records rationalisation as a priority workstream, though it does not specify image deduplication by name. Service agencies processing planning documents for growth suburbs such as Gungahlin and Belconnen — where development application volumes have risen sharply — routinely attach the same site photos to multiple submissions, generating record-keeping redundancies that staff must later resolve manually.

Wellington and Ottawa Are Further Along

Comparable capital cities with similarly public-service-heavy economies have moved more decisively. Statistics New Zealand, based in Wellington, completed a whole-of-government digital asset audit in late 2024 and reported consolidating storage across central agencies by roughly 18 percent in the first year of its deduplication program, according to the agency's 2024–25 annual report. Ottawa's Treasury Board Secretariat mandated automated deduplication tooling across core federal departments from January 2025, requiring agencies above a defined headcount threshold to implement ISO 14721-compliant digital object management by June 2026.

Edinburgh, home to the Scottish Government's digital directorate and a dense cluster of public research institutions, piloted an AI-assisted duplicate detection tool across National Records of Scotland holdings in 2024. The tool, developed in partnership with the University of Edinburgh's informatics faculty, reportedly reduced manual review hours by around 40 percent during its pilot phase — a figure cited in a University of Edinburgh research summary published in March 2025.

Canberra has no equivalent mandated standard in place yet. The Digital Transformation Agency, which sits on London Circuit in the city centre, sets whole-of-government digital policy but has not published a specific framework addressing image asset deduplication as of July 2026. Individual agencies are making their own calls, meaning approaches vary from the sophisticated hash-matching used at ANU to simple manual review conducted by already-stretched ICT teams.

For public servants in Lyneham, Barton or Woden working in records and information management roles, the practical upshot is straightforward: check whether your agency's SharePoint or content management configuration flags duplicate uploads at point of entry. If it does not, a request to your ICT helpdesk to enable built-in Microsoft Purview duplicate detection — a feature included in most existing government Microsoft 365 enterprise licences — is a low-cost first step. The alternative is a much larger cleanup bill later, of the kind Wellington and Ottawa are only now finishing paying.