How Canberra Stacks Up Against the World on Duplicate Image Replacement in Government Archives

Australia's federal government holds tens of millions of digitised images across its agency networks — and a significant portion of them are duplicates. Canberra, as the administrative heart of that system, is now at the centre of a quiet but consequential effort to identify, deduplicate and replace low-quality or redundant image files lodged across departmental repositories, a process that archivists and digital records managers say has been too long deferred.

The push matters now for a specific reason: the National Archives of Australia, based on Queen Victoria Terrace in Parkes, is midway through a multi-year digitisation program that has brought the duplication problem into sharp relief. When agencies submit digitised records for long-term preservation, duplicate image files inflate storage costs, complicate retrieval, and — critically — can mean a lower-resolution version of a document is retained while a sharper scan sits forgotten on a departmental server. The Archives has been working since at least 2023 to align its ingest protocols with its Digital Continuity 2020 policy framework, which sets minimum standards for image quality and metadata integrity across Commonwealth holdings.

What Canberra Is Actually Doing

The Australian Public Service Commission, headquartered in Canberra's CBD on Constitution Avenue, has flagged digital records hygiene as part of broader workforce capability uplift programs aimed at APS agencies through 2026. Several large departments — including those clustered in the Barton and Woden precincts — have begun internal audits of their image libraries, prompted partly by the transition to cloud-based records management platforms that charge by storage volume.

The Australian National University's College of Arts and Social Sciences has separately been working through its own institutional image archive, an effort accelerated after the university's Chifley Library underwent a cataloguing review in late 2024. The project involves cross-referencing thousands of scanned photographs and maps against the Libraries Australia database to flag exact and near-duplicate files before they are migrated to new infrastructure. That kind of institution-level action is increasingly common in the precinct, but coordination between agencies remains patchy.

Canberra's challenge is structural. Unlike a city government managing a single unified archive, the ACT and federal layers here operate largely in parallel. The ACT government's own Territory Records Office, which operates under the Territory Records Act 2002, manages records separately from the Commonwealth, meaning duplicate images can exist across both systems with no automatic reconciliation mechanism between them.

How Other Cities Are Approaching the Same Problem

Wellington, New Zealand's capital, offers a useful comparison. Archives New Zealand completed a deduplication pass across its digitised photographic holdings in 2024, using perceptual hashing — a technique that identifies visually similar images even when file names or metadata differ — and reported removing more than 14,000 redundant image files from its primary repository. The process freed roughly 2.3 terabytes of storage and, more importantly, allowed archivists to ensure the highest-resolution version of each document was the one indexed for public access.

Amsterdam's Stadsarchief has gone further, publishing its deduplication methodology as an open-source tool available to other municipal archives since early 2025. The Dutch model emphasises community verification — flagging suspected duplicates publicly and allowing researchers to confirm or dispute matches before deletion. No equivalent public-participation model exists yet in Canberra, though the National Archives does accept public feedback on its RecordSearch platform.

Singapore's National Archives completed a comparable exercise in 2023 across its oral history and image collections, with the process tied to a broader S$50 million investment in digital infrastructure announced by the National Library Board. Canberra's investment figures are harder to pin down; the National Archives' annual report for 2024-25 outlines capital works allocations but does not break out deduplication-specific expenditure as a line item.

For public servants in suburbs like Gungahlin and Belconnen who work remotely and submit digital records through agency portals, the practical advice from digital records specialists is straightforward: check whether your agency's records management system has deduplication settings enabled at point of upload, and confirm that image files meet the minimum 300 DPI resolution standard specified in the National Archives' Digital Preservation Policies before submission. Waiting until a migration project surfaces the problem is, according to archival best practice, considerably more expensive than catching it early.