Canberra Officials Warn: Duplicate Files Drain Government Database Systems

Federal agencies based in the capital are sitting on enormous volumes of duplicate digital images — scanned documents, identity photos, planning maps and correspondence attachments stored multiple times across overlapping systems — and the bill for managing that redundancy is growing. The issue has landed on the agenda of several ACT-based institutions in mid-2026, as the Australian Public Service Commission pushes departments to consolidate their digital infrastructure ahead of a government-wide data governance review scheduled for later this year.

The problem is not new, but it has become harder to ignore. Federal departments headquartered along the Parliamentary Triangle corridor — from Treasury on Langton Crescent to Home Affairs facilities in Belconnen — have each undergone separate rounds of digitisation over the past decade. The result, according to digital records specialists who work with Commonwealth clients, is that agencies often hold the same scanned file in three or four locations simultaneously, with no automated tool flagging the duplication.

Why Canberra Feels This Acutely

Canberra's public service concentration means the duplicate-image problem is proportionally larger here than anywhere else in the country. The ACT hosts a disproportionate share of Commonwealth data centres and records management teams. The National Archives of Australia, on Queen Victoria Terrace in Parkes, has been working through a multi-year digitisation program that ingested millions of historical documents. Archivists familiar with that program have noted internally that without robust deduplication protocols baked in from the start, digitisation projects routinely generate redundant copies — particularly when multiple staff members scan the same physical file at different points in a workflow.

The Australian National University's School of Computing, based on the Acton campus, has published research examining automated image-matching techniques that could identify near-duplicate files even when file names and metadata differ. That research is directly relevant to the public sector challenge, given that agencies frequently rename files when moving them between systems, making simple hash-based deduplication insufficient.

The ACT government is navigating its own version of the issue. Access Canberra, which processes thousands of licensing and permit applications annually from its service centres in Belconnen and Tuggeranong, stores identity documents and supporting photographs as part of those transactions. A move to a unified digital case management platform — flagged in the ACT Budget handed down in June 2026 — is intended partly to address storage redundancies across those service delivery points.

What Specialists Are Recommending

Digital records consultants advising Commonwealth agencies are broadly recommending a three-step approach: audit existing repositories to establish a baseline count of duplicates, implement perceptual hashing tools capable of catching visually identical images regardless of format or file name, and enforce single-source-of-truth policies so newly ingested images are checked against the master repository before being saved.

The cost argument is concrete. Commercial cloud storage pricing for government-certified environments — such as those meeting the Australian Signals Directorate's requirements under the Protective Security Policy Framework — runs significantly higher per gigabyte than consumer-grade storage. Eliminating even a modest percentage of redundant image files across a mid-sized department can translate to measurable annual savings on infrastructure contracts.

At the University of Canberra's Faculty of Science and Technology in Bruce, researchers have been exploring machine-learning pipelines that flag suspected duplicates for human review rather than auto-deleting them — a cautious approach that suits the evidentiary requirements of government record-keeping, where premature deletion can create legal and compliance risks under the Archives Act 1983.

The practical next step for most agencies is a records audit, and that work will not be quick. Departments with legacy systems — some running document management software that pre-dates current APS digitisation standards — will need to export metadata inventories before any deduplication tool can be run effectively. The APSC's data governance review, expected to publish interim guidance in the fourth quarter of 2026, is likely to set minimum standards for exactly that kind of audit. Until then, the duplicate images keep accumulating.