Boston Archives and City Agencies Push to Root Out Duplicate Images From Public Digital Records

Boston's city government is moving to clean up years of duplicated images clogging its public-facing digital archives, a technical housekeeping effort that has picked up pace this week as agencies attempt to reconcile overlapping document management systems before a mid-July internal deadline. The effort touches municipal records ranging from building permit scans filed through the Inspectional Services Department on City Hall Plaza to digitized property photographs maintained by the Boston Assessing Department for neighborhoods including Dorchester and Jamaica Plain.

The push matters right now because the city has been migrating legacy databases onto a unified cloud platform over the past 18 months, and duplicate image files — sometimes dozens of copies of the same scanned deed or inspection photograph — slow retrieval times, inflate storage costs, and create version-control headaches for planners and residents trying to access accurate records. With housing production under active political pressure in Jamaica Plain and along the Blue Hill Avenue corridor in Dorchester, clean document records underpin the permitting pipeline that developers and community boards depend on.

What the Cleanup Actually Involves

The practical work involves running deduplication algorithms across file repositories and then manually reviewing flagged image clusters to confirm which version is authoritative. City IT staff, working alongside contractors engaged through the Mayor's Office of New Urban Mechanics — the innovation arm housed at One City Hall Square — began the review process in earnest after the June 30 close of the fiscal year, using the transition between budget cycles as a natural window to pause ingestion of new documents and audit existing ones.

The Boston Public Library's Digital Repository at the Copley Square branch has been a parallel focus. Librarians there have been deduplicating historical photograph collections since early 2025, but the July 2026 phase targets scanned municipal maps and building survey images from the 20th century that were digitized under multiple separate grant-funded projects and ended up stored in redundant folders. The library's digital preservation team estimates that roughly 15 percent of images in one specific mid-century architectural survey collection turned out to be exact or near-exact duplicates, consuming storage that could otherwise hold undigitized material.

The Inspectional Services Department, which processes thousands of building permit applications annually for addresses across the city, is also affected. When contractors submit photo documentation for projects — say, a triple-decker rehab on Bowdoin Street in Dorchester or a mixed-use proposal near the Green Street MBTA station in Jamaica Plain — those images frequently get uploaded multiple times through different staff workflows. The result is a sprawl of identical JPEG files tagged to the same parcel ID, complicating searches by both city staff and members of the public accessing records through the Analyze Boston open data portal.

Costs and the Road Ahead

Cloud storage is not free. The city's technology budget for fiscal year 2026, approved by the Boston City Council earlier this year, allocated funds for digital infrastructure under the Department of Innovation and Technology, and administrators have flagged unnecessary duplication as a recurring cost driver. Deduplication in enterprise environments typically reduces storage overhead by 20 to 40 percent depending on the document type, according to widely published industry benchmarks, though the city has not released its own projected savings figure for this specific effort.

For residents, the practical upshot is simpler: property records and permit documentation accessed through Analyze Boston or the City Clerk's office should become more accurate and faster to retrieve once the cleanup concludes. The mid-July internal deadline is a working target, not a public commitment, and more complex cases — images where metadata differs but visual content is identical — will likely require review into August.

Anyone who has submitted permit documentation for a property in recent years and wants to confirm their records are correctly filed can contact the Inspectional Services Department directly at its City Hall Plaza offices. The Boston Public Library's digital collections page also allows users to flag apparent duplicate records in public-facing finding aids, giving librarians a crowdsourced assist on the longer-term archival cleanup.