Boston City Hall Tackles Duplicate Image Problem in Digital Archives This Week

Boston's Office of Digital Innovation quietly escalated its cleanup of duplicate images inside the city's public-facing digital archives this week, targeting a backlog of redundant files that has accumulated across department websites, permitting portals, and the Boston.gov content management system since at least 2019. The effort, which began in earnest on June 30, is now expected to carry through mid-July.

The problem is straightforward, even if the fix is not. When city departments upload photographs — construction site progress shots, MBTA accessibility improvement records, housing inspection documentation — they routinely do so independently, with no central deduplication check. The result is thousands of near-identical images sitting in separate storage buckets, inflating server costs and cluttering search results for residents trying to navigate permit applications or zoning filings.

Why It Matters Right Now

Timing is not accidental. Mayor Michelle Wu's administration has made digital accessibility a stated priority since 2022, and Boston.gov handles an estimated 4.5 million unique visitors per year, according to figures the city published in its 2025 annual technology report. With the city's new Inspectional Services Department online portal — which went live on March 3, 2026, covering properties from Roxbury to East Boston — duplicate construction and property images began surfacing immediately in user-facing search returns, slowing load times and confusing applicants trying to track permit histories.

The scale of the redundancy became clear earlier this spring when an internal audit by the Department of Innovation and Technology, housed at City Hall on Cambridge Street, found more than 22,000 image files flagged as likely duplicates across 14 departmental subsystems. Staff were pulling the same JPEGs repeatedly into separate content folders — a photograph of a Dorchester three-decker uploaded once for a zoning filing, again for a neighborhood planning presentation, and a third time as a thumbnail in a BHA Housing Authority report.

The Boston Housing Authority, which manages properties including the Mary Ellen McCormack development in South Boston and the Bromley-Heath complex in Jamaica Plain, has been among the agencies most directly affected. BHA's digital filing system interfaces with both the city's permitting infrastructure and its own tenant communications platform, and overlapping image uploads between those systems have been flagged as a recurring friction point in IT support logs going back to fiscal year 2023.

What the Fix Looks Like

The current remediation uses a combination of perceptual hash comparison — a technique that identifies visually similar images even when file names or metadata differ — and manual review for files flagged as ambiguous. The Department of Innovation and Technology contracted the tool through an existing citywide software services agreement rather than issuing a new procurement, keeping the process inside budget allocations already approved for fiscal year 2026, which runs through June 30, 2027.

For residents using Boston's online services, the practical effect should be faster load times on the Inspectional Services portal and cleaner image results when searching permit histories by address. The city expects to complete the first round of deduplication for Dorchester and Jamaica Plain records — two neighborhoods with among the highest permit volumes in the current housing production push — before July 18.

Developers working the Fairmount Corridor, where the Wu administration has prioritized new housing production along the commuter rail line, have been among the heaviest users of the permit image system. A single mixed-use project on Blue Hill Avenue can generate dozens of inspection photographs across multiple filing events, each potentially duplicated if uploaded by different city staff members.

The longer-term fix will require a change to upload protocols across all 14 flagged departmental systems — a policy change that the Office of Digital Innovation is expected to circulate for internal review by August. For now, IT staff are working through the backlog manually for the highest-traffic record categories. Residents with active permits can still access their files normally through Boston.gov throughout the process, city communications staff confirmed in a public notice posted to the site on July 2.