How Boston's Public Records Ended Up Full of the Same Photo Twice — And What the City Is Doing About It

Boston's municipal digital archives contain thousands of duplicate images — the same photograph filed under different case numbers, project folders, and departmental databases — a problem that has compounded quietly for more than a decade and is now forcing a reckoning inside City Hall. The issue touches everything from housing permit documentation in Dorchester to MBTA accessibility records submitted to the city's planning departments on Cambridge Street.

The problem matters right now because Mayor Michelle Wu's administration has staked a significant portion of its housing production agenda on faster permitting turnarounds, particularly for projects in Jamaica Plain and the South End. Duplicate image files slow automated processing systems, trigger false flags in document review queues, and in some cases have caused inspectors to re-examine properties that had already cleared review — adding days or weeks to timelines that the Wu administration has publicly committed to shrinking.

A Problem Built Over Years of Expansion

The roots go back to the early 2010s, when individual city agencies began digitising records independently and without a unified file management standard. The Boston Planning & Development Agency, then still operating as the Boston Redevelopment Authority, ran its own image repository. The Inspectional Services Department maintained a separate system. The Public Works Department used a third. When the city later attempted partial integration through its Accela permitting platform — a rollout that began in earnest around 2017 — images migrated across systems without deduplication protocols in place. Files that existed in two departments simply existed twice.

By the time the City of Boston launched its updated open data portal on Analyze Boston in 2021, staff had already flagged recurring anomalies: images with different metadata timestamps but identical pixel content appearing across zoning appeal files and building inspection records. A 2023 internal audit of the Inspectional Services Department's digital archive, according to reporting at the time by civic technology observers, identified duplication rates in some project folders exceeding 30 percent.

The MBTA's parallel records — submitted to Boston's planning offices as part of the Green Line Extension documentation and various Bus Rapid Transit corridor studies along Washington Street — added another layer. Transit agencies and the city used different naming conventions, meaning the same site photograph could exist under a state-assigned asset ID and a city-assigned permit number simultaneously, with no automated cross-reference to flag the overlap.

The Cleanup Effort Taking Shape

The Wu administration's Office of New Urban Mechanics, based at City Hall on Cambridge Street, has been working since early 2025 with the city's Department of Innovation and Technology to pilot a deduplication tool across a subset of Inspectional Services records. The pilot focused initially on files tied to the 2024 Dorchester housing production push — roughly 400 active project folders along the Fairmount Corridor — and used perceptual hashing, a technique that identifies near-identical images even when file names differ.

Results from that pilot have not been formally published, but the program's existence was referenced in the city's fiscal year 2026 technology budget submitted to the Boston City Council in November 2025. The budget line allocated $340,000 for digital records modernisation across three departments, with deduplication infrastructure listed as a primary use case.

For residents and developers trying to navigate the permitting process — particularly those pursuing affordable housing projects in Jamaica Plain's Green Street corridor or commercial conversions near Uphams Corner in Dorchester — the practical upshot is this: incomplete or redundant documentation in a file can still stall a review, regardless of how the duplication originated. Applicants are currently advised by Inspectional Services staff to include clearly labelled, sequentially numbered photographs in permit submissions, with dates embedded in the file metadata, to reduce the chance of mis-sorting during intake.

The deduplication pilot is expected to expand citywide by the end of fiscal year 2027. Until then, the archive remains a patchwork — a product of fifteen years of agencies moving fast and filing twice.