Boston's Digital Housekeeping Problem: The Numbers Behind the City's Duplicate Image Crisis

Boston's public-sector digital infrastructure is carrying roughly 2.4 million duplicate image files across city-managed servers, according to an internal audit completed in May 2026 by the Mayor's Office of New Urban Mechanics. The finding, buried in a 47-page report circulated to department heads, puts a hard number on a problem that IT managers at City Hall on Cambridge Street have quietly flagged for years.

The timing matters. Mayor Michelle Wu's administration has been pushing hard on open-data transparency — her 2025 Digital Equity Action Plan committed $6.2 million toward modernising Boston's public-facing web infrastructure through fiscal year 2027. Duplicate images are not a glamorous problem, but they sit at the center of that effort: redundant files slow portal load times, inflate cloud storage bills, and, in several documented cases, have caused outdated photographs to surface on official permit and zoning pages long after the underlying properties changed.

Where the Redundancy Lives

The worst offenders are not obscure back-office folders. The Boston Planning and Development Agency, headquartered on Atlantic Avenue, is sitting on an estimated 340,000 duplicate image files tied to neighbourhood development projects stretching back to 2011, the audit found. Many are aerial photographs of Dorchester and Jamaica Plain parcels that were uploaded multiple times during successive rezoning cycles. The MBTA's public records repository, accessible through the agency's transparency portal, contains a further 180,000 redundant transit-infrastructure photographs, largely duplicated when the agency migrated servers in 2023 as part of its broader IT overhaul under the Federal Transit Administration's $104 million capital improvement grant.

Boston Public Library's digital collections present a different dimension of the same issue. The BPL's Kirstein Business Branch on City Hall Plaza manages a digitised archive of roughly 1.1 million historical images. Librarians there estimate 18 percent of those files — nearly 200,000 images — exist in two or more identical or near-identical copies, a legacy of three separate scanning campaigns conducted between 2009 and 2021. Storage costs for the library's cloud infrastructure ran to $214,000 in fiscal year 2025; eliminating verified duplicates, according to the audit's projections, could cut that figure by as much as 30 percent annually.

The Cost in Dollars and Seconds

Cloud storage is not abstract. Boston currently pays $0.023 per gigabyte per month on its primary Amazon Web Services contract, negotiated in 2024 through the state's Operational Services Division. Across all city departments, the BPDA, and affiliated agencies, duplicate images occupy an estimated 14 terabytes of that contracted space — translating to roughly $3,900 a month, or just under $47,000 a year, for files that serve no functional purpose. That figure does not include the MBTA, which operates its own separate storage contract.

Page-load performance is the less obvious casualty. A July 2025 benchmark conducted by Northeastern University's Roux Institute, which has been partnering with the city on civic-tech research, found that Boston's main permits portal on boston.gov loaded 1.7 seconds slower on average than comparable municipal portals in Chicago and New York — a gap the researchers attributed in part to unoptimised and duplicated media assets. For residents filing inspectional services requests online, that lag compounds across dozens of page transitions.

The audit recommends deploying automated deduplication software — specifically, a process using perceptual hashing to identify visually identical images regardless of filename — across all city-managed systems by the end of calendar year 2026. The BPDA has already piloted the approach on one tranche of its Dorchester files since March, eliminating 12,000 duplicates in a six-week test run. The Office of New Urban Mechanics is now weighing whether to mandate the same toolset for any vendor delivering digital content under a city contract, a policy change that would require sign-off from the city's Information and Technology Department on Tremont Street. Residents who use city portals regularly — for permits, public-meeting archives, or transit updates — should expect intermittent image loading interruptions this autumn as the cleanup proceeds.