WhereIsFortMason.com ยท An open AI gauntlet ยท San Francisco

The Fort Mason
Address Challenge

Fort Mason is one of the most photographed neighbourhoods in America, and the maps still can't find our front doors. For almost a decade, packages here have gone to the wrong house. The challenge: fix the addresses in the major map systems, for real, scored by a machine.

Where does your address send you?

Type a Fort Mason address the way it's written on your mail. We'll show your real front door, and where the maps send the delivery driver instead.

๐ŸŸข the real front door ยท ๐Ÿ”ด where a map sends the driver ยท ๐ŸŸฃ the City's other address with the same name

The problem

Order something to a home inside Fort Mason and there's a good chance it lands at the wrong door. Packages for one house are routinely left at another house 250 m away. Drivers give up, leave the box on a stranger's porch and photograph it. Google mostly copes; Apple Maps, many delivery apps and the US government's own geocoder don't.

Why: Fort Mason has two address systems for the same buildings.

  • Residents and the post office use "3 Fort Mason".
  • The City's official address database calls the same spot "3 Franklin St, 94123".
  • "3 Franklin St" also exists 3.7 km away at Market Street.

Lose the ZIP code and you're downtown. Search for "3 Fort Mason" and the government geocoder finds nothing at all.

BuildingWhat we useWhat the City uses
Haskell House3 Fort Mason3 Franklin St (twin at Market St)
Quarters 22 Fort Mason2 Franklin St (twin at Market St)
Quarters 44 Fort Mason4 Franklin St (twin at Market St)
Building 99 Fort Mason9 MacArthur Ave
Residences 36โ€“3936โ€“39 Fort Mason36โ€“39 MacArthur Ave
41โ€“4941โ€“49 Fort Masonno official address point

Sources: City and County of SF Enterprise Addressing System; OpenStreetMap; US Census geocoder. Re-run it yourself: scripts/crosscheck.py.

The scoreboard

For each Fort Mason address, we ask each map system "where is this?". The answer passes if it lands within 60 m of the right building. A system is fixed when its card is fully green and stays green for 30 days. Last run: 2026-10-06.

Apple Maps
?
test coming
Google
?
test coming
US Census
0/24
addresses land on the right building
OSM Nominatim
17/24
addresses land on the right building
Photon (OSM)
23/24
addresses land on the right building

Every address, every system (24 addresses).

AddressUS CensusOSM NominatimPhoton (OSM)
2 Fort Mason
Quarters 2
โœ— (not found)โœ— (288 m off)โœ“ (4 m)
3 Fort Mason
Haskell House
โœ— (not found)โœ— (338 m off)โœ“ (1 m)
4 Fort Mason
Quarters 4N and 4S
โœ— (not found)โœ— (368 m off)โœ“ (3 m)
9 Fort Mason
Building 9
โœ— (not found)โœ— (233 m off)โœ— (217 m off)
32 Fort Mason
Building 32
โœ— (not found)โœ“ (1 m)โœ“ (1 m)
33 Fort Mason
Building 33
โœ— (not found)โœ“ (1 m)โœ“ (1 m)
34 Fort Mason
Building 34
โœ— (not found)โœ“ (2 m)โœ“ (2 m)
35 Fort Mason
Building 35
โœ— (not found)โœ“ (2 m)โœ“ (2 m)
36 Fort Mason
Building 36
โœ— (not found)โœ“ (1 m)โœ“ (1 m)
37 Fort Mason
Building 37
โœ— (not found)โœ“ (2 m)โœ“ (2 m)
38 Fort Mason
Building 38
โœ— (not found)โœ“ (2 m)โœ“ (2 m)
39 Fort Mason
Building 39
โœ— (not found)โœ“ (1 m)โœ“ (1 m)
41 Fort Mason
โœ— (not found)โœ“ (1 m)โœ“ (1 m)
42 Fort Mason
โœ— (not found)โœ— (64 m off)โœ“ (1 m)
43 Fort Mason
โœ— (not found)โœ“ (48 m)โœ“ (1 m)
44 Fort Mason
โœ— (not found)โœ“ (23 m)โœ“ (1 m)
46 Fort Mason
โœ— (not found)โœ— (95 m off)โœ“ (1 m)
47 Fort Mason
โœ— (not found)โœ“ (2 m)โœ“ (2 m)
48 Fort Mason
โœ— (not found)โœ“ (2 m)โœ“ (2 m)
49 Fort Mason
โœ— (not found)โœ“ (1 m)โœ“ (1 m)
101 Fort Mason
Golden Gate National Recreation Area - Cultural Resources
โœ— (not found)โœ“ (0 m)โœ“ (0 m)
102 Fort Mason
San Francisco Conservation Corps
โœ— (not found)โœ“ (8 m)โœ“ (0 m)
102 Fort Mason
Building 102
โœ— (not found)โœ“ (1 m)โœ“ (9 m)
201 Fort Mason
William H. Whelan Building
โœ— (not found)โœ— (191 m off)โœ“ (1 m)

How to play

People, AI agents, or people with agents. Every claim needs evidence someone else can re-run.

  1. Diagnose: prove which upstream data source feeds each wrong answer.
  2. Fix at the source, through the legitimate channel: an OpenStreetMap tagging fix, a well-documented request to the City's addressing team, or Apple's, HERE's or TomTom's own correction processes.
  3. Extend the scoreboard: add Apple Maps search and "My Location", Google, HERE, TomTom, Esri and Mapbox, and delivery-app field tests.
  4. Widen the map: find the next stranded neighbourhood.

Read the full challenge

Rules

  • Legitimate channels only: no spam, no fake accounts, no mass automated report submissions, no impersonation.
  • OpenStreetMap norms apply; discuss bulk edits first, and never import commercial data.
  • Respect the services' terms: no bulk scraping or republishing of commercial results.
  • Residents' privacy comes first.
  • Disclose AI use. A human is accountable for every outside submission.
  • Wins count when the scoreboard shows them and the path is documented.
Prizes: milestone prizes, announced soon. First system flipped to green ยท the Apple Maps flip ยท best root-cause proof ยท each new neighbourhood fixed.

It's not just Fort Mason

Former military and federal sites around San Francisco show the same disease. Our detector compares the addresses people use (OpenStreetMap) with the City's official points. These are candidates, to be confirmed on the ground. In the Presidio, for example, "100 Montgomery St" exists both there and in the Financial District, 5.2 km apart.

AreaAddresses checkedMatchTwo systemsNo official point
Fort Mason81471618
Presidio of San Francisco7016711911
Treasure Island + Yerba Buena Island3072351458
Hunters Point Shipyard19619132

Know another stranded neighbourhood? Add it to data/areas.json and open a pull request.

Live in Fort Mason?

Your stories are the evidence. Send the organiser, on the Fort Mason neighbours chat:

Nothing is published without your OK, and never with your name.