diffed-places / pipeline / 22685240312

97%

Build Type

push

github

Committed by web-flow

Commit Message

Write OSM ways into Parquet file, using centroids as points (#174)

On a 2018 MacBook Pro with 6 Intel CPU cores, assembling the
Parquet file for the OSM planet of 2026-01-19, restricted to
the coverage area of AllThePlaces 2026-01-03, now takes
37 minutes, starting from the output of the filtering phase.
The resulting `osm.parquet` file is 1.5 GB in size.

Previous runs had much shorter timings and smaller file sizes,
but this was due to a bug in the underlying OpenStreetMap PBF
reader which was silently omitting most data.

Run Details

107 of 110 new or added lines in 5 files covered. (97.27%)

3 existing lines in 1 file now uncovered.

2284 of 2362 relevant lines covered (96.7%)

108.71 hits per line