brawer / osmdiffs / 43197426948

94%

Build Type

push

github

Committed by web-flow

Commit Message

feat(spider-stats): keep ATP's dataset attributes per spider (#940)

import_atp now keeps the dataset_attributes of each spider's
FeatureCollection, such as license and attribution, in
alltheplaces.spider-counts.tsv, and compute_spider_stats writes them
to spider-stats.parquet as a MAP<UTF8, UTF8> column. Downstream tools
can join on atp.fetched.spider instead of repeating them on every row
of conflated.parquet.

Counts files from before are still read, without attributes, and
import_atp counts again where the zip is there.

Fixes #910.


Claude-Session: https://claude.ai/code/session_01Ttfb2KDndfjnQEycP3Ay6G

Co-authored-by: Claude <noreply@anthropic.com>

Coverage Stats

136 of 139 new or added lines in 3 files covered. (97.84%)

1 existing line in 1 file now uncovered.

19162 of 20354 relevant lines covered (94.14%)

3296.4 hits per line