pirl-unc / tsarina / 27784381517

Build # 27784381517

Build Type

push

github

Committed by web-flow

Commit Message

Reuse hitlist download_to_file for reference fetch (progress + cache status) (closes #133) (#134)

reference_data.download() delegated the transfer to datacache, which buffers the
whole file in memory (requests.get().content) with no progress — a ~200 MB HPA TSV
looked like a hang. Route it through hitlist's new download_to_file (>=1.42.0)
instead: streamed, progress-reporting, cache-aware, with .zip/.gz decompression.

- download(): swap datacache._download_and_decompress_if_necessary for
  download_to_file(..., decompress=True); add verbose; skip manifest churn on a
  cache hit (the helper prints the cache-status line). datacache stays only for
  cache-dir resolution.
- tsarina data fetch already benefited via the hitlist.downloads re-export; also
  re-export download_to_file for discoverability.
- Tests: stub download_to_file (faithful cache semantics) + an end-to-end test
  through the real helper decompressing an HPA-style .zip.
- Bump hitlist floor >=1.42.0; version 1.18.2 -> 1.19.0.

datacache's in-memory limitation filed upstream: openvax/datacache#49.

Coverage Stats

2751 of 3719 relevant lines covered (73.97%)

0.74 hits per line

Source File

Press 'n' to go to next uncovered line, 'b' for previous

Source Not Available