jzombie / rust-sec-fetcher / 25087183531

65%

Build Type

push

github

Committed by web-flow

Commit Message

Add 10-K Item 1 and Item 7 pulls (#55)

* Prototype 10-K section retrievals

* dynamic 10-K section extractor + CIK lineage system

Replace hardcoded Item 1/7 struct with a scraper-based extractor that
dynamically discovers and returns all numbered sections (Item 1, 1A, 2,
3, 7, 7A, 8, …) keyed as a HashMap. Use a widest-span heuristic to
distinguish body sections from TOC/cross-reference tokens.

Add fetch_related_ciks / fetch_all_entity_submissions for predecessor
CIK tracking (e.g. GOOG → Google Inc).

- TenKSections: HashMap<String, String> with .get("item_7"), .item1(),
  .item7(), .keys(), .iter() accessors
- ANY_ITEM_RE: single regex replaces per-item hardcoded patterns
- scraper DOM text-node traversal for HTML (fixes table-cell anchoring)
- line-based tokenizer for SGML/plain-text
- 15/15 tenk_sections_tests pass across SGML (1994–1996), early HTML
  (2003–2009), iXBRL (2016–2017), and modern HTML (2019–2024) fixtures
- 7/7 cik_lineage_tests pass (GOOG/GOOGL predecessor chain verified)

* Extract parsers

* cargo fmt

* Prototype arbitrary item parsing

* Add related items

* Add enum for 10-K items

* Extract test fixtures into separate workspace crate

* Sort workspace deps

* cargo fmt

* Enable config file to be found from subdirectories

* Prototype 10-K item auditing

* Improve robustness against malformed documents

* Add merge+sort+dedup logic to 10-K submission fetch

Also deduplicates test fixture loaders.

* Merge 10-K/A and 10-K405/A

* Rename collect_10k_filings and add comments

* Store raw .htm/.txt files for 10-K auditing

* Add example for converting direct files to Parquet

* Fix intermediate directory

* Add prototype 10-K to Parquet converter

* Bump clap from 4.6.0 to 4.6.1 (#52)

* Bump tokio from 1.50.0 to 1.51.1 (#49)

Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.50.0 to 1.51.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.50.0...... (continued)

Coverage Stats

1053 of 1603 new or added lines in 38 files covered. (65.69%)

5 existing lines in 3 files now uncovered.

3678 of 5678 relevant lines covered (64.78%)

7879.65 hits per line