doruirimescu / stateful-data-processor / 26124276410

push

github

MINOR: Add ParallelStatefulDataProcessor

Subclass of StatefulDataProcessor that distributes pending items across
a ThreadPoolExecutor (n_workers=4 default). Pre-filters already-processed
and skip-listed items before submitting; results accumulate in self.data
and are written to file once by the base run() method after all workers
finish. Inherits signal handling, verbose_skip, skip_list, and reprocess
support from the base class.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

26 of 26 branches covered (100.0%)

Branch coverage included in aggregate %.

39 of 40 new or added lines in 1 file covered. (97.5%)

143 of 178 relevant lines covered (80.34%)

2.41 hits per line