OpenCOMPES / sed / 6471550710

92%

push

github

NaN filing between partitions with overlap (#165)

* simplify NaN filling in FlashLoader and make it lazy

* add the map_overlap method to do intrafile filling

* add ffill as dfops with tests

* add optional df len computation

* add test for df len compute

* implement multipass ffill

* add config for ffill multipass iteration

* add pyarrow

* load metadata directly for parquet files using pyarrow or speedup

---------

Co-authored-by: Steinn Ymir Agustsson <sagustss@uni-mainz.de>

72 of 72 new or added lines in 3 files covered. (100.0%)

4285 of 4733 relevant lines covered (90.53%)

0.91 hits per line