apache / iotdb / #9996

47%

push

travis_ci

Pipe: Improve performance for 10000+ pipes (#11021)

Improvements:

* Cache the File objects to reduce the size of TsFileInsertionEvents.

* Limit the frequency of flushing TsFiles when cocurrently creating historical extractors.

* If cluster heartbeat doesn't need PipeMetaList, do not get into PipeTaskAgent. This will prevent datanode from turning UNKNOWN when many pipes are being created.

---------

Co-authored-by: Steve Yurong Su <rong@apache.org>

28 of 28 new or added lines in 3 files covered. (100.0%)

80382 of 168381 relevant lines covered (47.74%)

0.48 hits per line