apache / iotdb / #10003

48%

master: 47%

push

travis_ci

Pipe: Improve performance for 10000+ pipes (#11021) (#11051)

Improvements:

* Cache the File objects to reduce the size of TsFileInsertionEvents.

* Limit the frequency of flushing TsFiles when cocurrently creating historical extractors.

* If cluster heartbeat doesn't need PipeMetaList, do not get into PipeTaskAgent. This will prevent datanode from turning UNKNOWN when many pipes are being created.

---------

Co-authored-by: Steve Yurong Su <rong@apache.org>
(cherry picked from commit 1a3568ff2)

Co-authored-by: 马子坤 <55695098+DanielWang2035@users.noreply.github.com>

28 of 28 new or added lines in 3 files covered. (100.0%)

80196 of 168159 relevant lines covered (47.69%)

0.48 hits per line