babelfish-for-postgresql / babelfish_extensions / 10058822560

74%

BABEL_5_X_DEV: 76%

push

github

BCP import - open and close indices for every batch (#2487) (#2766)

In `ExecuteBulkCopy` indices on the target table are opened for every incoming batch, but never closed.

It is proposed to open indices instead for every executor batch just before the call to `table_multi_insert` and close them after they are updated with tuples from this batch.

Backend memory usage (with both this patch and #2469 patch included) while importing 16 million varchar records (4x the table from the linked issue):

![Figure_3](https://github.com/babelfish-for-postgresql/babelfish_extensions/assets/9497509/4b36faab-79d7-4a82-aef1-8404a3ee2c49)

Signed-off-by: Alex Kasko <alex@staticlibs.net>

9 of 9 new or added lines in 1 file covered. (100.0%)

42187 of 57448 relevant lines covered (73.44%)

108807.7 hits per line