babelfish-for-postgresql / babelfish_extensions / 10006940483

76%

BABEL_5_X_DEV: 77%

Build Type

push

github

Committed by web-flow

Commit Message

BCP import - open and close indices for every batch (#2487)

In `ExecuteBulkCopy` indices on the target table are opened for every incoming batch, but never closed.

It is proposed to open indices instead for every executor batch just before the call to `table_multi_insert` and close them after they are updated with tuples from this batch.

Backend memory usage (with both this patch and #2469 patch included) while importing 16 million varchar records (4x the table from the linked issue):

![Figure_3](https://github.com/babelfish-for-postgresql/babelfish_extensions/assets/9497509/4b36faab-79d7-4a82-aef1-8404a3ee2c49)

Signed-off-by: Alex Kasko <alex@staticlibs.net>

Run Details

9 of 9 new or added lines in 1 file covered. (100.0%)

2 existing lines in 1 file now uncovered.

42897 of 58591 relevant lines covered (73.21%)

114306.05 hits per line