blevesearch / bleve / 23666911021

53%

Build Type

push

github

Committed by web-flow

Commit Message

MB-62182: Implement File transfer APIs (#2279)

- Utilizes the new file transfer APIs to able to transfer the trained
index file from one bleve index to another. This is helpful in a
multi-partition scenario with a single datasource - where only one bleve
index is trained on a set of vectors and then transfer the generated
file to the other bleve indexes.
- The file transfer is currently focused around the trained index file
but the protocol is such that its future extendable for other files if
needed.
- The main control flow here is that the application needs to implement
the `IndexDirectory` interface which maintains a reference to the
destination bleve index.
- Now, when the `srcIndex.CopyFile(index.TrainedIndexFileName,
directory)` is invoked, it internally fetches the writer on the
destination using `directory.GetWriter()`
- Then, as part of the CopyFile it does an `io.Copy()` of the specific
file and currently this is focused only for trained index file.
- This is followed by an update bolt transaction + commit and sync in
the destination index by invoking `directory.SetPathInBolt(fileName,
filePath)`. This is mandatory since bolt is reflective of the on-disk
information.

Run Details

1 of 75 new or added lines in 4 files covered. (1.33%)

2 existing lines in 1 file now uncovered.

19220 of 36606 relevant lines covered (52.51%)

0.59 hits per line