dgraph-io / badger / 1526
61%
main: 61%

LAST BUILD BRANCH: dependabot/github_actions/actions-eb8e6b6abe
DEFAULT BRANCH: main
Ran
Jobs 1
Files 27
Run time 6s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
1526

push

travis-ci

web-flow 
Many GC related changes (#479)

Max entries per value log file:
To ensure that we can GC a file in bounded time, we should restrict the max number of key-value pairs that can be contained by one log file. A new option now enforces that, taking the minimum of value log file size, and the number of entries contained to determine when a file should be rotated.

New move keyspace:
We should never write an entry with an older timestamp for the same key. We need to maintain this invariant to search for the latest value of a key, or else we need to search in all tables and find the max version among them.

- Value log GC moves key-value pairs to new files. This used to cause older versions of keys to be written to the top of LSM tree. This change puts those moves into a separate keyspace, prefixed by badgerMove. When doing a value read, we can look into this keyspace if the previous value pointer is no longer valid (pointed to a deleted value log file).
- Add an integration test, which runs for 3 mins and ensures that GC moves work as expected.
- Switch db.get back to stopping as soon as we encounter the first key (instead of looking into all levels).
- Collect value log GC stats when doing compactions.
- Trace log the entire value log GC, so we know how the file was picked and the result of sampling.
- Pick two value log files for GC. First from discard stats, and second randomly. Then try to GC both, and return on whichever is successful.
- Add a function to delete move keys corresponding to a value log file deletion.
- Increase the value threshold to 32 by default.

4226 of 5274 relevant lines covered (80.13%)

75624.09 hits per line

Jobs
ID Job ID Ran Files Coverage
1 1526.1 0
80.13
 Travis Job 1526.1
Source Files on build 1526