apache / carbondata / 1978

76%

push

jenkins

[CARBONDATA-3526]Fix cache issue during update and query

Problem:
When multiple updates happen on table, cache is loaded
during update operation, but since on second update the
horizontal compaction happens inside the segment, already
loaded into cache are invalid. So if we do clean files,
physical deletion of horizontal compacted takes place,
but still the cache contains old files. So when select
 query is fired, query fails with file not found exception.

Solution:
once after horizontal compaction is finished, new compacted
files are generated, so the segments inside cache are now invalid,
so clear the cache of invalid segment after horizontal compaction.
During drop cache command, clear the cache of segmentMap also.

This closes #3385

4 of 4 new or added lines in 2 files covered. (100.0%)

66088 of 84174 relevant lines covered (78.51%)

1.04 hits per line