apache / carbondata / 472

76%

Build Type

push

jenkins

Committed by manishgupta88

Commit Message

[CARBONDATA-2496] Changed to hadoop bloom implementation and added compress option to compress bloom on disk

This PR removes the guava bloom and adds the hadoop bloom. And also added the compress bloom option to compress bloom on disk and in memory as well.
The user can use bloom_compress property to enable/disable compression. By default, it is enabled.

Please check the performance of bloom
Loaded 100 million data with bloom datamap on a column with a cardinality of 5 million with 'BLOOM_SIZE'='5000000', 'bloom_fpp'='0.001'.

This closes #2324

Run Details

93 of 93 new or added lines in 8 files covered. (100.0%)

52252 of 66771 relevant lines covered (78.26%)

1.04 hits per line