1
76%
master: 76%

Ran 29 Jan 2019 08:28AM UTC

Files 1027

Run time 1min

Badge

Embed ▾

Committed 29 Jan 2019 08:28AM UTC coverage: 79.18% (+0.04%) from 79.14%

Job # 1510.1

Build Type

push

jenkins

Committed by ravipesala

Commit Message

[CARBONDATA-3272]fix ArrayIndexOutOfBoundsException of horizontal compaction during update, when cardinality changes within a segment

Problem:
During horizontal compaction in update, we prepare a taskBlockMapping to get the resultIterators. horizontal compaction will be done within a segment. Here, source segment properties will be always prepared by the filefooter of first block in the blocklist for a corresponding task. source segment properties will contain the dimensionKeyGenerator which will be used to convert the rows. If the cardinality is different for two blcoks for a task, then the dimensionKeyGenerator will be different. Since we always take the first one, it failed with ArrayIndexOutOfBoundsException for other block with different keyGenerator.

Solution
so get all the blocks present in a task and then split into multiple lists of same key length and create separate RawResultIterator for each list of same key length. If all the blocks have same keylength, then make a single RawResultIterator for all the blocks

This closes #3102

Coverage Stats

62478 of 78906 relevant lines covered (79.18%)

1.05 hits per line

apache / carbondata / 1510 / 1
76%
master: 76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 1510.1

apache / carbondata / 1510 / 1 76% master: 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 1510.1

apache / carbondata / 1510 / 1
76%
master: 76%

README BADGES
x