1510
76%

Ran 29 Jan 2019 08:28AM UTC

Jobs 1

Files 1027

Run time 1min

Badge

Embed ▾

pending completion

Build # 1510

Build Type

push

jenkins

Committed by ravipesala

Commit Message

[CARBONDATA-3272]fix ArrayIndexOutOfBoundsException of horizontal compaction during update, when cardinality changes within a segment

Problem:
During horizontal compaction in update, we prepare a taskBlockMapping to get the resultIterators. horizontal compaction will be done within a segment. Here, source segment properties will be always prepared by the filefooter of first block in the blocklist for a corresponding task. source segment properties will contain the dimensionKeyGenerator which will be used to convert the rows. If the cardinality is different for two blcoks for a task, then the dimensionKeyGenerator will be different. Since we always take the first one, it failed with ArrayIndexOutOfBoundsException for other block with different keyGenerator.

Solution
so get all the blocks present in a task and then split into multiple lists of same key length and create separate RawResultIterator for each list of same key length. If all the blocks have same keylength, then make a single RawResultIterator for all the blocks

This closes #3102

Run Details

62478 of 78906 relevant lines covered (79.18%)

1.05 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	1510.1	29 Jan 2019 08:28AM UTC	0	79.18

Source Files on build 1510

Detailed source file information is not available for this build.

apache / carbondata / 1510
76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 1510

apache / carbondata / 1510 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 1510

apache / carbondata / 1510
76%

README BADGES
x