1271
76%

Ran 13 Nov 2018 04:33PM UTC

Jobs 1

Files 1014

Run time 54s

Badge

Embed ▾

pending completion

Build # 1271

Build Type

push

jenkins

Committed by ravipesala

Commit Message

[CARBONDATA-3065]make inverted index false by default

Why this PR?
Bottleneck with invertedIndex:
As for each page first we will sort the data and generate inverted index, data loading performance will get impacted.because of this
Store size is more because of stroing inverted index for each dimension column which results in more IO and it impacts query performance
One extra lookup happenes during query due to presence of inverted index which is causing many cachline miss and it impacts the query performance
Changes Proposed in this PR:
by default inverted index will be disabled for all the dimension columns, only row level sorting happens in sortstep and column level sorting will be skipped.
new table property will be added called INVERTED_INDEX which takes comma separated column names as value, and only for these columns inverted index will be generated.
NO_INVERTED_INDEX table property will be deprecated, and it will be kept only for compatibility.
Handled in describe formatted for inverted index columns
how this tested
existing UTs will take care and new test cases are added.

This closes #2886

Run Details

61325 of 77010 relevant lines covered (79.63%)

1.06 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	1271.1	13 Nov 2018 04:33PM UTC	0	79.63

Source Files on build 1271

Detailed source file information is not available for this build.

apache / carbondata / 1271
76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 1271

apache / carbondata / 1271 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 1271

apache / carbondata / 1271
76%

README BADGES
x