1
76%
master: 76%

Ran 10 Jul 2018 05:04PM UTC

Files 1055

Run time 28min

Badge

Embed ▾

Committed 10 Jul 2018 05:04PM UTC coverage: 71.503% (-4.9%) from 76.39%

Job # 639.1

Build Type

push

jenkins

Committed by Venkata Ramana G

Commit Message

[CARBONDATA-2607][Complex Column Enhancements] Complex Primitive DataType Adaptive Encoding

In this PR the improvement was done to save the complex type more effectively so that reading becomes more efficient.

The changes are:

Primitive types inside complex types are separate pages. Previously it was a single byte array column page for a complex column. Now all sub-levels inside the complex data types are stored as separate pages with their respective datatypes.

No Dictionary Primitive DataTypes inside Complex Columns will be processed through Adaptive Encoding. Previously only snappy compression was applied.

All Primitive datatypes inside complex if it is now dictionary, only value will be saved except String, Varchar which is saved as ByteArray. Previously all sub-levels are saved as Length And Value Format inside a single Byte Array. Currently only Struct And Array type column pages are saved in ByteArray. All other primitive except String and varchar are saved in respective fixed datatype length.

Support for the Safe and Unsafe Fixed length Column Page to support growing dynamic array implementation. This is done to support Array datatype.

Co-authored-by: sounakr <sounakr@gmail.com>

This closes #2417

Coverage Stats

52427 of 73321 relevant lines covered (71.5%)

0.93 hits per line

apache / carbondata / 639 / 1
76%
master: 76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 639.1

apache / carbondata / 639 / 1 76% master: 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 639.1

apache / carbondata / 639 / 1
76%
master: 76%

README BADGES
x