639
76%

Ran 10 Jul 2018 05:04PM UTC

Jobs 1

Files 1055

Run time 55min

Badge

Embed ▾

pending completion

Build # 639

Build Type

push

jenkins

Committed by Venkata Ramana G

Commit Message

[CARBONDATA-2607][Complex Column Enhancements] Complex Primitive DataType Adaptive Encoding

In this PR the improvement was done to save the complex type more effectively so that reading becomes more efficient.

The changes are:

Primitive types inside complex types are separate pages. Previously it was a single byte array column page for a complex column. Now all sub-levels inside the complex data types are stored as separate pages with their respective datatypes.

No Dictionary Primitive DataTypes inside Complex Columns will be processed through Adaptive Encoding. Previously only snappy compression was applied.

All Primitive datatypes inside complex if it is now dictionary, only value will be saved except String, Varchar which is saved as ByteArray. Previously all sub-levels are saved as Length And Value Format inside a single Byte Array. Currently only Struct And Array type column pages are saved in ByteArray. All other primitive except String and varchar are saved in respective fixed datatype length.

Support for the Safe and Unsafe Fixed length Column Page to support growing dynamic array implementation. This is done to support Array datatype.

Co-authored-by: sounakr <sounakr@gmail.com>

This closes #2417

Run Details

52427 of 73321 relevant lines covered (71.5%)

0.93 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	639.1	10 Jul 2018 05:04PM UTC	0	71.5

Source Files on build 639

Detailed source file information is not available for this build.

apache / carbondata / 639
76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 639

apache / carbondata / 639 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 639

apache / carbondata / 639
76%

README BADGES
x