apache / carbondata / 1397

76%

push

jenkins

[CARBONDATA-3080] Supporting local dictionary enable by default for SDK

Enabled Local dictionary by default for SDK and handle below issues

In Local dictionary enabled if same cols given multiple times then duplicate projection cols gives empty records in SDK reader.
Solution :- added mapping of projection cols v/s carbon fetch col (remove duplicate while fetching data)

In SDK reader ,Same TaskID is assigned when run CSDKReader reads blocks. For Ex. Read Seq -> read parallel.In this case During Sequence read TaskID is assinged in main thread and during parallel read also all thread got same TaskId (InheritableThreadLocal). This causing some time JVM crash as in concurrent read. refer testReadParallely() testcase .
Solution :- During freeallmemory () clear the Taskinfo also.

This closes #2897

35 of 35 new or added lines in 7 files covered. (100.0%)

61537 of 77926 relevant lines covered (78.97%)

1.05 hits per line