916
76%

Ran 27 Aug 2018 09:49AM UTC

Jobs 1

Files 991

Run time 54s

Badge

Embed ▾

pending completion

Build # 916

Build Type

push

jenkins

Committed by kumarvishal09

Commit Message

[CARBONDATA-2885] Broadcast Issue and Small file distribution Issue

Issue :-

In External Table Carbon Relation sizeInByte is wrong (always 0) because of this Join Queries are identified for broadcast even
Table actual size is > 10MB( default broadcast).This is making fail some of the join table ( table which should select sortmergeJoin but
because of wrong calculation it gone for broadcast join)

if Merge_small_file task distribution is enabled ,Join queries are failed (TPCH).
carbon opens many carbon files but it not getting closed.

Root Cause :-
1. Current relation size calculation is based on tablestatus file but since
External Table does not have tablestatus file so always zero was returned.
2. if Merge_small_file task distribution is enabled carbon opens many carbon files but it not getting closed.
Solution :-

if Table is External Table then calculate size from TablePath .
close the carbon files for scan is finished.

This closes #2658

Run Details

57278 of 71115 relevant lines covered (80.54%)

1.07 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	916.1	27 Aug 2018 09:49AM UTC	0	80.54

Source Files on build 916

Detailed source file information is not available for this build.

apache / carbondata / 916
76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 916

apache / carbondata / 916 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 916

apache / carbondata / 916
76%

README BADGES
x