1
76%
master: 76%

Ran 10 May 2018 05:14PM UTC

Files 1017

Run time 1min

Badge

Embed ▾

Committed 10 May 2018 05:14PM UTC coverage: 74.85% (+3.0%) from 71.822%

Job # 422.1

Build Type

push

jenkins

Committed by ravipesala

Commit Message

[CARBONDATA-2417] [SDK Writer] SDK writer goes to infinite wait when consumer thread goes dead

Problem:
SDK Writer going into infinte loop in case of multi-threaded scenario

Analysis:
In multi-threaded scenarios where multiple instances of writer thread are trying to add a row to the RowBatch, addition to given batch size cannot be ensured as addition process is not synchronized and it can lead to ArrayIndexOutOfBound Exception or data loss/mismatch issues.
If multiple writer threads are adding the data to RowBatch and immediately after launching all the threads closeWriter is called, in that case we don't know when all the data is finished writing by all the threads but we are returning immediately from close writer after setting the close flag to true. This does not ensure complete processing of data.

Solution:
Make the row addition logic synchronized and modify the code in closeWriter to ensure data completeness.

This closes #2286

Coverage Stats

51496 of 68799 relevant lines covered (74.85%)

1.0 hits per line

apache / carbondata / 422 / 1
76%
master: 76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 422.1

apache / carbondata / 422 / 1 76% master: 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 422.1

apache / carbondata / 422 / 1
76%
master: 76%

README BADGES
x