• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

apache / carbondata / 913
76%

Build:
DEFAULT BRANCH: master
Ran 26 Aug 2018 07:51PM UTC
Jobs 1
Files 991
Run time 54s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

pending completion
913

push

jenkins

ravipesala
[CARBONDATA-2874] Support SDK writer as thread safe api

Problem: Currently CarbonWriter.write() not a thread safe. if multiple threads calls .write() for one writer.
Data count inconsistency is observed.

root casue: As all the threads are writing to same batch of blocking queue. need to synchronize this. Else one thread data overwrite the other thread data.

Solution:
a) DataLoadExecutor is using only one iterator, take number of threads as input and internally create that many iterator to loop over the data. This will reduce the blocking time of queue as each iterator has its own queue.
b) InputProcessor step is taking only default 2 cores (2 thread) for data load in SDK flow, can use the same number as number of threads created by user.
c) writer step is using only 2 cores (2 thread). can use the same number as number of threads created by user.

This closes #2653

69 of 69 new or added lines in 7 files covered. (100.0%)

53716 of 71105 relevant lines covered (75.54%)

0.98 hits per line

Jobs
ID Job ID Ran Files Coverage
1 913.1 26 Aug 2018 07:51PM UTC 0
75.54
Source Files on build 913
Detailed source file information is not available for this build.
  • Back to Repo
  • Jenkins Build #913
  • 17a4b485 on github
  • Prev Build on master (#914)
  • Next Build on master (#915)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc