1
76%
master: 76%

Ran 05 Jun 2018 12:47PM UTC

Files 964

Run time 2min

Badge

Embed ▾

Committed 05 Jun 2018 12:47PM UTC coverage: 78.415% (+2.8%) from 75.605%

Job # 520.1

Build Type

push

jenkins

Committed by ravipesala

Commit Message

[CARBONDATA-2557] [CARBONDATA-2472] [CARBONDATA-2570] Improve Carbon Reader performance on S3 and fixed datamap clear issue in reader

[CARBONDATA-2557] [CARBONDATA-2472] Problem : CarbonReaderBuilder.build() is slower in s3. It takes around 8 seconds to finish build()
Solution: S3 is slow in listFiles, open, FileExist, getCarbonFile operations. So, List down all the calls of those API in the reader flow and remove the redundant checks.

[CARBONDATA-2570] Problem : Carbon SDK Reader, second time reader instance have an issue in cluster test
Solution: Blocklet datamap's of first time reader is not cleared properly in the cluster. Need to change the API to clear the blocklet datamap.

so change
DataMapStoreManager.getInstance().getDefaultDataMap(queryModel.getTable()).clear();
to
DataMapStoreManager.getInstance().clearDataMaps(queryModel.getTable().getAbsoluteTableIdentifie());

This closes #2345

Coverage Stats

52610 of 67092 relevant lines covered (78.41%)

1.05 hits per line

apache / carbondata / 520 / 1
76%
master: 76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 520.1

apache / carbondata / 520 / 1 76% master: 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 520.1

apache / carbondata / 520 / 1
76%
master: 76%

README BADGES
x