1
76%
master: 76%

Ran 30 Jul 2018 10:32AM UTC

Files 985

Run time 1min

Badge

Embed ▾

Committed 30 Jul 2018 10:32AM UTC coverage: 81.257% (+0.004%) from 81.253%

Job # 783.1

Build Type

push

jenkins

Committed by ravipesala

Commit Message

[HOTFIX] Removed file existence check to improve dataMap loading performance

Problem
DataMap loading performance degraded after adding file existence check.

Analysis
When carbonIndex file is read and carbondata file path to its metadata Info map is prepared, file physical existence is getting checked every time which in case of HDFS file system is a namenode call. This degrades the dataMap loading performance. This is done to avoid failures for

Handle IUD scenario where after delete operation carbondata file is deleted but the entry still exists in index file.
Fix
Modified code to check for physical file existence only in case when any IUD operation has happened on the table

This closes #2560

Coverage Stats

57118 of 70293 relevant lines covered (81.26%)

1.08 hits per line

apache / carbondata / 783 / 1
76%
master: 76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 783.1

apache / carbondata / 783 / 1 76% master: 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 783.1

apache / carbondata / 783 / 1
76%
master: 76%

README BADGES
x