1
76%
master: 76%

Ran 02 Aug 2018 02:11PM UTC

Files 987

Run time 6min

Badge

Embed ▾

Committed 02 Aug 2018 02:11PM UTC coverage: 80.946% (-0.006%) from 80.952%

Job # 833.1

Build Type

push

jenkins

Committed by ravipesala

Commit Message

[Documentation] [Unsafe Configuration] Added carbon.unsafe.driver.working.memory.in.mb parameter to differentiate between driver and executor unsafe memory

Added carbon.unsafe.driver.working.memory.in.mb parameter to differentiate between driver and executor unsafe memory

Usually in production scenarios driver memory will be less than the executor memory. Now we are using unsafe for caching block/blocklet dataMap in driver. Current unsafe memory configured for executor is getting used for driver also which is not a good idea.
Therefore it is required to separate out driver and executor unsafe memory.
You can observe the same in spark configuration also that spark has given different parameters for configuring driver and executor memory overhead to control the unsafe memory usage.
spark.yarn.driver.memoryOverhead and spark.yarn.executor.memoryOverhead

This closes #2595

Coverage Stats

57051 of 70480 relevant lines covered (80.95%)

1.08 hits per line

apache / carbondata / 833 / 1
76%
master: 76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 833.1

apache / carbondata / 833 / 1 76% master: 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 833.1

apache / carbondata / 833 / 1
76%
master: 76%

README BADGES
x