3
100%
master: 100%

Ran 26 Jan 2017 06:44AM UTC

Files 7

Run time 0s

Badge

Embed ▾

Committed 19 May 2015 10:09AM UTC coverage: 78.313%. First build

Job # PROFILE="-P!include-yarn -Dhadoop.version=2.0.0-alpha"

Build Type

Pull #605

travis-ci

Committed by

tammymendt

Commit Message

[FLINK-1297] Added an accumulator called OperatorStatsAccumulator capable of tracking min, max and estimates for count distinct and heavy hitters.

The count distinct algorithms are Linear Counting and HyperLogLog, both from an imported library from clearspring.

The heavy hitters algorithms are Lossy counting (Manku et.al 2002) and one based on Count Min Sketch (Cormode 2005).

The heavy hitters algorithms are implemented in the statistics package in flink-contrib.

Refactored to flink-contrib.

The OperatorStatsAccumulatorTest creates a local accumulator and a global accumulator. Inside of the
flatmap the local accumulator is updated. The global accumulator is updated when the task closes.

Custom serialization implemented for OperatorStatistics and CountMinHeavyHitter.
Refactored CountMinHeavyHitter and fixed a bug in the merge function.
Fixed bug in merge function in OperatorStatistics.

Pull Request Pull Request #605: [FLINK-1297] Added OperatorStatsAccumulator for tracking operator related stats

Run Details

65 of 83 relevant lines covered (78.31%)

19.24 hits per line

apache / flink / 2985 / 3
100%
master: 100%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 2985.3 (PROFILE="-P!include-yarn -Dhadoop.version=2.0.0-alpha")

apache / flink / 2985 / 3 100% master: 100%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 2985.3 (PROFILE="-P!include-yarn -Dhadoop.version=2.0.0-alpha")

apache / flink / 2985 / 3
100%
master: 100%

README BADGES
x