2985
100%

Ran 26 Jan 2017 06:44AM UTC

Jobs 5

Files 7

Run time 58s

Badge

Embed ▾

pending completion

Build # 2985

Build Type

Pull #605

travis-ci

Committed by

tammymendt

Commit Message

[FLINK-1297] Added an accumulator called OperatorStatsAccumulator capable of tracking min, max and estimates for count distinct and heavy hitters.

The count distinct algorithms are Linear Counting and HyperLogLog, both from an imported library from clearspring.

The heavy hitters algorithms are Lossy counting (Manku et.al 2002) and one based on Count Min Sketch (Cormode 2005).

The heavy hitters algorithms are implemented in the statistics package in flink-contrib.

Refactored to flink-contrib.

The OperatorStatsAccumulatorTest creates a local accumulator and a global accumulator. Inside of the
flatmap the local accumulator is updated. The global accumulator is updated when the task closes.

Custom serialization implemented for OperatorStatistics and CountMinHeavyHitter.
Refactored CountMinHeavyHitter and fixed a bug in the merge function.
Fixed bug in merge function in OperatorStatistics.

Pull Request Pull Request #605: [FLINK-1297] Added OperatorStatsAccumulator for tracking operator related stats

Run Details

65 of 83 relevant lines covered (78.31%)

94.11 hits per line

Jobs

ID	Job ID	Ran	Coverage
1	2985.1 (PROFILE="-Dhadoop.profile=1 -Dscala-2.11")	26 Jan 2017 06:45AM UTC	77.78	Travis Job 2985.1
2	2985.2 (PROFILE="-Dhadoop.profile=1")	26 Jan 2017 06:45AM UTC	78.31	Travis Job 2985.2
3	2985.3 (PROFILE="-P!include-yarn -Dhadoop.version=2.0.0-alpha")	26 Jan 2017 06:44AM UTC	78.31	Travis Job 2985.3
4	2985.4 (PROFILE="-Dhadoop.version=2.2.0")	26 Jan 2017 06:45AM UTC	78.31	Travis Job 2985.4
5	2985.5 (PROFILE="-Dhadoop.version=2.6.0 -Dscala-2.11 -Pinclude-tez -Dmaven.javadoc.skip=true")	26 Jan 2017 06:45AM UTC	78.31	Travis Job 2985.5

Source Files on build 2985

Detailed source file information is not available for this build.

apache / flink / 2985
100%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 2985

apache / flink / 2985 100%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 2985

apache / flink / 2985
100%

README BADGES
x