2352
70%

Ran 17 Mar 2016 02:41AM UTC

Jobs 4

Files 640

Run time 8618min

Badge

Embed ▾

pending completion

Build # 2352

Build Type

Pull #863

travis-ci

Committed by

lbendig

Commit Message

Metric reporters (Graphite, InfluxDB)

Reimplementation of the Graphite and InfluxDB reporters that were removed in PR#429
due to the changes in Metric API.

Graphite:
- Supports sending through UDP and TCP
- metric and/or event reporter can be toggled
- Additional parameter metrics.reporting.graphite.events.value.as.key:
  - for those backends that doesn't allow string event value types (e.g: InfluxDB's Graphite protocol)
  - In this case the event value is added as a postfix to the event key

InfluxDB;
- metric and/or event reporter can be toggled
- Only TCP as influxdb-java 2.1 doesn't support UDP yet

Both were tested on InfluxDB 0.9.4.1.

Refactoring:
- Restructured configuration keys for the metric reporters and classes of metric/event names
- Timing event related event names are now in the TimingEvent class
- Metric reporting configurations are moved from MetricReportReport to a new base class ConfiguredScheduledReporter.
  To report non-serialized metrics one can extend ConfiguredScheduledReporter, for serialized Avro records
  MetricReportReport can be subclassed
- Duplicate class: MetricGroup  -> gobblin.runtime.MetricGroup was removed

Pull Request Pull Request #863: Metric reporters (Graphite, InfluxDB)

Run Details

9873 of 23303 relevant lines covered (42.37%)

1.62 hits per line

Uncovered Existing Lines

Lines	Coverage	∆	File
1	75.32	-1.3%	gobblin-core/src/main/java/gobblin/writer/FsDataWriter.java
2	86.96	0.0%	gobblin-runtime/src/main/java/gobblin/runtime/util/JobMetrics.java
3	86.96	-8.28%	gobblin-metrics/src/main/java/gobblin/metrics/event/TimingEvent.java
4	93.55	5.79%	gobblin-metrics/src/main/java/gobblin/metrics/reporter/MetricReportReporter.java
6	76.79	11.33%	gobblin-metrics/src/main/java/gobblin/metrics/reporter/EventReporter.java
9	0.0	0.0%	gobblin-metrics/src/main/java/gobblin/metrics/reporter/RecursiveScheduledReporter.java
11	82.4	0.0%	gobblin-runtime/src/main/java/gobblin/runtime/JobState.java
12	87.92	0.67%	gobblin-metrics/src/main/java/gobblin/metrics/reporter/OutputStreamReporter.java
13	67.92	0.0%	gobblin-runtime/src/main/java/gobblin/runtime/local/LocalJobLauncher.java
13	0.0	0.0%	gobblin-runtime/src/main/java/gobblin/runtime/mapreduce/CliMRJobLauncher.java
22	0.0	0.0%	gobblin-metrics/src/main/java/gobblin/metrics/example/ReporterExampleBase.java
32	70.39	0.0%	gobblin-runtime/src/main/java/gobblin/runtime/mapreduce/MRJobLauncher.java
43	72.45	0.0%	gobblin-runtime/src/main/java/gobblin/runtime/AbstractJobLauncher.java
60	8.87	0.74%	gobblin-core/src/main/java/gobblin/source/extractor/utils/Utils.java
84	16.18	2.19%	gobblin-core/src/main/java/gobblin/source/extractor/extract/kafka/KafkaSource.java
97	0.0	0.0%	gobblin-compaction/src/main/java/gobblin/compaction/mapreduce/MRCompactorJobRunner.java
154	34.22	-9.35%	gobblin-core/src/main/java/gobblin/metrics/GobblinMetrics.java

Jobs

ID	Job ID	Ran	Files	Coverage
1	2352.1 (USEHADOOP2=false)	17 Mar 2016 02:42AM UTC	639	42.19	Travis Job 2352.1
2	2352.2 (USEHADOOP2=false)	23 Mar 2016 02:19AM UTC	639	42.34	Travis Job 2352.2
3	2352.3 (USEHADOOP2=true)	17 Mar 2016 02:44AM UTC	640	42.48	Travis Job 2352.3
4	2352.4 (USEHADOOP2=true)	17 Mar 2016 02:41AM UTC	640	42.62	Travis Job 2352.4

Source Files on build 2352

Coverage	∆	File	Lines	Relevant	Covered	Missed	Hits/Line

linkedin / gobblin / 2352
70%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 2352

linkedin / gobblin / 2352 70%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 2352

linkedin / gobblin / 2352
70%

README BADGES
x