2352
70%

Ran 17 Mar 2016 02:41AM UTC

Jobs 4

Files 640

Run time 8618min

Badge

Embed ▾

pending completion

Build # 2352

Build Type

Pull #863

travis-ci

Committed by

lbendig

Commit Message

Metric reporters (Graphite, InfluxDB)

Reimplementation of the Graphite and InfluxDB reporters that were removed in PR#429
due to the changes in Metric API.

Graphite:
- Supports sending through UDP and TCP
- metric and/or event reporter can be toggled
- Additional parameter metrics.reporting.graphite.events.value.as.key:
  - for those backends that doesn't allow string event value types (e.g: InfluxDB's Graphite protocol)
  - In this case the event value is added as a postfix to the event key

InfluxDB;
- metric and/or event reporter can be toggled
- Only TCP as influxdb-java 2.1 doesn't support UDP yet

Both were tested on InfluxDB 0.9.4.1.

Refactoring:
- Restructured configuration keys for the metric reporters and classes of metric/event names
- Timing event related event names are now in the TimingEvent class
- Metric reporting configurations are moved from MetricReportReport to a new base class ConfiguredScheduledReporter.
  To report non-serialized metrics one can extend ConfiguredScheduledReporter, for serialized Avro records
  MetricReportReport can be subclassed
- Duplicate class: MetricGroup  -> gobblin.runtime.MetricGroup was removed

Pull Request Pull Request #863: Metric reporters (Graphite, InfluxDB)

Run Details

9873 of 23303 relevant lines covered (42.37%)

1.62 hits per line

Uncovered Existing Lines

Lines	Coverage	File
1	100.0	gobblin-core/src/main/java/gobblin/writer/FsDataWriter.java
2	100.0	gobblin-runtime/src/main/java/gobblin/runtime/util/JobMetrics.java
3	100.0	gobblin-metrics/src/main/java/gobblin/metrics/event/TimingEvent.java
4	100.0	gobblin-metrics/src/main/java/gobblin/metrics/reporter/MetricReportReporter.java
6	100.0	gobblin-metrics/src/main/java/gobblin/metrics/reporter/EventReporter.java
9	100.0	gobblin-metrics/src/main/java/gobblin/metrics/reporter/RecursiveScheduledReporter.java
11	100.0	gobblin-runtime/src/main/java/gobblin/runtime/JobState.java
12	100.0	gobblin-metrics/src/main/java/gobblin/metrics/reporter/OutputStreamReporter.java
13	100.0	gobblin-runtime/src/main/java/gobblin/runtime/local/LocalJobLauncher.java
13	100.0	gobblin-runtime/src/main/java/gobblin/runtime/mapreduce/CliMRJobLauncher.java
22	100.0	gobblin-metrics/src/main/java/gobblin/metrics/example/ReporterExampleBase.java
32	100.0	gobblin-runtime/src/main/java/gobblin/runtime/mapreduce/MRJobLauncher.java
43	100.0	gobblin-runtime/src/main/java/gobblin/runtime/AbstractJobLauncher.java
60	100.0	gobblin-core/src/main/java/gobblin/source/extractor/utils/Utils.java
84	100.0	gobblin-core/src/main/java/gobblin/source/extractor/extract/kafka/KafkaSource.java
97	100.0	gobblin-compaction/src/main/java/gobblin/compaction/mapreduce/MRCompactorJobRunner.java
154	100.0	gobblin-core/src/main/java/gobblin/metrics/GobblinMetrics.java

Jobs

ID	Job ID	Ran	Coverage
1	2352.1 (USEHADOOP2=false)	17 Mar 2016 02:42AM UTC	42.19	Travis Job 2352.1
2	2352.2 (USEHADOOP2=false)	23 Mar 2016 02:19AM UTC	42.34	Travis Job 2352.2
3	2352.3 (USEHADOOP2=true)	17 Mar 2016 02:44AM UTC	42.48	Travis Job 2352.3
4	2352.4 (USEHADOOP2=true)	17 Mar 2016 02:41AM UTC	42.62	Travis Job 2352.4

Source Files on build 2352

Detailed source file information is not available for this build.

linkedin / gobblin / 2352
70%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 2352

linkedin / gobblin / 2352 70%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 2352

linkedin / gobblin / 2352
70%

README BADGES
x