trivago / gollum / 1987
71%

Ran 01 Jul 2019 08:28PM UTC

Jobs 4

Files 78

Run time 6min

Badge

Committed 07 Jun 2019 10:43AM UTC coverage: 71.531% (-0.05%) from 71.584%

Build # 1987

Build Type

cron

travis-ci

Committed by

Commit Message

Refactor formatters to use metadata as intermediate (#249)

* convert grokToJSON to grok to metadata
* remove collectd to influx formatter.
Resons:
- This formatter is too specific.
- A collectd consumer and an influxdb producer should handle this instead.
- There is other software doing this kind of work better than gollum (e.g. telegraph).

* remove extractToJSON.
Reason: This kind of functionality will be handled by formatters converting metadata to a specific output format like JSON.

* remove jsonToInflux. Same reason as collectdToInflux.
* convert jsonToArray to ToArray to match the new metadata concept.
* remove serialize formatter as spooling does not need it anymore.
* add a formater that can convert metadata to json
* remove filter.json go as it will be replaced by filter.metadata.
* rename 'ApplyTo' to 'Target'.
- includes renaming format.MetadataCopy to format.Copy.
- includes adding format.Move

As we now put more emphasis on metadata, 'target' becomes a much clearer identifier.
Along with this, the names for Set and Get functions have been simplified.
This should make formatter configurations more readable and easier to understand.

* use a better example for format.double
* add an option to keep the last separator
* finish format.ToJSON
* remove format.TextToJSON.

- Nobody understood the syntax anyways.
- format.Grok can handle most of its usecases.
- A high maintenance burden for a too small usecase.

* rename format.Clear to format.Delete
* remove unittest for texttojson
* rename format.Trim to format.Bounds.
There will be a new format.Trim that uses strings.Trim.

* add format.Trim
* rename format.Bounds to format.TrimToBounds
* introduce Source parameter to all SimpleFormatter.
- Also includes targeting a specific metadata key for parser formatter.

* add a metadata access function for parsers
* switch aggregate from Target to Source
* fix metadata being properly cloned on msg.Clone
* ad... (continued)

Run Details

2701 of 3776 relevant lines covered (71.53%)

2354.68 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	1987.1 (ACCEPT_TARGET=pipeline-accept)	01 Jul 2019 08:34PM UTC	78	71.58	Travis Job 1987.1
2	1987.2 (ACCEPT_TARGET=pipeline-accept GOMOD=off)	01 Jul 2019 08:30PM UTC	78	71.53	Travis Job 1987.2
3	1987.3 (ACCEPT_TARGET=pipeline-accept)	01 Jul 2019 08:29PM UTC	78	71.53	Travis Job 1987.3
4	1987.4 (ACCEPT_TARGET=test)	01 Jul 2019 08:28PM UTC	78	71.49	Travis Job 1987.4

Source Files on build 1987