#61
66%
master: 68%

Ran 03 Nov 2020 08:30AM UTC

Jobs 1

Files 27

Run time 2s

Badge

Embed ▾

pending completion

Build # #61

Build Type

push

Committed by

peel

Commit Message

Add support for nullable fields

Previously all the fields with nullable values were discarded as invalid.
However there is a wide range of fields that cannot be treated as non-nullable.

For example for enrichment failures bad row, we get following
structure (trimmed):
```
                column_name                | is_nullable |          data_type
-------------------------------------------+-------------+-----------------------------
 processor.artifact                        | NO          | character varying
 processor.version                         | NO          | character varying
 failure.messages                          | YES         | jsonb
 failure.timestamp                         | YES         | timestamp without time zone
 payload.enriched.app_id                   | YES         | character varying
 payload.enriched.base_currency            | YES         | character varying
...
```
Where only processor is non-nullable. Therefore enrichment failures would not be
written with evaluations like:
```
payload.enriched.br_cookies -> Some(null) ->  BigInt -> Left(Invalid type
BIGINT for value Some(null))
```
This PR allows marking fields nullable by default. We might want to consider a
smarter approach at some point.

Run Details

411 of 625 relevant lines covered (65.76%)

0.66 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	#61.1	03 Nov 2020 08:30AM UTC	0	65.76

Source Files on build #61

Detailed source file information is not available for this build.

snowplow-incubator / snowplow-postgres-loader / #61
66%
master: 68%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build #61

snowplow-incubator / snowplow-postgres-loader / #61 66% master: 68%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build #61

snowplow-incubator / snowplow-postgres-loader / #61
66%
master: 68%

README BADGES
x