1
81%
master: 81%

Ran 25 Nov 2024 10:16AM UTC

Files 42

Run time 1s

Badge

Embed ▾

Committed 25 Nov 2024 10:12AM UTC coverage: 80.314% (-0.4%) from 80.692%

Job # 12007810384.1

Build Type

push

github

Committed by

web-flow

Commit Message

Preserve original field order when merging parquet Fields (#213)

We use the `Migrations.mergeSchema` function in the loaders, for
combining a series of schemas (e.g. `1-0-0`, `1-0-1`, `1-0-2`) into a
reconciled column

Before this PR, `mergeSchemas` contained some logic to preserve field
order... but it was the wrong logic. It preserved field order of the
newer schema, ignoring whether a field was present in the older schema.

After this PR, we preserve field order of the older schema.  New fields
added in a later schema are appended to the end of the field list.

This feature change is needed for loaders that only allow field
additions when they are appended to the end of a struct. E.g. the Lake
Loader for Hudi/Glue.

Run Details

1277 of 1590 relevant lines covered (80.31%)

0.8 hits per line

snowplow / schema-ddl / 12007810384 / 1
81%
master: 81%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 12007810384.1

snowplow / schema-ddl / 12007810384 / 1 81% master: 81%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 12007810384.1

snowplow / schema-ddl / 12007810384 / 1
81%
master: 81%

README BADGES
x