supabase / etl / 25307133081
76%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 180
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 76.562% (+0.4%) from 76.129%
25307133081

push

github

web-flow 
Add ClickHouse destination (#658)

* add support clickhouse destination wip

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* add support for clickhouse destination in ETL and API

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* Add example binary

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* fixes

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* Add local ClickHouse test helper

* Fix ClickHouse test row id type

* Avoid async cleanup panic in ClickHouse tests

* Fix ClickHouse UUID encoding

* Add ClickHouse update streaming integration test

* Format ClickHouse destination files

* Adapt ClickHouse destination to async flushing API

Main introduced AsyncResult parameters on the Destination trait
(truncate_table, write_table_rows, write_events). Update the
ClickHouse implementation to conform, add missing K8sClient trait
stubs, and fix imports that drifted during rebase.

* Remove unused log_config helpers from replicator

These were carried over during the ClickHouse rebase but the startup
path on main no longer calls them, triggering dead_code warnings.

* Sort Cargo.toml files

* Remove skip_if_missing_clickhouse_env_vars from tests

Silently skipping tests when env vars are missing gives false
confidence. The tests should fail explicitly so missing configuration
is always noticed.

* Add boundary-values integration test for ClickHouse

Exercises encoding edge cases the all_types test does not cover:
- NULL scalars (nullable columns with SQL NULL)
- NULL elements inside arrays (ARRAY[1, NULL, 3])
- Empty strings distinct from NULLs
- Single-element arrays (varint length = 0x01)
- Multi-byte UTF-8 (emoji, CJK) in scalars and arrays
- Zero integer distinct from NULL

* Add ClickHouse env vars to CI

The docker-compose stack already starts a ClickHouse container but
the test env vars were not set, causing the integration tests to
panic. Wire up the same defaults used b... (continued)

1479 of 1781 new or added lines in 17 files covered. (83.04%)

20 existing lines in 8 files now uncovered.

29405 of 38407 relevant lines covered (76.56%)

903.13 hits per line

Uncovered Changes

Lines Coverage ∆ File
82
85.93
 etl-destinations/src/clickhouse/core.rs
82
0.0
 etl-examples/src/bin/clickhouse.rs
32
89.74
 etl-destinations/src/clickhouse/encoding.rs
27
89.18
 -1.55% etl-api/src/k8s/http.rs
16
91.67
 etl-destinations/src/clickhouse/client.rs
13
89.92
 etl-destinations/src/clickhouse/test_utils.rs
11
52.94
 -5.39% etl-api/src/validation/validators.rs
11
0.0
 0.0% etl-replicator/src/core.rs
10
94.05
 etl-destinations/src/clickhouse/schema.rs
9
90.72
 0.14% etl-api/src/configs/destination.rs
4
61.18
 -3.02% etl-api/src/k8s/cache.rs
2
25.0
 -3.57% etl-api/src/k8s/base.rs
2
18.57
 -0.55% etl-config/src/shared/destination.rs
1
0.0
 0.0% etl-replicator/src/init/destination.rs

Coverage Regressions

Lines Coverage ∆ File
6
71.59
 -1.7% etl/src/workers/table_sync_copy.rs
5
84.54
 -2.42% etl/src/test_utils/test_destination_wrapper.rs
3
87.32
 -0.72% etl-postgres/src/tokio/test_utils.rs
2
85.03
 2.04% etl/src/replication/table_sync.rs
1
90.72
 0.14% etl-api/src/configs/destination.rs
1
25.0
 -3.57% etl-api/src/k8s/base.rs
1
61.18
 -3.02% etl-api/src/k8s/cache.rs
1
89.18
 -1.55% etl-api/src/k8s/http.rs
Jobs
ID Job ID Ran Files Coverage
1 25307133081.1 180
76.56
 GitHub Action Run
Source Files on build 25307133081