• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

supabase / etl / 36677907011
79%

Build:
DEFAULT BRANCH: main
Ran 30 Sep 2026 06:31AM UTC
Jobs 1
Files 223
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

30 Sep 2026 06:22AM UTC coverage: 76.963% (+0.009%) from 76.954%
36677907011

push

github

web-flow
 clickhouse: stop dropped and resurrected inserts (#1077)

* clickhouse: keep identical initial-copy batches

ClickHouse can drop an insert whose rows match a recent one. The
initial copy sent no token, so two different batches with identical
rows looked like a retry and ClickHouse kept only one. Replicated and
Shared tables do this by default.

Send the copy batch ID as the insert's deduplication token. Distinct
batches are all kept, and a redelivered batch is still dropped.

* clickhouse: use synchronous inserts

Since ClickHouse 26.2 the server queues inserts by default. When the
wait for a queued flush times out, the server returns an error but
keeps the rows queued. ETL replays the batch, and the stale rows can
land later, even after a replayed TRUNCATE. Pin async_insert=0.

Synchronous inserts turn on content deduplication for Replicated and
Shared tables. A replayed change-stream block could then be dropped
after a replayed TRUNCATE removed it, if the table remembers the block
across the truncate. Give each change-stream insert a random token so
ClickHouse never drops one. Replays already tolerate duplicate rows.

* clickhouse: test timed-out queued insert

ClickHouse 26.2 and newer queue inserts by default. When the wait for a
queued flush times out, the server reports an error but keeps the rows
queued, so they can land after a later TRUNCATE. The new test runs the
destination as a user whose profile queues inserts with a short wait,
truncates, flushes the queue, and checks that the table stays empty.

It fails without `async_insert = 0` (the row comes back) and passes
with it. `use_user_with_settings` gives the test its own user, since the
client drops URL settings and the shared test user must stay unchanged.

* clickhouse: keep content dedup for CDC inserts

Change-stream inserts sent a random deduplication token so ClickHouse
would never drop a replayed block that a replayed TRUNCATE had just
removed. That failure does not reproduce: on C... (continued)

45 of 47 new or added lines in 3 files covered. (95.74%)

2 existing lines in 1 file now uncovered.

46520 of 60445 relevant lines covered (76.96%)

10198.54 hits per line

Uncovered Changes

Lines Coverage ∆ File
2
87.57
1.29% crates/etl-destinations/src/clickhouse/test_utils.rs

Coverage Regressions

Lines Coverage ∆ File
2
51.17
-0.08% crates/etl-maintenance/src/ducklake/runner.rs
Jobs
ID Job ID Ran Files Coverage
1 36677907011.1 30 Sep 2026 06:31AM UTC 223
76.96
GitHub Action Run
Source Files on build 36677907011
  • Tree
  • List 223
  • Changed 4
  • Source Changed 3
  • Coverage Changed 4
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • Github Actions Build #36677907011
  • 11e5743e on github
  • Prev Build on main (#36553599401)
  • Next Build on main (#36686389623)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE TRIAL · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc