supabase / etl / 33508594766

77%

Build Type

push

github

Committed by web-flow

Commit Message

refactor(ducklake): use shared duckdb instances with multiple connections (#1002)

* fix(ducklake): recreate pool of duckdb connections when a maintenance completed

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* fix regressions

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* feat(ducklake): add deferred durability to ducklake in SYNC phase

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* fix deadlock

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* fix schemaRewind error

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* improve clones, code and fix potential deadlock

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* improve shape of config and enable it by default

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* refactor

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* avoid global lock

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* refactor(ducklake): use shared duckdb instances with multiple connections

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

* address comments from review

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

---------

Signed-off-by: Benjamin <5719034+bnjjj@users.noreply.github.com>

Coverage Stats

246 of 270 new or added lines in 3 files covered. (91.11%)

18 existing lines in 3 files now uncovered.

54441 of 70416 relevant lines covered (77.31%)

6295.98 hits per line