Giorgi / DuckDB.NET / 42250146953

94%

develop: 94%

Build Type

push

github

Committed by Giorgi

Commit Message

Append each Arrow batch as one chunk

DuckDB main casts a chunk of any length (duckdb/duckdb#27664), so a batch
is no longer cut into slices of 2048 rows. A batch that fails now appends
nothing of itself, where the slices before the failing one used to stay,
and long batches skip the slicing's cost: 1.20x and 1.2 MB per 1M rows on
65536-row batches against the same calls made directly (Linux VM, .NET 10,
DuckDB 2.0.0). DuckDB 2.0.0 fails such a batch when a column needs a cast,
so the appender stays on nightly-builds until DuckDB.NET targets 2.0.1.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LUiK1pvgPkj5cNpmZiTsNr

Coverage Stats

2805 of 3047 branches covered (92.06%)

Branch coverage included in aggregate %.

1 of 1 new or added line in 1 file covered. (100.0%)

6 existing lines in 2 files now uncovered.

4440 of 4693 relevant lines covered (94.61%)

1031376.65 hits per line