gluesql / gluesql / 22273285091
99%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 341
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 98.196% (+0.1%) from 98.085%
22273285091

push

github

web-flow 
Move schemaless handling from execution layer to planner (#1865)

Move schemaless handling from execution to planner and complete the row model migration from `DataRow` to `Vec<Value>` across storages.

### Strategy
- Schemaless tables are planned as a single `_doc` map-column shape.
- Planner rewrites `SELECT id` -> `SELECT _doc['id'] AS id`.
- Planner rewrites `INSERT INTO T VALUES (...)` -> `INSERT INTO T (_doc) VALUES (...)`.
- Execution follows a unified row path after planning.

### Changes
- Add `plan/schemaless.rs` for schemaless query transformations.
- Add `plan/expr/visit_mut` utilities for AST mutation.
- Update INSERT/SELECT/UPDATE planning/execution paths for `_doc` handling.
- Add schemaless projection/subquery validation errors.
- Remove `DataRow` wrapper and migrate store row payloads to `Vec<Value>`.

## Storage Format Impact

### One-time migration required
- `gluesql-file-storage` (v1 -> v2, `migrate_to_latest`)
- `gluesql-redb-storage` (v1 -> v2, `migrate_to_latest`)
- `gluesql-sled-storage` (v1 -> v2, `migrate_to_latest`)

### Automatic migration
- `gluesql-web-storage` (v1 -> v2 on `WebStorage::new`)

### Reset policy (no one-time migrator)
- `gluesql-redis-storage`
  - payload shape changed
  - reset namespace data on upgrade

### No persisted data migration required
- `gluesql-idb-storage`
- `gluesql-json-storage`
- `gluesql-csv-storage`
- `gluesql-parquet-storage`
- `gluesql-mongo-storage`
- wrappers updated without independent format migration: `shared-memory`, `composite`, `git`

## CLI Upgrade Command

Added `--upgrade` mode to run one-time migrations for supported storages.

- supported: `sled`, `redb`, `file`
- requires: `--storage` + `--path`
- conflicts with: `--execute`, `--dump`

Usage:
```bash
gluesql --storage sled --path ./data --upgrade
gluesql --storage redb --path ./glue.redb --upgrade
gluesql --storage file --path ./data --upgrade
```

3974 of 4043 new or added lines in 100 files covered. (98.29%)

42726 of 43511 relevant lines covered (98.2%)

66426.64 hits per line

Uncovered Changes

Lines Coverage ∆ File
17
86.29
 storages/sled-storage/tests/migration_v1_to_v2_fixtures.rs
12
92.31
 storages/file-storage/src/migration.rs
9
90.22
 storages/file-storage/tests/migration_v1_to_v2_fixtures.rs
6
98.5
 storages/redb-storage/tests/migration_v1_to_v2.rs
5
98.75
 core/src/plan/schemaless.rs
3
97.94
 0.17% core/src/executor/insert.rs
2
97.59
 core/src/plan/expr/visit.rs
1
99.79
 -0.1% core/src/ast/query.rs
1
97.47
 -0.57% core/src/executor/aggregate.rs
1
93.33
 0.05% core/src/executor/execute.rs
1
95.34
 -0.45% core/src/plan/expr/evaluable.rs
1
97.5
 core/src/plan/expr/visit/aggregate.rs
1
99.69
 -0.31% core/src/plan/schema.rs
1
99.71
 core/src/plan/schemaless/validate.rs
1
99.13
 -0.87% core/src/plan/validate.rs
1
98.48
 -0.71% storages/json-storage/src/store_mut.rs
1
99.51
 0.02% storages/mongo-storage/src/store_mut.rs
1
93.75
 -2.08% storages/mongo-storage/tests/mongo_storage_conflict.rs
1
98.33
 storages/redb-storage/src/migration/v1_to_v2.rs
1
98.9
 storages/redb-storage/tests/migration_v1_to_v2_fixtures.rs
1
98.72
 0.21% storages/sled-storage/src/lib.rs
1
98.11
 storages/sled-storage/src/migration/v1_to_v2.rs
Jobs
ID Job ID Ran Files Coverage
1 22273285091.1 341
98.2
 GitHub Action Run
Source Files on build 22273285091