geo-engine / geoengine / 29957817213
88%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 425
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 87.585% (-0.2%) from 87.738%
29957817213

push

github

web-flow 
feat: add Gdal process pool (#1192)

* ipc-channel based gdal process

Co-authored-by: Mika <78550479+0xmycf@users.noreply.github.com>

* use thread and transfer only tile grid data

* LazyLock

* gdal pool

* working pool, tests, lints

* revert arrow serialization for gdal ipc data

* fix end of file

* clarify field name

* update gdalsource-process binary handling

* fix lazy gdalsource-process path detection

* justfile: add run --release

* remove or downgrade debug logs in hot paths

* gdal pool: add more complex affinity calculation

* gdal process pool with more caching workers

* simplified pool again

* batching pool

* gdal pool next iteration

* more structure

* more constants, less unwrap. Add decay.

* make load_tile_data_process more reusable

* adapt multi tile source part 1

* adapt  gdal multi source. sort errors.

* fix typo

* adapt ci bench

* remove LLVM_PROFILE from worker processes.

* update backend justfile run

* rename pool, pool worker and reorder imports

* use process-wide gdal options in gdal worker process

* put "Grid" into type name + remove comments

* explain llcov related env modification

* rename gdal dataset holding struct

* calculate composite thereshold from others

* remove comment

* rename GdaProcess config fields and add docs

* restructure gdal handling and sources

* fmt

* change env_remove logic for coverage

* refactor common worker spwaning

* stac back to 0.17

* add  leader & follower feature to gdal pool

* add default viscurl params to gdal dataset params

* lints

* sequential build bins

* complete hashing, avod stalling in group read feature, serial tests

* deaktivate porp no loger valid test

* fix: remove trailing space in VSI_CACHE_SIZE default

* chore: remove commented-out dead gdal geotransform tests

* docs: explain leader/follower cancellation semantics in read_data

* fix: set VSICURL globals once at worker startup instead of per-request

* refactor: make gdal request deduplicati... (continued)

3022 of 3724 new or added lines in 38 files covered. (81.15%)

21 existing lines in 7 files now uncovered.

123306 of 140785 relevant lines covered (87.58%)

481313.37 hits per line

Uncovered Changes

Lines Coverage ∆ File
190
0.0
 geoengine/operators/src/bin/gdalsource_process_main.rs
121
84.61
 geoengine/operators/src/source/gdal_worker_process/process_pool.rs
95
55.4
 geoengine/operators/src/source/gdal_worker_process/process_common.rs
72
92.62
 geoengine/operators/src/source/gdal_worker_process/process_impl.rs
41
93.09
 geoengine/operators/src/source/gdal_worker_process/reader_mode.rs
29
59.56
 -5.68% geoengine/operators/src/engine/execution_context.rs
28
77.95
 geoengine/operators/src/source/gdal_worker_process/gdal_dataset_params.rs
17
69.67
 -7.86% geoengine/services/src/config.rs
17
96.43
 -0.42% geoengine/services/src/contexts/postgres.rs
13
74.0
 geoengine/operators/src/source/gdal_worker_process/reader.rs
12
73.33
 geoengine/operators/src/source/gdal_worker_process/db_types.rs
12
0.0
 0.0% geoengine/services/src/bin/geoengine-server.rs
11
84.51
 -15.49% geoengine/operators/src/util/retry.rs
9
87.01
 -5.11% geoengine/operators/src/source/multi_band_gdal_source/reader.rs
5
71.67
 -1.48% geoengine/operators/src/engine/query.rs
5
92.05
 -0.48% geoengine/operators/src/source/gdal_source/mod.rs
5
62.81
 -0.09% geoengine/services/src/contexts/mod.rs
4
97.3
 0.22% geoengine/operators/src/source/gdal_source/reader.rs
4
0.0
 0.0% geoengine/services/src/server.rs
3
95.6
 -0.03% geoengine/operators/src/adapters/raster_subquery/raster_subquery_reprojection.rs
3
0.0
 geoengine/operators/src/source/gdal_source/error.rs
3
0.0
 geoengine/operators/src/source/multi_band_gdal_source/error.rs
2
96.49
 geoengine/operators/src/util/gdal_config_options.rs
1
81.82
 -0.3% geoengine/operators/src/util/input/float_with_nan_serde.rs

Coverage Regressions

Lines Coverage ∆ File
12
52.5
 -15.0% geoengine/datatypes/src/raster/no_data_value_grid.rs
3
88.94
 12.55% geoengine/services/src/datasets/external/edr.rs
2
85.03
 -0.31% geoengine/operators/src/cache/shared_cache.rs
1
95.6
 -0.03% geoengine/operators/src/adapters/raster_subquery/raster_subquery_reprojection.rs
1
81.82
 -0.3% geoengine/operators/src/util/input/float_with_nan_serde.rs
1
96.43
 -0.42% geoengine/services/src/contexts/postgres.rs
1
0.0
 0.0% geoengine/services/src/server.rs
Jobs
ID Job ID Ran Files Coverage
1 29957817213.1 425
87.58
 GitHub Action Run
Source Files on build 29957817213