geo-engine / geoengine / 42983420678

88%

main: 88%

Build Type

push

github

Committed by web-flow

Commit Message

feat(backend): make all pool and concurrency sizes settings (#1407)

* feat(backend): make the sizes of the processing runtime settings

[processing_runtime] worker_threads (0 = one per core) and max_blocking_threads (512) are read before the runtime is built. The defaults are Tokio's.

* feat(backend): make the HTTP worker pool sizes settings

[web] workers (0 = actix default, one per core) and max_blocking_threads_per_worker (0 = max(512 / workers, 32), as before).

* feat(backend): make the GDAL read-ahead of the sources settings

[query_context] gdal_source_read_ahead (8) and multi_band_gdal_source_read_ahead (16) replace the hard-coded buffer sizes. QueryContext::gdal_read_ahead defaults to them, so mock contexts and benches are unchanged.

* feat(backend): make the number of parallel STAC cell searches a setting

[stac] max_concurrent_cell_searches (8) replaces MAX_CONCURRENT_CELL_SEARCHES. The provider reads it when it is built and passes it to its metadata, like its query cache.

* docs(backend): document GDAL_NUM_THREADS for the GDAL worker processes

The worker applies [gdal_process_pool.worker.gdal_config_options] before it opens a dataset, so GDAL_NUM_THREADS is already a setting there; unset keeps the driver's default.

* feat(backend): log the pool sizes at startup and bound the runtime shutdown

One line per pool with its effective size. After actix has stopped, the processing runtime waits at most 30 s (actix' default) for blocking tasks instead of forever.

* feat(backend): make the parallel STAC cell searches a field of the provider definition

* build(api-client): regenerate the clients for the STAC cell search limit

* feat(backend): let mock query contexts carry the GDAL read-ahead

Benches and tests can set the read-ahead that the server reads from
[query_context]; the default stays the built-in one.

Coverage Stats

121 of 168 new or added lines in 16 files covered. (72.02%)

3 existing lines in 2 files now uncovered.

137842 of 156633 relevant lines covered (88.0%)

536390.54 hits per line