decentraland / world-storage-service / 39393523928

97%

main: 97%

push

github

feat: scene storage export (#125)

* test(scene-storage-export): phase 1 red

* feat(scene-storage-export): stream scene world and player storage rows for export

* test(scene-storage-export): phase 2 red

* feat(scene-storage-export): add export jobs store

* test(scene-storage-export): phase 3 red

* feat(scene-storage-export): add export worker and serializers

* test(scene-storage-export): phase 4 red

* feat(scene-storage-export): add export HTTP API

* test(scene-storage-export): scene export budget and NUL key red

* fix(scene-storage-export): cap exports per scene and budget stored files

Take the create lock per scene and limit in-flight jobs per scene as well
as per signer. Refuse to store a finished file when the scene's unexpired
files would exceed EXPORT_MAX_SCENE_STORED_BYTES, failing the job with
'Export storage limit reached'. Reject storage keys containing NUL, which
Postgres cannot store, with a 400 instead of a 500.

* docs(scene-storage-export): record the per-scene export budget decision

* docs: note parallel test isolation and nested worktree gotchas

Also documents:
- AGENTS.md: per-run HTTP_SERVER_PORT/PG_COMPONENT_PSQL_DATABASE for parallel test runs, and Jest collecting nested .worktrees specs

* test(scene-storage-export): streaming export red

* feat(scene-storage-export): stream exports instead of async jobs

* test(scene-storage-export): late timeout must not escape as an unhandled error

* fix(scene-storage-export): log a timeout that fires after the pipeline settled instead of crashing

* docs(learning): record the streaming export decision and stream lifecycle gotchas

* test(scene-storage-export): per-pod cap, release accounting, late cancel log and HTTP disconnect

* feat(scene-storage-export): cap concurrent exports per pod and log late client cancels

* docs(learning): record the per-pod export cap and correct the stream lifecycle gotchas

* fix(http): treat a request without Content-Length or Transfer-Encoding as... (continued)

759 of 805 branches covered (94.29%)

Branch coverage included in aggregate %.

187 of 189 new or added lines in 14 files covered. (98.94%)

1627 of 1659 relevant lines covered (98.07%)

110.3 hits per line