ghga-de / hexkit / 13832713629

93%

push

github

DB Versioning & Migration Tools (GSI-1462) (#159)

* Add migration tools with index copying functionality

* Remove info from MigrationStepError and soft mig fail logs

* Fix index copying and related tests

* Add impossible backward migration test and tweak staging-skip log

* Fix type-hints for 3.9

* Remove strict=True from zip for 3.9 support

* Add test for unapply() happy path

* Enable batch processing in migrate_docs_in_collection()

* Fix batching and add test

* Bump version from 4.1.1 -> 4.2.0

* Add migration idempotence test

* Add unit tests for some helper methods

* Add configurable migration timeout for waiters and test

* Make migration waiting timeout optional, default none

* Fix migration map typing issue

* Add more unit tests and fix doc string typo

* Test index copy enforcement upon collection drop

* Add unit test for validate_doc

* Fix slight problem with failed migration cleanup in auto_finalize()

* Organize integration tests a little better and add integration tests for auto_finalize()

* Fix relative import in tests that was broken in prv commit

* Improve db version record retrieval

Co-authored-by: Christoph Zwerschke <c.zwerschke@dkfz-heidelberg.de>

* Update old example usage in doc string

* Change RuntimeError to ValueError in MigrationManager init

* Spell out abbreviated test helper functions

* Add normal migration test

* Replace migration_type with 'backward' bool and update associated tests

* Remove doc copy in validate_doc

* Use datetimes instead of strings for migration timestamps

* Fix typo

Co-authored-by: Thomas Zajac <thomas-jakob.zajac@uni-tuebingen.de>

* Improve MigrationStepError and add test

---------

Co-authored-by: Christoph Zwerschke <c.zwerschke@dkfz-heidelberg.de>
Co-authored-by: Thomas Zajac <thomas-jakob.zajac@uni-tuebingen.de>

303 of 342 new or added lines in 3 files covered. (88.6%)

2328 of 2537 relevant lines covered (91.76%)

0.92 hits per line