lubitchv / dataverse / #123

25%

Build Type

push

github

Committed by web-flow

Commit Message

IQSS/10697 - Improve batch permission indexing (#10698)

* reindex batches of 20 files instead of all at once

* Also only keep 100 files in list at a time

* release note

* Just do collections/datasets as you go

Avoids keeping everything in memory, also helps in tracking progress as
you can see the permissionindextime getting updated per dataset.

* fix merge issues, add logging

* put comments back to how they were #10697

* reduce logging #10697

* rename release note and add PR number #10697

* fix logging - finest for per file, space in message

* adding a space in log message - per review

---------

Co-authored-by: Philip Durbin <philip_durbin@harvard.edu>

Coverage Stats

0 of 66 new or added lines in 1 file covered. (0.0%)

233 existing lines in 3 files now uncovered.

17977 of 86138 relevant lines covered (20.87%)

0.21 hits per line