google / sedpack / 11593962917

89%

push

github

Implement limiting the number of shard types (#47)

Implement limiting the number of shards with a given `custom_metadata`
resulting in using at most a `custom_metadata_type_limit` shards of the
same `custom_metadata`. This is useful for experiments with how much
data is needed to train a neural network (say with `custom_metadata`
denoting the uniform content type in the whole shard).

58 of 58 new or added lines in 2 files covered. (100.0%)

2285 of 2644 relevant lines covered (86.42%)

0.86 hits per line