mrocklin / dask / 1320

93%

master: 94%

push

travis-ci

Add task-based shuffle for dask.bag

This uses the transpose trick originally described in
https://github.com/dask/dask/issues/417 to affect a shuffle using the
task scheduling framework.  This is slower than partd on a single
machine but can work with the distributed scheduler.

This operates in log(n) / log(32) full memory copies and
n_partitions * 32 * n_copies tasks.

37 of 37 new or added lines in 1 file covered. (100.0%)

8567 of 9147 relevant lines covered (93.66%)

0.94 hits per line