uwescience / raco / 3133

92%

push

travis-ci

Myria broadcast partitioning support (#548)

* a first basic test

* broadcast with minimal tests; including de broadcast

* pep

* add MoveDeBroadcast rule for non-Myria backends

* fix more non-Myria backends

* flake

* convert PartitionFunction to DistributeFunction

* fix broadcast propagation bug in Apply

* fix tests

* more changes to shuffle types

Conflicts:
	raco/algebra.py
	raco/backends/myria/catalog.py
	raco/backends/myria/myria.py
	raco/myrial/interpreter.py

* HyperCubeShuffle renaming, add Broadcast as a df for MyriaShuffleProducer

* fix debroadcast for PushIntoSQL

* remove DeBroadcast logical operator

* fix assert

* comments

* track source relations in MyriaQueryScan

* set debroadcast in Myria encodings

* cleanup

* rename

* add new pseudo-functional distribute function syntax

* remove default round-robin partitioning on store

* fix tests

* code review feedback

* always shuffle FileScan input if not already shuffled

* fix rule

* fix rule

* fix repr

* add PushSelectThroughShuffle rule

* add tests

* fix selection on filescan

263 of 263 new or added lines in 10 files covered. (100.0%)

11911 of 12952 relevant lines covered (91.96%)

0.92 hits per line