open-hyped / crane / 18857903855

Builds Branch Commit Type Ran Committer Via Coverage
18857903855 main fix sample count sharding strategy (#9) * fix sample count sharding strategy * fix format type lookup for python versions <=3.11 --------- Co-authored-by: Niclas Doll <niclas.doll@iais.fraunhofer.de> push web-flow github
95.87
18857844763 5-sharding-not-working-for-main-process-runner Merge ab5f95188 into 044e855dd Pull #9 web-flow github
95.87
18731380786 main Refactor/message queues (#8) * refactor: replace msg connection objects with queues * fix: tests --------- Co-authored-by: Niclas Doll <niclas.doll@iais.fraunhofer.de> push web-flow github
96.55
18731340613 refactor/message-queues Merge fe6e9f3ab into 2f24ad5d3 Pull #8 web-flow github
96.55
18698953732 main fix: datasets depricated TypedExamplesIterable (#7) Co-authored-by: Niclas Doll <niclas.doll@iais.fraunhofer.de> push web-flow github
96.86
18698922289 fix/typed-examples-iterable Merge 4c3fdbbb5 into 157fb394b Pull #7 web-flow github
96.86
12531161929 main Make arrow fast (#3) * Implement faster rebatch * Report number of processed examples instead of iterations * Support different data formats in writer and route to the best option * Refactor routing to format-specific write function *... push web-flow github
96.48
12530742037 fix/arrow-to-slow Merge d61e35139 into 822e23b12 Pull #3 web-flow github
96.48
12509649680 main Use Arrow Tables for data transfer between processes (#2) * Back all operations by ExamplesIterable objects and use pyarrow tables for data transfer between workers * Use arrow formatting for writers and use native batch size instead of buffer... push web-flow github
96.39
12509629473 refactor/pyarrow-backend Merge caea653f3 into 077e5fa21 Pull #2 web-flow github
96.31
12496487832 main README push ndoll1998 github
96.73
12496385921 main README push ndoll1998 github
96.73
12496326482 main Remove license push web-flow github
96.73
12496027559 main Remove direct dependency to sharedmock push ndoll1998 github
96.07
12495904263 main Fix workflow file push ndoll1998 github
96.07