open-hyped / crane
96%

DEFAULT BRANCH: main
Repo Added
Files 21
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH main
branch: SELECT
CHANGE BRANCH
x

coverage: 95.867% (-0.7%) from 96.552%
18857903855

push

github

web-flow 
fix sample count sharding strategy (#9)

* fix sample count sharding strategy

* fix format type lookup for python versions <=3.11

---------

Co-authored-by: Niclas Doll <niclas.doll@iais.fraunhofer.de>

29 of 33 new or added lines in 4 files covered. (87.88%)

6 existing lines in 1 file now uncovered.

1322 of 1379 relevant lines covered (95.87%)

0.96 hits per line

Relevant lines Covered
1379 RELEVANT LINES 1322 COVERED LINES
0.96 HITS PER LINE
Source Files on main

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
18857903855 main fix sample count sharding strategy (#9) * fix sample count sharding strategy * fix format type lookup for python versions <=3.11 --------- Co-authored-by: Niclas Doll <niclas.doll@iais.fraunhofer.de> push web-flow github
95.87
18857844763 5-sharding-not-working-for-main-process-runner Merge ab5f95188 into 044e855dd Pull #9 web-flow github
95.87
18731380786 main Refactor/message queues (#8) * refactor: replace msg connection objects with queues * fix: tests --------- Co-authored-by: Niclas Doll <niclas.doll@iais.fraunhofer.de> push web-flow github
96.55
18731340613 refactor/message-queues Merge fe6e9f3ab into 2f24ad5d3 Pull #8 web-flow github
96.55
18698953732 main fix: datasets depricated TypedExamplesIterable (#7) Co-authored-by: Niclas Doll <niclas.doll@iais.fraunhofer.de> push web-flow github
96.86
18698922289 fix/typed-examples-iterable Merge 4c3fdbbb5 into 157fb394b Pull #7 web-flow github
96.86
12531161929 main Make arrow fast (#3) * Implement faster rebatch * Report number of processed examples instead of iterations * Support different data formats in writer and route to the best option * Refactor routing to format-specific write function *... push web-flow github
96.48
12530742037 fix/arrow-to-slow Merge d61e35139 into 822e23b12 Pull #3 web-flow github
96.48
12509649680 main Use Arrow Tables for data transfer between processes (#2) * Back all operations by ExamplesIterable objects and use pyarrow tables for data transfer between workers * Use arrow formatting for writers and use native batch size instead of buffer... push web-flow github
96.39
12509629473 refactor/pyarrow-backend Merge caea653f3 into 077e5fa21 Pull #2 web-flow github
96.31
See All Builds (24)