5818924645
91%

Ran 10 Aug 2023 08:46AM UTC

Jobs 4

Files 15

Run time 2s

Badge

Embed ▾

pending completion

Build # 5818924645

Build Type

push

github

Committed by

web-flow

Commit Message

[Commoncrawl pipeline] Add component download_commoncrawl_segments (#273)

This PR adds the second component of the Commoncrawl pipeline. The
component downloads the WARC segment files and extracts the webpage urls
and html code to be returned as a dask dataframe.

Coverage Stats

993 of 1100 relevant lines covered (90.27%)

3.6 hits per line

Jobs

ID	Job ID	Ran	Coverage
1	test-3.10 - 5818924645.1	10 Aug 2023 08:48AM UTC	90.09
2	test-3.9 - 5818924645.2	10 Aug 2023 08:48AM UTC	90.08
3	test-3.8 - 5818924645.3	10 Aug 2023 08:48AM UTC	90.26
4	test-3.11 - 5818924645.4	10 Aug 2023 08:48AM UTC	90.09

Source Files on build 5818924645

Detailed source file information is not available for this build.

ml6team / fondant / 5818924645
91%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 5818924645

ml6team / fondant / 5818924645 91%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 5818924645

ml6team / fondant / 5818924645
91%

README BADGES
x