5829712268
91%

Ran 11 Aug 2023 06:43AM UTC

Jobs 4

Files 15

Run time 1s

Badge

Embed ▾

pending completion

Build # 5829712268

Build Type

push

github

Committed by

web-flow

Commit Message

Improve html extraction in commoncrawl download component

To guarantee robust HTML extraction, this PR introduces the usage of trafilatura, a powerful library that enhances the HTML extraction process. Additionally, the initialization of the boto3 session is now handled only once, preventing performance bottlenecks caused by multiple connection setups.

Coverage Stats

1003 of 1068 relevant lines covered (93.91%)

3.75 hits per line

Jobs

ID	Job ID	Ran	Coverage
1	test-3.11 - 5829712268.1	11 Aug 2023 06:46AM UTC	93.73
2	test-3.9 - 5829712268.2	11 Aug 2023 06:46AM UTC	93.72
3	test-3.10 - 5829712268.3	11 Aug 2023 06:46AM UTC	93.73
4	test-3.8 - 5829712268.4	11 Aug 2023 06:46AM UTC	93.91

Source Files on build 5829712268

Detailed source file information is not available for this build.

ml6team / fondant / 5829712268
91%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 5829712268

ml6team / fondant / 5829712268 91%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 5829712268

ml6team / fondant / 5829712268
91%

README BADGES
x