3
70%
master: 70%

Ran 09 Nov 2018 06:12PM UTC

Files 383

Run time 10min

Badge

Embed ▾

Committed 09 Nov 2018 05:24PM UTC coverage: 53.734% (-0.008%) from 53.742%

Job # MC_TEST_CHUNK=3

Build Type

push

travis-ci

Committed by

hroberts

Commit Message

once fetch link queue gets below 25 links, requeue and exit

the fetch_link queue works in chunks of 10k urls.  this change makes
the parent process just requeue everything without domain throttling
once the queue gets below 25.  this is to speed up the last few urls
in the queue, which can take a long time to complete due to getting
starved out by the domain throttle scheduling and also prevents a couple
of failed fetch link jobs from killing the whole topic spidering job.

Run Details

12217 of 22736 relevant lines covered (53.73%)

110.45 hits per line

berkmancenter / mediacloud / 5835 / 3
70%
master: 70%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 5835.3 (MC_TEST_CHUNK=3)

berkmancenter / mediacloud / 5835 / 3 70% master: 70%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 5835.3 (MC_TEST_CHUNK=3)

berkmancenter / mediacloud / 5835 / 3
70%
master: 70%

README BADGES
x