777
0%

Ran 19 Oct 2017 04:47PM UTC

Jobs 5

Files 44

Run time 1min

Badge

Embed ▾

pending completion

Build # 777

Build Type

Pull #186

travis-ci

Committed by

web-flow

Commit Message

scrapy: don't use persistent JOBDIR

* The problem is that the JOBDIR has to be unique for each crawl, so
  if it's set as a global setting in scrapy that prevents from running
  crawls in parallel because they collide when using that dir.
  On the other hand, it's a feature that we are not currently using,
  so deactivating it looks like the way to go.

* I had to create also a `StatefulSpider` in order to retain the
  `state` property in the spider, as we use that to accumulate the
  spider errors and the spiderstate extension gets disabled when
  `JOBDIR` is not set.

Signed-off-by: David Caro <david@dcaro.es>

Pull Request Pull Request #186: scrapy: don't use persistent JOBDIR

Run Details

3516 of 3776 relevant lines covered (93.11%)

2.16 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	777.1 (SUITE=unit)	19 Oct 2017 04:48PM UTC	44	87.0	Travis Job 777.1
2	777.2 (SUITE=functional_wsp)	19 Oct 2017 04:49PM UTC	44	35.12	Travis Job 777.2
3	777.3 (SUITE=functional_arxiv)	19 Oct 2017 04:48PM UTC	44	34.03	Travis Job 777.3
4	777.4 (SUITE=functional_desy)	19 Oct 2017 04:47PM UTC	44	30.93	Travis Job 777.4
5	777.5 (SUITE=functional_cds)	19 Oct 2017 04:48PM UTC	44	28.55	Travis Job 777.5

Source Files on build 777

Coverage	∆	File	Lines	Relevant	Covered	Missed	Hits/Line

inspirehep / hepcrawl / 777
0%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 777

inspirehep / hepcrawl / 777 0%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 777

inspirehep / hepcrawl / 777
0%

README BADGES
x