1
89%
main: 87%

Ran 20 May 2016 04:03PM UTC

Files 120

Run time 8s

Badge

Embed ▾

Committed 20 May 2016 03:47PM UTC coverage: 80.769% (-0.3%) from 81.054%

Job # COVERALLS=true

Build Type

Pull #20

travis-ci

Committed by

muffato

Commit Message

New Meadow/Valley interface that detects slow workers and mark them as pending

This fixes @danstaines's issue:
[Feb 11th at 09:49]
I've got a problem with hive where I supply a registry, and the registry takes
a couple of minutes to load (this is normal with 40k bacteria unfortunately).

The registry takes a lot of time to load, so the worker is running from the LSF
point-of-view but is not registered in the database yet (because the DBAdaptor
object is not ready yet). Because of the discrepancy, beekeeper thinks that
nothing is running and keep on submitting new workers (beyond the analysis
capacity)

My fix is to basically count those workers as pending. Because the
Valley/Meadow had a method to get the running workers and another one to get
the pending workers, I had to unify them into a single method which saves us
one call to _bjobs_. Then the Valley adjusts the counts into a complex hash
that contains accurate information about all the workers. This super-hash is
then carried around in various places so that all the decisions are consistent
to each other. Overall the Valley now does more things and the Meadows are a
bit shorter

The test-suite has been updated accordingly

Pull Request Pull Request #20: Fix for DS slow registry

Coverage Stats

5418 of 6708 relevant lines covered (80.77%)

2773.07 hits per line

Ensembl / ensembl-hive / 449 / 1
89%
main: 87%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 449.1 (COVERALLS=true)

Ensembl / ensembl-hive / 449 / 1 89% main: 87%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 449.1 (COVERALLS=true)

Ensembl / ensembl-hive / 449 / 1
89%
main: 87%

README BADGES
x