reanahub / reana-server / 434

53%

push

travis-ci

global: workflow execution scheduler

* Adds scheduler.py with WorkflowExecutionScheduler class,
  responsible for consuming the workflow-submission queue and
  schedule the execution of workflows based on priority and
  system availability. The scheduler checks with every new message
  whether the cluster has available resources to start a new
  workflow execution.
  If not the message in the workflow submission queue is requeued.

* Adds WorkflowSubmissionPublisher to do the publishing of the
  incoming workflow submissions to the corresponding message queue.

* Separates start_workflow from set_workflow_status.

* Updates openapi specifications with start_workflow

* Adds start_scheduler command to setup.py.

* Adds python kubernetes library as a dependency, to read the
  cluster nodes status.

* Imports workflow retrieval by id or name utilities from reana-db.
  Moved from RWC for reuse in other components.

* Adds kwargs to be passed to base consumer class.

* Adds tests for the workflow execution scheduler,
  asserting that workflows are started properly when conditions are
  met, and that the messages are requeued otherwise.

* Upgrades reana-commons to latest dev version.

* Applies review fixes.

Signed-off-by: Dinos Kousidis <dinos.kousidis@cern.ch>

61 of 61 new or added lines in 4 files covered. (100.0%)

268 of 488 relevant lines covered (54.92%)

0.55 hits per line