jbielick / faktory_worker_node / 28

94%

master: 97%

push

travis-ci

create manager->processor pool

major point of this is to create a pool of processors and a connection
pool. The connection pool holds concurrency + 2 connections to the
faktory server and each processor has it's own work loop and fetch
cycle. The connection pool is managed by the manager and all lifecycle
hooks are syndicated to the pool of workers. A processor is an object
that polls for jobs--checking out a connection for each command it
executes. It's working loop is an infinite for loop with awaiting on the
fetch and job execution.

                  ,_______________,
                  |    faktory    |
                  -----------------
                          |
                  ,________________
                 /        |        \
     ,___________,  ,___________,  ,___________,
     | processor |  | processor |  | processor |
     -------------  -------------  -------------
                  \       |       /
                   ---------------
                          |
                   ,-------------,
                   |   manager   |
                   ---------------

Where each processor has its own connection to the faktory server and
processor pools are managed by a manager. A manager has n concurrency
and that's the number of processors and connections that will be started
to serve that pool. All of this lives within one node process.

Benchmarks:

pool:

› bench/push

pushed: 30000 duration: 1.35946858s jobs/s: 22067

› bench/push

pushed: 30000 duration: 1.430357713s jobs/s: 20974

› bench/push

pushed: 30000 duration: 1.3823066609999999s jobs/s: 21703

› bench/work

Jobs processed: 30000
Concurrency: 20

Duration: 6.7563684649999995s
Jobs/s: 4440

› bench/work

Jobs processed: 30000
Concurrency: 20

Duration: 6.653886883s
Jobs/s: 4509

› bench/work

Jobs processed: 30000
Concurrency: 20

Duration: 6.515825339s
Jobs/s: 4604

===============================================================

pool without await this.execute and s... (continued)

22 of 24 branches covered (91.67%)

Branch coverage included in aggregate %.

95 of 101 relevant lines covered (94.06%)

15.83 hits per line