jbielick / faktory_worker_node
94%
master: 97%

LAST BUILD BRANCH: dependabot/npm_and_yarn/y18n-4.0.3
DEFAULT BRANCH: master
Repo Added
Files 9
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH pool
branch: pool
CHANGE BRANCH
x

28

push

travis-ci

jbielick 
create manager->processor pool

major point of this is to create a pool of processors and a connection
pool. The connection pool holds concurrency + 2 connections to the
faktory server and each processor has it's own work loop and fetch
cycle. The connection pool is managed by the manager and all lifecycle
hooks are syndicated to the pool of workers. A processor is an object
that polls for jobs--checking out a connection for each command it
executes. It's working loop is an infinite for loop with awaiting on the
fetch and job execution.

                  ,_______________,
                  |    faktory    |
                  -----------------
                          |
                  ,________________
                 /        |        \
     ,___________,  ,___________,  ,___________,
     | processor |  | processor |  | processor |
     -------------  -------------  -------------
                  \       |       /
                   ---------------
                          |
                   ,-------------,
                   |   manager   |
                   ---------------

Where each processor has its own connection to the faktory server and
processor pools are managed by a manager. A manager has n concurrency
and that's the number of processors and connections that will be started
to serve that pool. All of this lives within one node process.

Benchmarks:

pool:

› bench/push

pushed: 30000 duration: 1.35946858s jobs/s: 22067

› bench/push

pushed: 30000 duration: 1.430357713s jobs/s: 20974

› bench/push

pushed: 30000 duration: 1.3823066609999999s jobs/s: 21703

› bench/work

Jobs processed: 30000
Concurrency: 20

Duration: 6.7563684649999995s
Jobs/s: 4440

› bench/work

Jobs processed: 30000
Concurrency: 20

Duration: 6.653886883s
Jobs/s: 4509

› bench/work

Jobs processed: 30000
Concurrency: 20

Duration: 6.515825339s
Jobs/s: 4604

===============================================================

pool without await this.execute and s... (continued)

22 of 24 branches covered (91.67%)

Branch coverage included in aggregate %.

95 of 101 relevant lines covered (94.06%)

15.83 hits per line

Relevant lines Covered
101 RELEVANT LINES 95 COVERED LINES
15.83 HITS PER LINE
Source Files on pool
Coverage ∆ File Lines Relevant Covered Missed Hits/Line Branch Hits Branch Misses

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
28 pool create manager->processor pool major point of this is to create a pool of processors and a connection pool. The connection pool holds concurrency + 2 connections to the faktory server and each processor has it's own work loop and fetch cycle. The... push jbielick travis-ci pending completion  
See All Builds (326)