cjrh / deadpool / 30506674652

88%

push

github

feat: add remote Deadpool executor (#429)

## Big picture

Add an experimental remote executor so independent processes can share
one
server-owned Deadpool over Unix-domain or TCP sockets while retaining
the
standard `concurrent.futures.Executor` programming model. The
implementation
keeps application payloads opaque in the broker, makes distributed
ownership
and cancellation outcomes explicit, and bounds network-facing queues,
frames,
connections, and retained results.

The existing single-file module is migrated into a package so the remote
client/server implementation can be separated behind focused internal
modules
without breaking current `import deadpool` users.

## Changes

- Preserve the existing local executor API through package-level
re-exports and
  compatibility forwarding while moving the pool implementation to
  `deadpool/_pool.py`.
- Add `DeadpoolClient`, `DeadpoolServer`, and `RemoteFuture`, including
callable
and registered-task submission, ordered mapping,
health/status/statistics,
request identity, fork protection, and explicit client/server lifecycle
  handling.
- Add a private experimental wire protocol with safe JSON control
headers,
opaque chunked payloads, digest validation, bounded framing, typed
failures,
  and ordered full-duplex transport handling.
- Support protected Unix-domain sockets, explicit loopback TCP, and
caller-configured mutual TLS with bounded authentication and connection
  admission.
- Add broker-owned priority and principal-fair scheduling, queue and
execution
timeouts, ordinary/group/hard cancellation, terminal arbitration, and
bounded
  result retention with acknowledgement cleanup.
- Add serializer limits, worker-side opaque invocation decoding, remote
traceback fallbacks, and distinct transport, compatibility, queue,
process,
  cancellation, and result exceptions.
- Document the remote API, pickle trust boundary, experimental wire
status, and
  intentionally deferred protocol extensions.
- Add package c... (continued)

771 of 961 branches covered (80.23%)

Branch coverage included in aggregate %.

2175 of 2428 new or added lines in 13 files covered. (89.58%)

2633 of 2903 relevant lines covered (90.7%)

5.42 hits per line