webrecorder / warcio / 146 / 2

100%

master: 100%

push

travis-ci

New record HTTP http semantics (#43)

* add ability to record http traffic to warc directly!
Supports:

with (filename_or_warc_writer):
    requests.get(...)

- monkey-patch http.client.HTTPConnection (used by requests, etc..)
- contextmanager uses warc_writer to write captured data to warc
- optional filter callback to skip writing based on request/response
- use thread local to support concurrent recording, lock warc writer
- tests with requests, using httpbin
- add coveragerc with branching
- bump version to 1.6.0

- support passing filename directly to record_http, creates WARCWriter automatically
- remove record_http from default package init to avoid always monkey-patching
- pass warc_writer to filter function

- default record_http() with filename to append=True
- if append=False, open in exclusive write, raising if file already exists (don't provide option to overwrite existing WARC to discourage this)
- utils: add warcio.utils.open() which supports exclusive open 'x' mode for python 2.7

403 of 420 branches covered (95.95%)

1261 of 1263 relevant lines covered (99.84%)

1.0 hits per line