Recidiviz / recidiviz-data / 231

66%

master: 86%

Pull #116

travis-ci

Add a scraper for Vermont to ingest (#115)

- Create a `us_vt` directory in ingest
  - Fill with classes to handle the scraping and models for UsVt
  - This jurisdiction uses JailTracker, so this commit can serve as a
    basis for future jurisdictions that use the JailTracker system.

- Update the web app configuration to add queues for scraping `us_vt`.

- Update a test to include the new 'us_vt' region in the list of all
  expected regions.

- Added a stop task for UsVt

- Moved common scraper environment setup to the base class

- Removed some debugging cruft and pylinted a few things.

- Added package level docs

- Inmate -> Person wherever possible

- Pushed UsVt model fields up to the parent level when they were not
  clearly jurisdiction-specific

- Functionified a few pieces of complicated code

- Documented parameters in task methods

- Reordered model attributes to be alphabetical

- Removed unused function

- Added TODOs and made issues for a few tasks that need addressing
  soon

- Tune parameters for production

- Improve robustness of which rows are requested and detecting
  terminal condition

- Add documentation to some functions that were missing it

- Rework the way agencies and facilities are parsed

- Break out logic to extract scraped data and crea entities for both
  Person and Record.

- Several logging improvements.

292 of 292 new or added lines in 12 files covered. (100.0%)

2387 of 3595 relevant lines covered (66.4%)

0.66 hits per line