woudc / woudc-data-registry / 266 / 1
50%
master: 50%

DEFAULT BRANCH: master
Ran
Files 17
Run time 3s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 57.477% (-1.4%) from 58.842%
WDR_LOGGING_LOGLEVEL=ERROR WDR_LOGGING_LOGFILE=/tmp/woudc-data-registry.log WDR_DB_DEBUG=False WDR_DB_TYPE=postgresql WDR_DB_HOST=localhost WDR_DB_PORT=5432 WDR_DB_NAME=woudc-data-registry WDR_DB_USERNAME=postgres WDR_DB_PASSWORD=postgres PGPASSWORD=postgres WDR_SEARCH_TYPE=elasticsearch WDR_SEARCH_URL=http://localhost:9200/ WDR_WAF_BASEURL=https://woudc.org/archive/ WDR_WAF_BASEDIR=/tmp WDR_TABLE_SCHEMA=$TRAVIS_BUILD_DIR/data/tables-schema.json WDR_TABLE_CONFIG=$TRAVIS_BUILD_DIR/data/migrate/tables-backfilling.yml WDR_ERROR_CONFIG=$TRAVIS_BUILD_DIR/data/migrate/errors-backfilling.csv WDR_ALIAS_CONFIG=$TRAVIS_BUILD_DIR/data/aliases.yml WDR_EXTRA_CONFIG=$TRAVIS_BUILD_DIR/data/extra-options.yml

push

travis-ci

web-flow 
Operator and Run Reports (#35)

* Merged series of commits for pull request #34,
creating a stub class ReportWriter that will eventually
control operator report generation and plugging it into
the existing processing code.

Uses the ReportWriter and error configuration file
for deciding if an error is severe or not, rather than
having hard-coded decisions.

Unify file and directory inputs

Report writer skeleton

Load error definitions into report

Use error definition file for warning/error determination

Plug in standard process to reports

Redevelop error codes and messages

Attach parser success decisions to report

Attach processing success decisions to report

Move parsing outside of processing

Coordinate tests with report updates

Introduce and use backfilling errors config

Add missing licenses to files

Plug dataset_validators.py into report generator

Fix dataset_validators.py error codes

Replace &= with if statements

Resolve pull request #34 requested changes

* Report file writer skeleton

* Add report run numbers and filepaths

* Auto-compute report run number

* Collect data for operator report

* Produce operator reports

* Collect data for run reports

* Produce run reports

* Setup basic report testing

* Add error file and output directory tests

* One-file operator report tests

* Add one-file run report tests

* Multi-file report tests

* Fix wrong reporter variable usage

* Block report files when working directory is null

* Properly handle single-file parent directory

* Get rid of accidental CLI command

* Add report generation to README

* Get rid of error-causing verify kwarg for instruments

* Change empty strings to None

* Separate RunReport into own class

* Separate ReportWriter into specific report classes

* Give report types common superclass

* Remove run numbers and restore statelessness

* Make OperatorReport a context manager... (continued)

2237 of 3892 relevant lines covered (57.48%)

0.57 hits per line

Source Files on job 266.1 (WDR_LOGGING_LOGLEVEL=ERROR WDR_LOGGING_LOGFILE=/tmp/woudc-data-registry.log WDR_DB_DEBUG=False WDR_DB_TYPE=postgresql WDR_DB_HOST=localhost WDR_DB_PORT=5432 WDR_DB_NAME=woudc-data-registry WDR_DB_USERNAME=postgres WDR_DB_PASSWORD=postgres PGPASSWORD=postgres WDR_SEARCH_TYPE=elasticsearch WDR_SEARCH_URL=http://localhost:9200/ WDR_WAF_BASEURL=https://woudc.org/archive/ WDR_WAF_BASEDIR=/tmp WDR_TABLE_SCHEMA=$TRAVIS_BUILD_DIR/data/tables-schema.json WDR_TABLE_CONFIG=$TRAVIS_BUILD_DIR/data/migrate/tables-backfilling.yml WDR_ERROR_CONFIG=$TRAVIS_BUILD_DIR/data/migrate/errors-backfilling.csv WDR_ALIAS_CONFIG=$TRAVIS_BUILD_DIR/data/aliases.yml WDR_EXTRA_CONFIG=$TRAVIS_BUILD_DIR/data/extra-options.yml)