TUW-GEO / pytesmo

85%

master: 88%

LAST BUILD ON BRANCH fix-comparison-of-other-dataset-combos

branch: fix-comparison-of-other-dataset-combos

CHANGE BRANCH

x

Reset

• fix-comparison-of-other-dataset-combos
• ERS-reader-adaption
• H-SAF-pygeobase
• add-adapters
• add-additional-jd-test
• add-dekad-functions
• add-hamming-window
• add-julian-tests
• add-poets-timedate-stuff
• add-processing-framwork-tests
• add-tc-metrics-calc
• advanced_masking_adapter
• appveyor-conda
• appveyor-support
• automate-documentation-build
• climatology-less-than-full-year-leapyear
• dctpls
• develop
• feature/confidence_intervals
• feature/ismn-dateplot
• filters-fix
• fix-RuntimeError-DataManager
• fix-appveyor-versioning
• fix-ascat-segfault
• fix-boxcar-size1
• fix-docs
• fix-empty-dataframes-in-validation
• fix-exponential-filter-initialization
• fix-exponential-filter-nan
• fix-grids-deprecation-warning
• fix-h07-return-values
• fix-hsaf-ssm-mean
• fix-ismn-plotting
• fix-julian2datetime-bug
• fix-plotting-test
• fix-python36-test
• fix-resample-dtypes
• fix-return-clim
• fix-seas-val
• fix-temporal-matching
• fix-temporal-resampling-series
• fix_ci
• fix_numpy_installation
• import_ascat0.9
• improve-climatology
• improve-ismn-metadata-reading
• improve-ismn-performance
• improve_doy_testing
• ismn-refactor-common-interfaces
• make-mse-test-less-sensitive
• make-validation-framework-more-modular
• master
• move-ismn-to-package
• pybufr-ecmwf-conda-forge
• pyscaff_update
• python-3-6
• python3-support
• recursive_r
• refactor-resample-function
• refactor-scaling
• remove-ascat
• remove-dos-line-endings
• remove-grid-stuff
• remove-grids
• rolmetrics
• rtd
• s-scherrer-patch-1
• s-scherrer-patch-2
• scaling-validation-fw
• skip-h08-tests
• tcol-fix-24
• temporal-matching-performance
• test-data-repo
• triple-col-fix-24
• ubrmsd-test
• update-docs-minimize-pypi-package
• update-pyscaffold
• update-test-data-repo
• use-pybufr-ecmwf-conda-in-travis
• v0.10.x
• v0.11.3
• v0.11.4
• v0.12.0
• v0.13.0
• v0.13.1
• v0.13.2
• v0.13.3
• v0.13.4
• v0.14.0
• v0.14.1
• v0.14.2
• v0.14.3
• v0.14.4
• v0.15.0
• v0.15.1
• v0.15.2
• v0.16.0
• v0.16.1
• v0.17.0
• v0.18.0
• v0.2.4
• v0.3.0
• v0.3.1
• v0.3.2
• v0.3.4
• v0.3.5
• v0.3.6
• v0.4.0
• v0.5.1
• v0.5.2
• v0.6.0
• v0.6.1
• v0.6.10
• v0.6.2
• v0.6.3
• v0.6.4
• v0.6.5
• v0.6.6
• v0.6.7
• v0.6.8
• v0.6.9
• v0.9
• v0.9.1
• validation-framework-refactor

Build # 978

Build Type

push

travis-ci

Committed by cpaulik

Commit Message

Val Framework compares dataset matches that do not include the temporal reference

This changes the behavior of the validation framework.

Before this a validation run with `(n, k)` where `k < n` only gave results for
combinations of datasets which included the temporal reference.

e.g. If 3 dataset (DS1, DS2 and DS3) where given and a metric calculator was run
with `(3, 2)` with the temporal reference DS1. Then only the combinations of
`DS1 - DS2` and `DS1 - DS3` gave results.

This rectifies this behavior to also return results for the combination `DS2 -
DS3` in the above example.

Tests still need to be adapted but I want to discuss this first to see if this
is what people expect.

There are also some edge cases. e.g. If 4 datasets are given but the
configuration of the metric calculator would be `(3, 2)`. I think we should
raise an error in these cases because that would mean that the temporal
reference is not included in all matches.

Run Details

577 of 743 branches covered (77.66%)

24 of 24 new or added lines in 2 files covered. (100.0%)

1700 of 1990 relevant lines covered (85.43%)

2.56 hits per line