codegram / spinach

92%

Build Type

push

travis-ci

Committed by oriolgual

Commit Message

Finally randomize feature & scenario ordering (#204)

* fix 2 documentation mistakes

* removing extraneous whitespace

* Stable identifiers for ordering features and scenarios.

We need the relative filename involved in both so that a seed can
generate stable randomizations across runs and machines. Similarly,
that's why we need the line number for Scenario#ordering_id.

* introduce Orderers without hooking them up to anything

* hook up Orderers to Reporters. still not reordering tests at all

* Add features for testing randomization and random seeding

* Add cli tests for --seed and --rand

* Finally (re)order features/scenarios according to orderer instances

* Randomize our own test runs.

* fix test failure only present with some library versions

I could narrow it down to the exact versions of which librariess and
figure out exactly why that combination made the failure
happen. However, I can't find a compelling reason why this test
shouldn't pass in step_definitions like the others in this file, and
that change makes the test pass with the library version combos where
it previously failed, and doesn't affect it elsewhere. So, we're going
with that.

Run Details

63 of 66 new or added lines in 12 files covered. (95.45%)

2 existing lines in 2 files now uncovered.

599 of 650 relevant lines covered (92.15%)

129.19 hits per line