alphagov / accessible-autocomplete / 1386

90%

master: 90%

push

travis-ci-com

Disable test with Internet Explorer 9

I cannot get IE9 to work on Sauce Labs. I think this is due to an issue
in their stack. Disabling for now, maybe at a future date Sauce Labs
will fix the issue, or someone else will find a workaround.

Detailed notes follow:

Sauce Labs adds the capability `selenium:webdriver.remote.quietExceptions`
to the session for IE9 (but not IE10). This capability is not recognised
by IE, and something in the Sauce Labs stack complains about this. See
the [test logs from Sauce Labs] for more details about this.

I believe this is related to this [issue in IEDriverServer], but I could
be wrong. It's also not clear to me why Sauce Labs is adding this
capability for IE9 but not IE10, so Sauce Labs may change that behaviour
at some point.

As to why IE9 was working with WebdriverIO v4, I believe this is because
Sauce Labs uses a different (legacy) stack in some circumstances.
I think if the client uses the JSON Wire Protocol, which WebdriverIO v4
does, instead of the W3C Webdriver protocol. I couldn't find a way to
use the legacy protocol in WebdriverIO v6.

I also tried downgrading the version of Selenium used by Sauce Labs by
setting ['sauce:options']['seleniumVersion'], however that failed
because it expects the older JSON Wire Protocl, and although the commands
WebdriverIO v6 are backwards compatible with JSON Wire Protocol, when
using the newer W3C stack SauceLabs strips out the JSON Wire Protocol
`desiredCapabilties' key that Selenium v2 requires.

For information about why Sauce Labs is adding this capability to the
session, see the [Sauce Labs test configuration options documentation].
I'm not sure that this documentation is up to date though; for instance,
it doesn't cover how to make your capabilities W3C compatible, and
includes information about the Selenium version which doesn't seem to be
followed any more.

[test logs from Sauce Labs]: https://app.saucelabs.com/tests/4a28429a66ee4db7bf159fc43fdd4db3#0
[issue in I... (continued)

191 of 242 branches covered (78.93%)

240 of 266 relevant lines covered (90.23%)

61.67 hits per line