cross-browser-tests-runner / cross-browser-tests-runner / 196
93%

DEFAULT BRANCH: master
Ran
Jobs 171
Files 96
Run time 636min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
196

push

travis-ci

reeteshranjan 
Build error fixes and tests parallelization

Fixes:
- Fixed wrong path for linux crossbrowsertesting tunnel
- Some browser/platform combinations give error for crossbrowsertesting
- Few crossbrowsertesting functional tests broke due to conf update. Fixed.
- Testem saucelabs jasmine conf needed to be changed after conf update.
- Native runner jasmine conf needed to be changed after conf update. Also
  removed crossbrowsertesting Maxthon browser that is found to be never
  working.

Tests parallelization:
- Broke BrowserStack Platform tests into 6 - open, close, stop, status,
  job, scriptjob
- Broke SauceLabs Platform tests into 6 - open, close, stop, status,
  job, scriptjob
- Broke CrossBrowserTesting Platform tests into 6 - open, close, stop, status,
  job, scriptjob
- Broke integration tests into - core, browserstack, crossbrowsertesting,
  and saucelabs
- Broke functional tests - core, browserstack, saucelabs, crossbrowsertesting
  with separate platform-specific tests for utils and testem.
- Native runner tests have been broken into 3 - cases, retries, working
- For safety of parallel testem and native tests, the default 'parallel'
  value is set to 2 for each platform, and so is done for testem configs.
- Created new entries in package.json for each new test created
- Added new entries in .travis.yml and appveyor.yml

1003 of 1039 branches covered (96.54%)

Branch coverage included in aggregate %.

2757 of 2797 relevant lines covered (98.57%)

1865054.97 hits per line

Uncovered Existing Lines

Lines Coverage ∆ File
1
95.45
 -4.55% bin/hooks/testem/common/open.js
Jobs
ID Job ID Ran Files Coverage
1 196.1 (TEST="eslint-non-3rd-party" TYPE="unit") 57
44.22
 Travis Job 196.1
2 196.2 (TEST="core-scriptjob" TYPE="unit") 11
42.05
 Travis Job 196.2
4 196.4 (TEST="core-functional-tests" TYPE="functional") 22
65.18
 Travis Job 196.4
5 196.5 (TEST="saucelabs-tunnel" TYPE="unit") 24
81.82
 Travis Job 196.5
6 196.6 (TEST="browserstack-tunnel" TYPE="unit") 21
85.22
 Travis Job 196.6
7 196.7 (TEST="crossbrowsertesting-tunnel" TYPE="unit") 22
82.26
 Travis Job 196.7
8 196.8 (TEST="saucelabs-scriptjob" TYPE="unit") 31
57.99
 Travis Job 196.8
9 196.9 (TEST="browserstack-scriptjob" TYPE="unit") 29
58.16
 Travis Job 196.9
10 196.10 (TEST="crossbrowsertesting-scriptjob" TYPE="unit") 28
65.79
 Travis Job 196.10
11 196.11 (TEST="saucelabs-job" TYPE="unit") 24
58.68
 Travis Job 196.11
12 196.12 (TEST="browserstack-job" TYPE="unit") 20
60.26
 Travis Job 196.12
13 196.13 (TEST="crossbrowsertesting-job" TYPE="unit") 28
63.73
 Travis Job 196.13
14 196.14 (TEST="saucelabs-platform-open" TYPE="unit") 37
36.16
 Travis Job 196.14
15 196.15 (TEST="browserstack-platform-open" TYPE="unit") 35
37.06
 Travis Job 196.15
16 196.16 (TEST="crossbrowsertesting-platform-open" TYPE="unit") 36
35.06
 Travis Job 196.16
17 196.17 (TEST="saucelabs-platform-job" TYPE="unit") 37
49.55
 Travis Job 196.17
18 196.18 (TEST="browserstack-platform-job" TYPE="unit") 35
45.28
 Travis Job 196.18
19 196.19 (TEST="crossbrowsertesting-platform-job" TYPE="unit") 36
47.48
 Travis Job 196.19
20 196.20 (TEST="saucelabs-platform-scriptjob" TYPE="unit") 37
49.09
 Travis Job 196.20
21 196.21 (TEST="browserstack-platform-scriptjob" TYPE="unit") 35
46.76
 Travis Job 196.21
22 196.22 (TEST="crossbrowsertesting-platform-scriptjob" TYPE="unit") 36
50.13
 Travis Job 196.22
23 196.23 (TEST="saucelabs-platform-status" TYPE="unit") 37
64.81
 Travis Job 196.23
24 196.24 (TEST="browserstack-platform-status" TYPE="unit") 35
57.32
 Travis Job 196.24
25 196.25 (TEST="crossbrowsertesting-platform-status" TYPE="unit") 36
61.77
 Travis Job 196.25
26 196.26 (TEST="saucelabs-platform-stop" TYPE="unit") 37
54.46
 Travis Job 196.26
27 196.27 (TEST="browserstack-platform-stop" TYPE="unit") 35
54.65
 Travis Job 196.27
28 196.28 (TEST="crossbrowsertesting-platform-stop" TYPE="unit") 36
55.95
 Travis Job 196.28
29 196.29 (TEST="saucelabs-platform-close" TYPE="unit") 37
57.05
 Travis Job 196.29
30 196.30 (TEST="browserstack-platform-close" TYPE="unit") 35
57.39
 Travis Job 196.30
31 196.31 (TEST="crossbrowsertesting-platform-close" TYPE="unit") 36
59.9
 Travis Job 196.31
32 196.32 (TEST="saucelabs-integration-tests" TYPE="integration") 60
48.7
 Travis Job 196.32
33 196.33 (TEST="browserstack-integration-tests" TYPE="integration") 59
48.31
 Travis Job 196.33
34 196.34 (TEST="crossbrowsertesting-integration-tests" TYPE="integration") 59
46.77
 Travis Job 196.34
35 196.35 (TEST="utils-saucelabs-tests" TYPE="functional") 27
70.11
 Travis Job 196.35
36 196.36 (TEST="utils-browserstack-tests" TYPE="functional") 27
68.74
 Travis Job 196.36
37 196.37 (TEST="utils-crossbrowsertesting-tests" TYPE="functional") 27
72.21
 Travis Job 196.37
38 196.38 (TEST="testem-saucelabs" TYPE="functional") 45
56.97
 Travis Job 196.38
39 196.39 (TEST="testem-browserstack" TYPE="functional") 44
52.39
 Travis Job 196.39
40 196.40 (TEST="testem-crossbrowsertesting" TYPE="functional") 44
54.37
 Travis Job 196.40
41 196.41 (TEST="native-runner-cases" TYPE="functional") 74
67.26
 Travis Job 196.41
42 196.42 (TEST="native-runner-retries" TYPE="functional") 65
64.79
 Travis Job 196.42
43 196.43 (TEST="native-runner-working" TYPE="functional") 74
67.83
 Travis Job 196.43
44 196.44 (TEST="eslint-non-3rd-party" TYPE="unit") 57
44.18
 Travis Job 196.44
45 196.45 (TEST="core-scriptjob" TYPE="unit") 11
21.02
 Travis Job 196.45
46 196.46 (TEST="core-integration-tests" TYPE="integration") 27
26.92
 Travis Job 196.46
47 196.47 (TEST="core-functional-tests" TYPE="functional") 22
65.18
 Travis Job 196.47
48 196.48 (TEST="saucelabs-tunnel" TYPE="unit") 24
82.81
 Travis Job 196.48
49 196.49 (TEST="browserstack-tunnel" TYPE="unit") 21
85.22
 Travis Job 196.49
50 196.50 (TEST="crossbrowsertesting-tunnel" TYPE="unit") 22
82.26
 Travis Job 196.50
51 196.51 (TEST="saucelabs-scriptjob" TYPE="unit") 31
15.9
 Travis Job 196.51
52 196.52 (TEST="browserstack-scriptjob" TYPE="unit") 29
15.63
 Travis Job 196.52
53 196.53 (TEST="crossbrowsertesting-scriptjob" TYPE="unit") 28
15.84
 Travis Job 196.53
54 196.54 (TEST="saucelabs-job" TYPE="unit") 24
17.0
 Travis Job 196.54
55 196.55 (TEST="browserstack-job" TYPE="unit") 20
60.26
 Travis Job 196.55
56 196.56 (TEST="crossbrowsertesting-job" TYPE="unit") 28
63.73
 Travis Job 196.56
57 196.57 (TEST="saucelabs-platform-open" TYPE="unit") 37
37.32
 Travis Job 196.57
58 196.58 (TEST="browserstack-platform-open" TYPE="unit") 35
36.99
 Travis Job 196.58
59 196.59 (TEST="crossbrowsertesting-platform-open" TYPE="unit") 36
34.99
 Travis Job 196.59
60 196.60 (TEST="saucelabs-platform-job" TYPE="unit") 37
13.84
 Travis Job 196.60
61 196.61 (TEST="browserstack-platform-job" TYPE="unit") 35
45.22
 Travis Job 196.61
62 196.62 (TEST="crossbrowsertesting-platform-job" TYPE="unit") 36
47.41
 Travis Job 196.62
63 196.63 (TEST="saucelabs-platform-scriptjob" TYPE="unit") 37
13.84
 Travis Job 196.63
64 196.64 (TEST="browserstack-platform-scriptjob" TYPE="unit") 35
13.44
 Travis Job 196.64
65 196.65 (TEST="crossbrowsertesting-platform-scriptjob" TYPE="unit") 36
13.84
 Travis Job 196.65
66 196.66 (TEST="saucelabs-platform-status" TYPE="unit") 37
15.2
 Travis Job 196.66
67 196.67 (TEST="browserstack-platform-status" TYPE="unit") 35
50.1
 Travis Job 196.67
68 196.68 (TEST="crossbrowsertesting-platform-status" TYPE="unit") 36
52.91
 Travis Job 196.68
69 196.69 (TEST="saucelabs-platform-stop" TYPE="unit") 37
15.01
 Travis Job 196.69
70 196.70 (TEST="browserstack-platform-stop" TYPE="unit") 35
48.16
 Travis Job 196.70
71 196.71 (TEST="crossbrowsertesting-platform-stop" TYPE="unit") 36
46.25
 Travis Job 196.71
72 196.72 (TEST="saucelabs-platform-close" TYPE="unit") 37
15.33
 Travis Job 196.72
73 196.73 (TEST="browserstack-platform-close" TYPE="unit") 35
48.76
 Travis Job 196.73
74 196.74 (TEST="crossbrowsertesting-platform-close" TYPE="unit") 36
51.42
 Travis Job 196.74
75 196.75 (TEST="saucelabs-integration-tests" TYPE="integration") 60
38.46
 Travis Job 196.75
76 196.76 (TEST="browserstack-integration-tests" TYPE="integration") 59
48.27
 Travis Job 196.76
77 196.77 (TEST="crossbrowsertesting-integration-tests" TYPE="integration") 59
46.73
 Travis Job 196.77
78 196.78 (TEST="utils-saucelabs-tests" TYPE="functional") 27
70.11
 Travis Job 196.78
79 196.79 (TEST="utils-browserstack-tests" TYPE="functional") 27
68.74
 Travis Job 196.79
80 196.80 (TEST="utils-crossbrowsertesting-tests" TYPE="functional") 27
70.69
 Travis Job 196.80
81 196.81 (TEST="testem-saucelabs" TYPE="functional") 45
51.48
 Travis Job 196.81
82 196.82 (TEST="testem-browserstack" TYPE="functional") 44
52.33
 Travis Job 196.82
83 196.83 (TEST="testem-crossbrowsertesting" TYPE="functional") 44
54.31
 Travis Job 196.83
84 196.84 (TEST="native-runner-cases" TYPE="functional") 74
62.19
 Travis Job 196.84
85 196.85 (TEST="native-runner-retries" TYPE="functional") 65
61.53
 Travis Job 196.85
86 196.86 (TEST="native-runner-working" TYPE="functional") 64
62.43
 Travis Job 196.86
87 196.87 (TEST="eslint-non-3rd-party" TYPE="unit") 57
44.18
 Travis Job 196.87
88 196.88 (TEST="core-scriptjob" TYPE="unit") 11
42.05
 Travis Job 196.88
89 196.89 (TEST="core-integration-tests" TYPE="integration") 27
26.92
 Travis Job 196.89
90 196.90 (TEST="core-functional-tests" TYPE="functional") 22
65.18
 Travis Job 196.90
91 196.91 (TEST="saucelabs-tunnel" TYPE="unit") 24
81.32
 Travis Job 196.91
92 196.92 (TEST="browserstack-tunnel" TYPE="unit") 21
85.22
 Travis Job 196.92
93 196.93 (TEST="crossbrowsertesting-tunnel" TYPE="unit") 22
82.06
 Travis Job 196.93
94 196.94 (TEST="saucelabs-scriptjob" TYPE="unit") 31
57.82
 Travis Job 196.94
95 196.95 (TEST="browserstack-scriptjob" TYPE="unit") 29
58.16
 Travis Job 196.95
96 196.96 (TEST="crossbrowsertesting-scriptjob" TYPE="unit") 28
65.69
 Travis Job 196.96
97 196.97 (TEST="saucelabs-job" TYPE="unit") 24
58.56
 Travis Job 196.97
98 196.98 (TEST="browserstack-job" TYPE="unit") 20
60.26
 Travis Job 196.98
99 196.99 (TEST="crossbrowsertesting-job" TYPE="unit") 28
63.63
 Travis Job 196.99
100 196.100 (TEST="saucelabs-platform-open" TYPE="unit") 37
36.03
 Travis Job 196.100
101 196.101 (TEST="browserstack-platform-open" TYPE="unit") 35
37.06
 Travis Job 196.101
102 196.102 (TEST="crossbrowsertesting-platform-open" TYPE="unit") 36
34.99
 Travis Job 196.102
103 196.103 (TEST="saucelabs-platform-job" TYPE="unit") 37
49.35
 Travis Job 196.103
104 196.104 (TEST="browserstack-platform-job" TYPE="unit") 35
45.28
 Travis Job 196.104
105 196.105 (TEST="crossbrowsertesting-platform-job" TYPE="unit") 36
47.41
 Travis Job 196.105
106 196.106 (TEST="saucelabs-platform-scriptjob" TYPE="unit") 37
48.9
 Travis Job 196.106
107 196.107 (TEST="browserstack-platform-scriptjob" TYPE="unit") 35
46.76
 Travis Job 196.107
108 196.108 (TEST="crossbrowsertesting-platform-scriptjob" TYPE="unit") 36
50.06
 Travis Job 196.108
109 196.109 (TEST="saucelabs-platform-status" TYPE="unit") 37
64.62
 Travis Job 196.109
110 196.110 (TEST="browserstack-platform-status" TYPE="unit") 35
57.66
 Travis Job 196.110
111 196.111 (TEST="crossbrowsertesting-platform-status" TYPE="unit") 36
61.58
 Travis Job 196.111
112 196.112 (TEST="saucelabs-platform-stop" TYPE="unit") 37
54.27
 Travis Job 196.112
113 196.113 (TEST="browserstack-platform-stop" TYPE="unit") 35
54.52
 Travis Job 196.113
114 196.114 (TEST="crossbrowsertesting-platform-stop" TYPE="unit") 36
55.89
 Travis Job 196.114
115 196.115 (TEST="saucelabs-platform-close" TYPE="unit") 37
56.86
 Travis Job 196.115
116 196.116 (TEST="browserstack-platform-close" TYPE="unit") 35
57.39
 Travis Job 196.116
117 196.117 (TEST="crossbrowsertesting-platform-close" TYPE="unit") 36
59.83
 Travis Job 196.117
118 196.118 (TEST="saucelabs-integration-tests" TYPE="integration") 60
48.57
 Travis Job 196.118
119 196.119 (TEST="browserstack-integration-tests" TYPE="integration") 59
48.4
 Travis Job 196.119
120 196.120 (TEST="crossbrowsertesting-integration-tests" TYPE="integration") 59
46.73
 Travis Job 196.120
121 196.121 (TEST="utils-saucelabs-tests" TYPE="functional") 27
70.11
 Travis Job 196.121
122 196.122 (TEST="utils-browserstack-tests" TYPE="functional") 27
68.74
 Travis Job 196.122
123 196.123 (TEST="utils-crossbrowsertesting-tests" TYPE="functional") 27
72.21
 Travis Job 196.123
124 196.124 (TEST="testem-saucelabs" TYPE="functional") 45
56.38
 Travis Job 196.124
125 196.125 (TEST="testem-browserstack" TYPE="functional") 44
52.39
 Travis Job 196.125
126 196.126 (TEST="testem-crossbrowsertesting" TYPE="functional") 44
54.31
 Travis Job 196.126
127 196.127 (TEST="native-runner-cases" TYPE="functional") 74
68.29
 Travis Job 196.127
128 196.128 (TEST="native-runner-retries" TYPE="functional") 65
65.02
 Travis Job 196.128
129 196.129 (TEST="native-runner-working" TYPE="functional") 74
69.29
 Travis Job 196.129
130 196.130 (TEST="eslint-non-3rd-party" TYPE="unit") 57
44.14
 Travis Job 196.130
131 196.131 (TEST="core-scriptjob" TYPE="unit") 11
21.02
 Travis Job 196.131
132 196.132 (TEST="core-integration-tests" TYPE="integration") 27
26.92
 Travis Job 196.132
133 196.133 (TEST="core-functional-tests" TYPE="functional") 22
65.18
 Travis Job 196.133
134 196.134 (TEST="saucelabs-tunnel" TYPE="unit") 24
82.31
 Travis Job 196.134
135 196.135 (TEST="browserstack-tunnel" TYPE="unit") 21
85.22
 Travis Job 196.135
136 196.136 (TEST="crossbrowsertesting-tunnel" TYPE="unit") 22
82.06
 Travis Job 196.136
137 196.137 (TEST="saucelabs-scriptjob" TYPE="unit") 31
15.81
 Travis Job 196.137
138 196.138 (TEST="browserstack-scriptjob" TYPE="unit") 29
15.63
 Travis Job 196.138
139 196.139 (TEST="crossbrowsertesting-scriptjob" TYPE="unit") 28
15.74
 Travis Job 196.139
140 196.140 (TEST="saucelabs-job" TYPE="unit") 24
16.87
 Travis Job 196.140
141 196.141 (TEST="browserstack-job" TYPE="unit") 20
60.26
 Travis Job 196.141
142 196.142 (TEST="crossbrowsertesting-job" TYPE="unit") 28
63.63
 Travis Job 196.142
143 196.143 (TEST="saucelabs-platform-open" TYPE="unit") 37
37.26
 Travis Job 196.143
144 196.144 (TEST="browserstack-platform-open" TYPE="unit") 35
36.99
 Travis Job 196.144
145 196.145 (TEST="crossbrowsertesting-platform-open" TYPE="unit") 36
35.12
 Travis Job 196.145
146 196.146 (TEST="saucelabs-platform-job" TYPE="unit") 37
13.78
 Travis Job 196.146
147 196.147 (TEST="browserstack-platform-job" TYPE="unit") 35
45.22
 Travis Job 196.147
148 196.148 (TEST="crossbrowsertesting-platform-job" TYPE="unit") 36
47.35
 Travis Job 196.148
149 196.149 (TEST="saucelabs-platform-scriptjob" TYPE="unit") 37
13.78
 Travis Job 196.149
150 196.150 (TEST="browserstack-platform-scriptjob" TYPE="unit") 35
13.44
 Travis Job 196.150
151 196.151 (TEST="crossbrowsertesting-platform-scriptjob" TYPE="unit") 36
13.78
 Travis Job 196.151
152 196.152 (TEST="saucelabs-platform-status" TYPE="unit") 37
15.14
 Travis Job 196.152
153 196.153 (TEST="browserstack-platform-status" TYPE="unit") 35
50.1
 Travis Job 196.153
154 196.154 (TEST="crossbrowsertesting-platform-status" TYPE="unit") 36
52.85
 Travis Job 196.154
155 196.155 (TEST="saucelabs-platform-stop" TYPE="unit") 37
14.94
 Travis Job 196.155
156 196.156 (TEST="browserstack-platform-stop" TYPE="unit") 35
48.16
 Travis Job 196.156
157 196.157 (TEST="crossbrowsertesting-platform-stop" TYPE="unit") 36
46.18
 Travis Job 196.157
158 196.158 (TEST="saucelabs-platform-close" TYPE="unit") 37
15.27
 Travis Job 196.158
159 196.159 (TEST="browserstack-platform-close" TYPE="unit") 35
48.76
 Travis Job 196.159
160 196.160 (TEST="crossbrowsertesting-platform-close" TYPE="unit") 36
51.36
 Travis Job 196.160
161 196.161 (TEST="saucelabs-integration-tests" TYPE="integration") 60
38.34
 Travis Job 196.161
162 196.162 (TEST="browserstack-integration-tests" TYPE="integration") 59
48.27
 Travis Job 196.162
163 196.163 (TEST="crossbrowsertesting-integration-tests" TYPE="integration") 59
46.69
 Travis Job 196.163
164 196.164 (TEST="utils-saucelabs-tests" TYPE="functional") 27
70.11
 Travis Job 196.164
165 196.165 (TEST="utils-browserstack-tests" TYPE="functional") 27
68.74
 Travis Job 196.165
166 196.166 (TEST="utils-crossbrowsertesting-tests" TYPE="functional") 27
70.69
 Travis Job 196.166
167 196.167 (TEST="testem-saucelabs" TYPE="functional") 45
51.3
 Travis Job 196.167
168 196.168 (TEST="testem-browserstack" TYPE="functional") 44
52.33
 Travis Job 196.168
169 196.169 (TEST="testem-crossbrowsertesting" TYPE="functional") 44
54.25
 Travis Job 196.169
170 196.170 (TEST="native-runner-cases" TYPE="functional") 74
62.09
 Travis Job 196.170
171 196.171 (TEST="native-runner-retries" TYPE="functional") 65
61.45
 Travis Job 196.171
172 196.172 (TEST="native-runner-working" TYPE="functional") 64
61.87
 Travis Job 196.172
Source Files on build 196
Coverage ∆ File Lines Relevant Covered Missed Hits/Line Branch Hits Branch Misses