pantsbuild / pants / 4951
0%
main: 93%

LAST BUILD BRANCH: dk-uv-selective-sync
DEFAULT BRANCH: main
Ran
Jobs 10
Files 0
Run time 31min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
4951

push

travis-ci

jsirois 
Add support for python test sharding.

The option follows the format of the similar option in the junit-runner
and the sharding happens at the finest-grained test function/method
level.

Use this new feature to replace the target-level sharding implemented
in the ci.sh script.

Testing Done:
Locally verified the script changes with:
```console
$ CXX=g++ ./build-support/bin/ci.sh -u 0/10 -i 0/10
```

Also did a look and feel on the console for sharded vs non output.

Non-sharded:
```console
$ pants.dev test.pytest --shard=0/1 tests/python/pants_test/backend/python/tasks:
...
02:40:29 00:00     [pytest]
02:40:29 00:00       [run]
                     ============== test session starts ===============
                     platform linux2 -- Python 2.7.8 -- py-1.4.27 -- pytest-2.6.4
                     plugins: timeout, cov
                     collected 46 items

                     tests/python/pants_test/backend/python/tasks/test_setup_py.py .............
                     tests/python/pants_test/backend/python/tasks/test_pytest_run.py .............
                     tests/python/pants_test/backend/python/tasks/test_python_repl.py .......
                     tests/python/pants_test/backend/python/tasks/test_python_eval.py .............

                     ===== 46 passed, 1 warnings in 49.38 seconds =====
```

Sharded - note extra test session header lines explaining the shard:
```console
$ pants.dev test.pytest --shard=0/2 tests/python/pants_test/backend/python/tasks:
...
02:38:08 00:00     [pytest]
02:38:08 00:00       [run]
                     ============== test session starts ===============
                     platform linux2 -- Python 2.7.8 -- py-1.4.27 -- pytest-2.6.4
                     shard: 0 of 2 (0-based shard numbering)
                     plugins: timeout, cov
                     collected 46 items
                     Only executing 23 of 46 total tests in shard 0 of 2

                     tests/python/pants_test/backend/python/tasks/test_setup_py.py .......
                     tests/python/pants_test/backend/python/tasks/test_pytest_run.py ......
                     tests/python/pants_test/backend/python/tasks/test_python_repl.py ....
                     tests/python/pants_test/backend/python/tasks/test_python_eval.py ......

                     ===== 23 passed, 1 warnings in 39.47 seconds =====

$ pants.dev test.pytest --shard=1/2 tests/python/pants_test/backend/python/tasks:
...
02:39:13 00:03     [pytest]
02:39:13 00:03       [run]
                     ============== test session starts ===============
                     platform linux2 -- Python 2.7.8 -- py-1.4.27 -- pytest-2.6.4
                     shard: 1 of 2 (0-based shard numbering)
                     plugins: timeout, cov
                     collected 46 items
                     Only executing 23 of 46 total tests in shard 1 of 2

                     tests/python/pants_test/backend/python/tasks/test_setup_py.py ......
                     tests/python/pants_test/backend/python/tasks/test_pytest_run.py .......
                     tests/python/pants_test/backend/python/tasks/test_python_repl.py ...
                     tests/python/pants_test/backend/python/tasks/test_python_eval.py .......

                     ===== 23 passed, 1 warnings in 25.95 seconds =====
```

And a manual OSX CI launched with:
```console
$ cp .travis.osx.yml .travis.yml && \
  git commit -am 'Manual OSX CI.' && \
  git push -f git@github.com:pantsbuild/pants-for-travis-osx-ci.git HEAD:master && \
  git reset --hard HEAD~1
```
...went green here:
  https://travis-ci.org/pantsbuild/pants-for-travis-osx-ci/builds/63141484

Finally, linux CI went green here:
  https://travis-ci.org/pantsbuild/pants/builds/63232758

Bugs closed: 1569

Reviewed at https://rbcommons.com/s/twitter/r/2243/

13472 of 19468 relevant lines covered (69.2%)

1.3 hits per line

Jobs
ID Job ID Ran Files Coverage
1 4951.1 (CI_FLAGS="-cjlpn 'Various pants self checks'") 0
Travis Job 4951.1
2 4951.2 (CI_FLAGS="-fkmsrcn -u 0/2 'Unit tests for pants and pants-plugins - shard 1'") 0
65.03
 Travis Job 4951.2
3 4951.3 (CI_FLAGS="-fkmsrcn -u 1/2 'Unit tests for pants and pants-plugins - shard 2'") 0
65.07
 Travis Job 4951.3
4 4951.4 (CI_FLAGS="-fkmsrcjlp 'Python contrib tests'") 0
Travis Job 4951.4
5 4951.5 (CI_FLAGS="-fkmsrjlpn -i 0/6 'Python integration tests for pants - shard 1'") 0
Travis Job 4951.5
6 4951.6 (CI_FLAGS="-fkmsrjlpn -i 1/6 'Python integration tests for pants - shard 2'") 0
Travis Job 4951.6
7 4951.7 (CI_FLAGS="-fkmsrjlpn -i 2/6 'Python integration tests for pants - shard 3'") 0
Travis Job 4951.7
8 4951.8 (CI_FLAGS="-fkmsrjlpn -i 3/6 'Python integration tests for pants - shard 4'") 0
Travis Job 4951.8
9 4951.9 (CI_FLAGS="-fkmsrjlpn -i 4/6 'Python integration tests for pants - shard 5'") 0
Travis Job 4951.9
10 4951.10 (CI_FLAGS="-fkmsrjlpn -i 5/6 'Python integration tests for pants - shard 6'") 0
Travis Job 4951.10
Source Files on build 4951
Detailed source file information is not available for this build.