4615
0%
main: 93%

Ran 25 Apr 2015 12:00AM UTC

Jobs 10

Files 324

Run time 12min

Badge

Embed ▾

pending completion

Build # 4615

Build Type

push

travis-ci

Committed by

baroquebobcat

Commit Message

Parallelize isolated jvm compile strategy's chunk execution.

Instead of applying compiles in topological sorted order, schedule each compilation unit as part of an execution graph, then
run through the graph submitting each piece of work as its dependencies have successfully finished.

I've introduced an abstraction, ExecutionGraph, around scheduling and executing a graph of dependent jobs. I did this instead of just introducing a WorkPool inside compile_chunk. I think being able to generalize parallelizing dependent work will be valuable in other places. I wanted to prepare for being able to do that in other places without having to re-cut abstraction boundaries later.

Testing Done:
CI passing at https://travis-ci.org/pantsbuild/pants/builds/59897269

Ran successfully on internal target graphs with interleaved java / scala dependencies, as well as ones with multiple targets per chunk.

Bugs closed: 1443

Reviewed at https://rbcommons.com/s/twitter/r/2109/

Coverage Stats

13317 of 19087 relevant lines covered (69.77%)

0.7 hits per line

Jobs

ID	Job ID	Ran	Coverage
1	4615.1 (CI_FLAGS="-cjlpnet 'Various pants self checks'")	25 Apr 2015 12:01AM UTC		Travis Job 4615.1
2	4615.2 (CI_FLAGS="-fkmsrcjlpn 'Test examples and testprojects'")	25 Apr 2015 12:00AM UTC		Travis Job 4615.2
3	4615.3 (CI_FLAGS="-fkmsrcnet 'Unit tests for pants and pants-plugins'")	25 Apr 2015 12:02AM UTC	69.77	Travis Job 4615.3
4	4615.4 (CI_FLAGS="-fkmsrcjlpet 'Python contrib tests'")	25 Apr 2015 12:00AM UTC		Travis Job 4615.4
5	4615.5 (CI_FLAGS="-fkmsrjlpnet -i 6:0 'Python integration tests for pants - shard 1'")	25 Apr 2015 12:01AM UTC		Travis Job 4615.5
6	4615.6 (CI_FLAGS="-fkmsrjlpnet -i 6:1 'Python integration tests for pants - shard 2'")	25 Apr 2015 12:12AM UTC		Travis Job 4615.6
7	4615.7 (CI_FLAGS="-fkmsrjlpnet -i 6:2 'Python integration tests for pants - shard 3'")	25 Apr 2015 12:08AM UTC		Travis Job 4615.7
8	4615.8 (CI_FLAGS="-fkmsrjlpnet -i 6:3 'Python integration tests for pants - shard 4'")	25 Apr 2015 12:08AM UTC		Travis Job 4615.8
9	4615.9 (CI_FLAGS="-fkmsrjlpnet -i 6:4 'Python integration tests for pants - shard 5'")	25 Apr 2015 12:08AM UTC		Travis Job 4615.9
10	4615.10 (CI_FLAGS="-fkmsrjlpnet -i 6:5 'Python integration tests for pants - shard 6'")	25 Apr 2015 12:08AM UTC		Travis Job 4615.10

Source Files on build 4615

Detailed source file information is not available for this build.

pantsbuild / pants / 4615
0%
main: 93%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 4615

pantsbuild / pants / 4615 0% main: 93%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 4615

pantsbuild / pants / 4615
0%
main: 93%

README BADGES
x