• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

pantsbuild / pants / 5659
72%
main: 93%

Build:
Build:
LAST BUILD BRANCH: csb/pex-v2.91.2
DEFAULT BRANCH: main
Ran 16 Jul 2015 05:14PM UTC
Jobs 10
Files 336
Run time 11min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

pending completion
5659

push

travis-ci

Stu Hood
[group_task][jvm] Precompute compile contexts for all targets

PROBLEM:
Zinc learns about analysis files when they are passed in analysis-map argument. We always supply the analysis files for all targets in the build graph every time we invoke Zinc. The problem is that the paths to the analysis- and class files are computed separately by ScalaCompile and JavaZincCompile. This happens in compile_context() for isolated strategy, where a path is computed by concatenating target.id to the task's workdir. Basically compile_context() is only suitable for computing the context for the task's own targets, but we're (ab)using it for all targets in the build graph, when computing the value for analysis-map argument. This means some of the paths are incorrect and non-existent: e.g. path to java target analysis is computed by ScalaCompile as compile/jvm/scala/isolated-analysis/storage.clients.manhattan.client.src.main.java.java, while it should be compile/jvm/zinc-java/isolated-analysis/storage.clients.manhattan.client.src.main.java.java. Such incorrect paths are not matched with classpath entries in _upstream_analysis(), and therefore the corresponding analysis files are not included in the analysis-map argument. This causes Zinc to consider cross-language dependencies as binary dependencies and compare timestamps, which is suboptimal.

SOLUTION:
Compute the paths to analysis files more intelligently. The CompileContexts are computed in prepare_compile() (for both strategies) and saved in a global (target -> compile_context) map belonging to GroupTask. Then in compile_chunk(), this global map is used instead of calling _create_compile_contexts_for_targets(). This also possibly solves the boundary between tasks using global strategy (I believe they all map to same analysis and classdir) and the ones using isolated strategy.

DOWNSIDE:
GroupTask is now aware of the fact that it's in fact a compilation task, as does GroupMember. This was bound to happen anyway sinc... (continued)

17 of 17 new or added lines in 5 files covered. (100.0%)

14192 of 20107 relevant lines covered (70.58%)

1.33 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
1
100.0
src/python/pants/backend/jvm/tasks/jvm_compile/jvm_compile_global_strategy.py
1
100.0
src/python/pants/backend/jvm/tasks/jvm_compile/jvm_compile_isolated_strategy.py
4
100.0
src/python/pants/backend/jvm/tasks/jvm_compile/jvm_compile_strategy.py

Uncovered Existing Lines

Lines Coverage ∆ File
1
100.0
src/python/pants/backend/python/python_chroot.py
1
100.0
src/python/pants/base/generator.py
2
100.0
src/python/pants/backend/jvm/tasks/jar_create.py
5
100.0
src/python/pants/backend/python/tasks/python_task.py
14
100.0
src/python/pants/option/options.py
16
100.0
src/python/pants/goal/context.py
17
100.0
src/python/pants/base/cache_manager.py
20
100.0
src/python/pants/option/parser.py
22
100.0
src/python/pants/backend/core/tasks/task.py
31
100.0
src/python/pants/backend/codegen/tasks/protobuf_gen.py
33
100.0
src/python/pants/reporting/reporting.py
36
100.0
src/python/pants/backend/jvm/tasks/jvm_compile/jvm_compile_strategy.py
38
100.0
src/python/pants/backend/jvm/tasks/jvm_compile/jvm_compile.py
67
100.0
src/python/pants/backend/jvm/tasks/jvm_compile/jvm_compile_isolated_strategy.py
Jobs
ID Job ID Ran Files Coverage
1 5659.1 (CI_FLAGS="-cjlpn 'Various pants self checks'") 16 Jul 2015 05:14PM UTC 0
Travis Job 5659.1
2 5659.2 (CI_FLAGS="-fkmsrcn -u 0/2 'Unit tests for pants and pants-plugins - shard 1'") 16 Jul 2015 05:16PM UTC 0
67.01
Travis Job 5659.2
3 5659.3 (CI_FLAGS="-fkmsrcn -u 1/2 'Unit tests for pants and pants-plugins - shard 2'") 16 Jul 2015 05:19PM UTC 0
66.16
Travis Job 5659.3
4 5659.4 (CI_FLAGS="-fkmsrcjlp 'Python contrib tests'") 16 Jul 2015 05:19PM UTC 0
Travis Job 5659.4
5 5659.5 (CI_FLAGS="-fkmsrjlpn -i 0/6 'Python integration tests for pants - shard 1'") 16 Jul 2015 05:21PM UTC 0
Travis Job 5659.5
6 5659.6 (CI_FLAGS="-fkmsrjlpn -i 1/6 'Python integration tests for pants - shard 2'") 16 Jul 2015 05:22PM UTC 0
Travis Job 5659.6
7 5659.7 (CI_FLAGS="-fkmsrjlpn -i 2/6 'Python integration tests for pants - shard 3'") 16 Jul 2015 05:23PM UTC 0
Travis Job 5659.7
8 5659.8 (CI_FLAGS="-fkmsrjlpn -i 3/6 'Python integration tests for pants - shard 4'") 16 Jul 2015 05:24PM UTC 0
Travis Job 5659.8
9 5659.9 (CI_FLAGS="-fkmsrjlpn -i 4/6 'Python integration tests for pants - shard 5'") 16 Jul 2015 05:24PM UTC 0
Travis Job 5659.9
10 5659.10 (CI_FLAGS="-fkmsrjlpn -i 5/6 'Python integration tests for pants - shard 6'") 16 Jul 2015 05:25PM UTC 0
Travis Job 5659.10
Source Files on build 5659
Detailed source file information is not available for this build.
  • Back to Repo
  • Travis Build #5659
  • e37d8d77 on github
  • Prev Build on twitter/pants-1.2.4 (#5623)
  • Next Build on twitter/pants-1.2.4 (#5717)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc