29261418526
93%

Ran 13 Jul 2026 03:33PM UTC

Jobs 8

Files 1602

Run time 4min

Badge

Embed ▾

Committed 13 Jul 2026 03:14PM UTC coverage: 87.044% (-5.9%) from 92.971%

Build # 29261418526

Build Type

push

github

Committed by

web-flow

Commit Message

split invalidate_randomly into two deterministic tests (#23280)

This test was identified as flaky in 2020 and went through a prior
re-enable/backout dance. On my workstation with no load I can run it
1000 times without error. Under artificial cpu load (nice + dummy procs)
it fails ~20% of the time. So I think this is a straightforward timing
based assertion problem.

To "fix" this, the test is broken out into two smaller tests:
 * An assertion on small deterministic inputs.
 * Liveness under random invalidation.

I think the ideal fix would be some sort of fuzz or property based
testing system. But since once hasn't been adopted already and this test
has hung out for six years, I think this is a positive incremental move
forward.

closes #10839

Notice: A LLM both did the "run the tests a bunch scripting" and
generated the final code. I made the call on splitting versus futzing
with timeouts or high scope logical clock changes.

Coverage Stats

76293 of 87649 relevant lines covered (87.04%)

3.06 hits per line

Coverage Regressions

Lines	Coverage	∆	File
176	0.0	-98.88%	src/python/pants/backend/typescript/goals/check.py
173	0.0	-92.51%	src/python/pants/backend/codegen/protobuf/go/rules.py
160	0.0	-96.97%	src/python/pants/backend/go/goals/generate.py
133	63.92	-26.08%	src/python/pants/core/goals/test.py
128	58.87	-36.06%	src/python/pants/backend/python/util_rules/pex_requirements.py
115	0.0	-99.14%	src/python/pants/backend/codegen/protobuf/scala/rules.py
102	67.16	-30.18%	src/python/pants/backend/docker/goals/package_image.py
95	38.01	-55.56%	src/python/pants/vcs/git.py
94	0.0	-97.92%	src/python/pants/backend/helm/test/unittest.py
84	44.68	-44.68%	src/python/pants/backend/python/goals/lockfile.py
74	65.99	-21.51%	src/python/pants/bsp/util_rules/targets.py
66	43.8	-54.55%	src/python/pants/backend/python/goals/coverage_py_integration_test.py
66	89.18	-6.61%	src/python/pants/engine/target.py
66	44.52	-45.21%	src/python/pants/jvm/bsp/dependencies.py
65	0.0	-98.48%	src/python/pants/backend/k8s/goals/deploy.py
64	0.0	-91.43%	src/python/pants/backend/helm/dependency_inference/unittest.py
60	0.0	-96.77%	src/python/pants/backend/python/framework/django/dependency_inference.py
60	0.0	-96.77%	src/python/pants/backend/python/framework/django/detect_apps.py
60	0.0	-82.19%	src/python/pants/backend/python/util_rules/vcs_versioning.py
56	0.0	-94.92%	src/python/pants/backend/helm/goals/tailor.py
54	0.0	-100.0%	src/python/pants/backend/codegen/thrift/apache/java/rules.py
51	49.5	-50.5%	src/python/pants/backend/python/providers/python_build_standalone/rules_integration_test.py
51	64.53	-29.65%	src/python/pants/backend/scala/bsp/rules.py
50	0.0	-98.04%	src/python/pants/backend/helm/goals/publish.py
49	45.56	-54.44%	src/python/pants/backend/makeself/goals/package_run_integration_test.py
48	0.0	-77.42%	src/python/pants/backend/nfpm/native_libs/elfdeps/analyze.py
48	49.04	-46.15%	src/python/pants/engine/composite_process.py
47	0.0	-100.0%	src/python/pants/backend/javascript/goals/lockfile.py
45	85.31	-11.6%	src/python/pants/backend/python/util_rules/package_dists.py
42	0.0	-100.0%	src/python/pants/backend/codegen/protobuf/scala/dependency_inference.py
41	0.0	-91.11%	src/python/pants/backend/codegen/protobuf/lint/buf/format_rules.py
41	45.18	-24.7%	src/python/pants/backend/project_info/regex_lint.py
41	56.84	-43.16%	src/python/pants/backend/sql/lint/sqlfluff/rules_integration_test.py
40	42.86	-47.62%	src/python/pants/bsp/protocol.py
39	62.28	-34.21%	src/python/pants/bsp/spec/lifecycle.py
38	79.38	-13.06%	src/python/pants/backend/go/goals/test.py
38	0.0	-100.0%	src/python/pants/backend/python/providers/pyenv/custom_install/rules.py
38	57.3	-42.7%	src/python/pants/base/deprecated.py
38	54.46	-37.62%	src/python/pants/init/extension_loader.py
37	82.14	-13.21%	src/python/pants/backend/python/util_rules/pex_from_targets.py
37	57.45	-39.36%	src/python/pants/backend/python/util_rules/uv.py
37	85.25	-5.46%	src/python/pants/core/util_rules/system_binaries.py
36	55.56	-44.44%	src/python/pants/backend/helm/check/kubeconform/deployment_test.py
36	0.0	-100.0%	src/python/pants/backend/kotlin/goals/tailor.py
31	56.94	-43.06%	src/python/pants/backend/docker/lint/hadolint/rules_integration_test.py
31	84.56	-11.97%	src/python/pants/engine/internals/build_files.py
30	54.31	-12.93%	src/python/pants/backend/python/goals/coverage_py.py
29	0.0	-100.0%	src/python/pants/backend/swift/goals/tailor.py
29	54.67	-38.67%	src/python/pants/bsp/spec/task.py
29	28.89	-64.44%	src/python/pants/pantsd/service/store_gc_service.py
28	67.44	-32.56%	src/python/pants/backend/codegen/protobuf/python/rules_integration_test.py
27	53.73	-40.3%	src/python/pants/backend/observability/opentelemetry/single_threaded_processor.py
26	57.58	-39.39%	src/python/pants/bsp/util_rules/compile.py
26	80.18	-11.45%	src/python/pants/engine/internals/buildbarn_integration_tests/stack.py
25	60.32	-39.68%	src/python/pants/backend/python/lint/docformatter/rules_integration_test.py
24	0.0	-96.0%	src/python/pants/backend/codegen/protobuf/scala/subsystem.py
24	61.29	-38.71%	src/python/pants/backend/shell/lint/shfmt/rules_integration_test.py
24	71.86	-14.37%	src/python/pants/ng/subsystem.py
24	73.58	-15.09%	src/python/pants/option/registrar.py
23	89.41	-9.75%	src/python/pants/backend/docker/target_types.py
23	69.05	-27.38%	src/python/pants/backend/docker/util_rules/docker_binary.py
23	0.0	-100.0%	src/python/pants/backend/k8s/kubectl_subsystem.py
23	0.0	-100.0%	src/python/pants/backend/python/packaging/pyoxidizer/config.py
23	84.12	-9.87%	src/python/pants/backend/python/providers/python_build_standalone/rules.py
23	0.0	-100.0%	src/python/pants/backend/swift/target_types.py
23	61.04	-29.87%	src/python/pants/ng/source_partition.py
22	90.93	-5.54%	src/python/pants/backend/go/util_rules/build_pkg.py
22	0.0	-100.0%	src/python/pants/backend/jsx/goals/tailor.py
22	75.73	-21.36%	src/python/pants/core/subsystems/python_bootstrap.py
21	81.21	-14.09%	src/python/pants/backend/helm/utils/yaml.py
21	50.0	-47.73%	src/python/pants/backend/shell/goals/tailor.py
21	0.0	-100.0%	src/python/pants/backend/typescript/subsystem.py
21	82.4	-7.87%	src/python/pants/engine/internals/scheduler.py
20	64.29	-35.71%	src/python/pants/backend/build_files/fmt/black/integration_test.py
20	66.1	-33.9%	src/python/pants/backend/python/lint/autoflake/rules_integration_test.py
20	68.25	-31.75%	src/python/pants/backend/python/lint/yapf/rules_integration_test.py
20	89.58	-6.94%	src/python/pants/engine/internals/parser.py
19	52.27	-43.18%	src/python/pants/backend/codegen/export_codegen_goal.py
19	93.38	-3.49%	src/python/pants/backend/python/util_rules/pex.py
19	74.77	-17.12%	src/python/pants/bsp/spec/targets.py
19	62.0	-38.0%	src/python/pants/bsp/util_rules/resources.py
19	77.02	-11.8%	src/python/pants/option/options.py
18	87.3	-7.38%	src/python/pants/backend/python/dependency_inference/rules.py
18	58.46	-27.69%	src/python/pants/bsp/spec/compile.py
18	85.51	-6.36%	src/python/pants/core/goals/generate_lockfiles.py
17	74.39	-20.73%	src/python/pants/bsp/spec/base.py
17	79.01	-20.99%	src/python/pants/engine/internals/defaults.py
17	68.33	-28.33%	src/python/pants/jvm/bsp/compile.py
17	68.12	-24.64%	src/python/pants/util/value_interpolation.py
16	73.02	-25.4%	src/python/pants/backend/terraform/goals/lockfiles.py
15	64.58	-31.25%	pants-plugins/pants_explorer/server/graphql/query/rules.py
15	77.14	-21.43%	src/python/pants/backend/python/goals/repl.py
15	57.89	-39.47%	src/python/pants/backend/python/providers/python_build_standalone/constraints.py
15	57.14	-35.71%	src/python/pants/bsp/util_rules/lifecycle.py
15	85.37	-12.2%	src/python/pants/core/goals/package.py
14	0.0	-100.0%	src/python/pants/backend/codegen/protobuf/scala/symbol_mapper.py
14	0.0	-100.0%	src/python/pants/backend/k8s/k8s_subsystem.py
14	72.0	-28.0%	src/python/pants/backend/project_info/count_loc_test.py
14	0.0	-100.0%	src/python/pants/backend/python/subsystems/setuptools_scm.py
14	79.41	-20.59%	src/python/pants/backend/python/util_rules/pex_test_utils.py
14	42.5	-35.0%	src/python/pants/bsp/context.py
13	0.0	-100.0%	src/python/pants/backend/codegen/thrift/apache/java/symbol_mapper.py
13	75.44	-22.81%	src/python/pants/backend/python/subsystems/uv.py
12	74.6	-19.05%	src/python/pants/backend/helm/resolve/remotes.py
12	77.78	-19.05%	src/python/pants/core/util_rules/wrap_source.py
12	24.0	-48.0%	src/python/pants/init/util.py
12	83.33	-12.5%	src/python/pants/jvm/goals/lockfile.py
11	0.0	-100.0%	src/python/pants/backend/codegen/thrift/apache/java/subsystem.py
11	84.85	-8.33%	src/python/pants/backend/javascript/goals/test.py
11	88.26	-5.16%	src/python/pants/base/specs.py
11	22.22	-61.11%	src/python/pants/bsp/utils.py
11	91.47	-3.75%	src/python/pants/jvm/resolve/coursier_fetch.py
11	82.8	-7.01%	src/python/pants/option/native_options.py
11	56.0	-44.0%	src/python/pants/option/options_diff.py
11	91.14	-3.48%	src/python/pants/testutil/rule_runner.py
11	40.0	-36.67%	src/python/pants/util/eval.py
10	94.09	-4.22%	src/python/pants/backend/javascript/subsystems/nodejs.py
10	0.0	-100.0%	src/python/pants/backend/python/providers/pyenv/custom_install/target_types.py
10	68.85	-8.2%	src/python/pants/backend/scala/bsp/spec.py
10	76.47	-19.61%	src/python/pants/build_graph/build_file_aliases.py
10	78.72	-21.28%	src/python/pants/core/goals/multi_tool_goal_helper.py
10	81.67	-16.67%	src/python/pants/core/util_rules/stripped_source_files.py
10	71.43	-20.41%	src/python/pants/util/pip_requirement.py
9	85.0	-15.0%	src/python/pants/backend/nfpm/rules_integration_test.py
9	93.15	-4.11%	src/python/pants/engine/rules.py
9	60.71	-32.14%	src/python/pants/init/import_util.py
9	71.05	-23.68%	src/python/pants/option/errors.py
8	87.33	-2.74%	src/python/pants/backend/go/util_rules/build_pkg_target.py
8	79.49	-20.51%	src/python/pants/backend/python/macros/pipenv_requirements.py
8	84.78	-8.7%	src/python/pants/backend/terraform/dependencies.py
8	90.0	-7.27%	src/python/pants/engine/internals/mapper.py
8	79.41	-11.76%	src/python/pants/option/option_value_container.py
7	79.43	-4.96%	src/python/pants/backend/go/util_rules/build_opts.py
7	72.73	-21.21%	src/python/pants/backend/python/dependency_inference/default_module_mapping.py
7	74.29	-20.0%	src/python/pants/backend/python/macros/python_artifact.py
7	85.71	-11.11%	src/python/pants/backend/python/macros/python_requirements.py
7	79.49	-17.95%	src/python/pants/engine/download_file.py
7	92.35	-1.85%	src/python/pants/jvm/target_types.py
6	88.1	-7.14%	src/python/pants/backend/java/bsp/rules.py
6	83.67	-12.24%	src/python/pants/backend/python/framework/stevedore/python_target_dependencies.py
6	93.3	-2.87%	src/python/pants/backend/python/target_types_rules.py
6	93.47	-2.45%	src/python/pants/engine/internals/parametrize.py
6	75.0	-25.0%	src/python/pants/jvm/bsp/resources.py
6	63.04	-13.04%	src/python/pants/jvm/bsp/spec.py
5	75.0	-25.0%	src/python/pants/backend/python/subsystems/setup_py_generation.py
5	95.0	-2.27%	src/python/pants/backend/python/util_rules/lockfile_metadata.py
5	79.17	-20.83%	src/python/pants/bsp/spec/resources.py
5	87.88	-3.79%	src/python/pants/core/util_rules/lockfile_metadata.py
5	95.24	-4.76%	src/python/pants/engine/intrinsics.py
4	88.89	-11.11%	src/python/pants/backend/codegen/protobuf/python/python_protobuf_module_mapper.py
4	92.63	-4.21%	src/python/pants/backend/docker/utils.py
4	77.99	-1.26%	src/python/pants/backend/go/util_rules/cgo.py
4	91.74	-1.65%	src/python/pants/backend/python/goals/pytest_runner.py
4	88.24	-11.76%	src/python/pants/backend/python/goals/repl_integration_test.py
4	92.31	-7.69%	src/python/pants/jvm/classpath.py
4	92.34	-1.91%	src/python/pants/jvm/jdk_rules.py
4	93.71	-2.29%	src/python/pants/source/source_root.py
3	94.24	-2.16%	src/python/pants/backend/codegen/protobuf/protobuf_dependency_inference.py
3	92.0	-4.0%	src/python/pants/backend/go/util_rules/assembly.py
3	95.85	-1.55%	src/python/pants/core/goals/fix.py
3	95.94	-0.76%	src/python/pants/core/util_rules/adhoc_process_support.py
3	96.58	-2.05%	src/python/pants/engine/internals/specs_rules.py
3	94.12	-3.53%	src/python/pants/engine/internals/synthetic_targets.py
3	95.34	-0.64%	src/python/pants/option/bootstrap_options.py
3	62.86	-4.29%	src/python/pants/util/osutil.py
2	95.24	-4.76%	src/python/pants/backend/docker/subsystems/dockerfile_parser.py
2	92.59	-7.41%	src/python/pants/backend/docker/util_rules/dockerfile.py
2	94.9	-1.27%	src/python/pants/backend/go/util_rules/first_party_pkg.py
2	96.83	-3.17%	src/python/pants/backend/go/util_rules/link.py
2	96.3	-0.93%	src/python/pants/backend/python/dependency_inference/module_mapper.py
2	99.29	0.14%	src/python/pants/backend/python/util_rules/interpreter_constraints.py
2	97.25	-0.61%	src/python/pants/core/target_types.py
2	93.18	-4.55%	src/python/pants/engine/env_vars.py
2	92.11	-5.26%	src/python/pants/engine/internals/engine_testutil.py
2	94.0	-4.0%	src/python/pants/jvm/resolve/coordinate.py
2	68.21	-1.03%	src/python/pants/option/custom_types.py
2	88.24	-11.76%	src/python/pants/util/enums.py
2	83.33	-16.67%	src/python/pants/util/requirements.py
2	84.62	-15.38%	src/python/pants/util/resources.py
1	97.62	-1.19%	src/python/pants/backend/codegen/protobuf/python/rules.py
1	95.83	-2.08%	src/python/pants/backend/docker/lint/hadolint/rules.py
1	95.45	-4.55%	src/python/pants/backend/docker/package_types.py
1	86.96	-4.35%	src/python/pants/backend/go/util_rules/implicit_linker_deps.py
1	90.48	-4.76%	src/python/pants/backend/go/util_rules/link_defs.py
1	97.14	-2.86%	src/python/pants/backend/helm/check/kubeconform/deployment.py
1	98.0	-1.0%	src/python/pants/backend/javascript/nodejs_project_environment.py
1	96.55	-0.69%	src/python/pants/backend/javascript/nodejs_project.py
1	97.56	-2.44%	src/python/pants/backend/project_info/count_loc.py
1	96.3	-1.85%	src/python/pants/backend/python/macros/common_requirements_rule.py
1	96.88	-0.63%	src/python/pants/backend/python/subsystems/setup.py
1	97.44	-2.56%	src/python/pants/backend/terraform/testutil.py
1	96.15	-3.85%	src/python/pants/backend/tools/preamble/subsystem.py
1	96.97	-1.52%	src/python/pants/base/specs_parser.py
1	91.67	-8.33%	src/python/pants/bsp/rules.py
1	92.95	-0.64%	src/python/pants/build_graph/build_configuration.py
1	91.76	-0.37%	src/python/pants/core/environments/rules.py
1	96.43	-0.6%	src/python/pants/core/goals/lint.py
1	97.32	-0.89%	src/python/pants/engine/fs.py
1	85.17	-0.38%	src/python/pants/engine/internals/rule_visitor.py
1	85.71	-1.43%	src/python/pants/engine/internals/target_adaptor.py
1	93.3	-0.52%	src/python/pants/engine/process.py
1	41.18	-1.47%	src/python/pants/goal/completion.py
1	80.98	-0.61%	src/python/pants/init/engine_initializer.py
1	95.89	-1.37%	src/python/pants/jvm/shading/rules.py
1	97.14	-2.86%	src/python/pants/option/scope.py
1	81.42	-0.88%	src/python/pants/pantsd/service/pants_service.py
1	82.09	-1.49%	src/python/pants/testutil/python_interpreter_selection.py
1	94.78	-0.75%	src/python/pants/util/contextutil.py

Jobs

ID	Job ID	Ran	Files	Coverage
1	test_python_linux_x86_64_5/10 - 29261418526.1	13 Jul 2026 03:39PM UTC	1224	59.94	GitHub Action Run
2	test_python_linux_x86_64_0/10 - 29261418526.2	13 Jul 2026 03:44PM UTC	1231	57.38	GitHub Action Run
3	test_python_linux_x86_64_7/10 - 29261418526.3	13 Jul 2026 03:45PM UTC	1212	50.84	GitHub Action Run
4	test_python_linux_arm64 - 29261418526.4	13 Jul 2026 03:33PM UTC	1190	51.76	GitHub Action Run
5	test_python_linux_x86_64_6/10 - 29261418526.5	13 Jul 2026 03:36PM UTC	1206	49.7	GitHub Action Run
6	test_python_linux_x86_64_1/10 - 29261418526.6	13 Jul 2026 03:41PM UTC	1210	48.93	GitHub Action Run
7	test_python_linux_x86_64_8/10 - 29261418526.7	13 Jul 2026 03:43PM UTC	1210	52.87	GitHub Action Run
8	test_python_linux_x86_64_2/10 - 29261418526.8	13 Jul 2026 03:38PM UTC	1211	58.65	GitHub Action Run

pantsbuild / pants / 29261418526
93%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Coverage Regressions

Jobs

Source Files on build 29261418526

pantsbuild / pants / 29261418526 93%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Coverage Regressions

Jobs

Source Files on build 29261418526

pantsbuild / pants / 29261418526
93%

README BADGES
x