tarantool / test-run

63%

master: 63%

LAST BUILD ON BRANCH Totktonada/calc-jobs-using-available-cpus

branch: Totktonada/calc-jobs-using-available-cpus

CHANGE BRANCH

x

Reset

• Totktonada/calc-jobs-using-available-cpus
• 0x501D/fix-get_iproto_port
• 0x501D/fix-luarocks-warnings
• Totktonada/add-github-actions-step-summary
• Totktonada/bump-luatest-to-1.0.1-15-gfcabd2a
• Totktonada/descrease-unix-socket-path-length
• Totktonada/dynamic-test-report-width
• Totktonada/fix-worker-failure-on-failed-tap13-parsing
• Totktonada/gh-22-tags
• Totktonada/gh-287-lift-pipe-buffer-size-restriction
• Totktonada/gh-325-add-env-option
• Totktonada/gh-361-status-line
• Totktonada/gh-382-add-test-timeout-for-luatest
• Totktonada/gh-437-fix-ability-to-run-test-several-times
• Totktonada/luatest-experimenting
• Totktonada/luatest-run-test-cases-in-parallel
• Totktonada/prettify-help-output
• Totktonada/qa-128-strengthen-wait-cond
• Totktonada/test-python-versions-in-ci
• Totktonada/update-flake8
• VitaliyaIoffe/gh-276-hangs-timeout-doesnt-work
• VitaliyaIoffe/gh-304-include-luatest
• add-extra-log-msg
• avtikhon/gh-qa-97-disk-bound-collect
• avtikhon/gh-qa-97-disk-bound-collect-TMP
• avtikhon/restart-tests
• avtikhon/restart-tests_TMP
• bump-luatest
• bump-luatest-to-1.0.0-3-gf37b353
• dependabot/pip/gevent-23.9.0
• drewdzzz/wait_cluster_vclock_fix
• fix-flake8-E721-do-not-compare-types
• gh-119-buffering-problems
• gh-330-fix-consistent-mode
• gh-tarantool-6646-workflow-catching-flaky-tests
• gorcunov/wait-log-drop-redundant-assert
• grafin/add_ignore_zero_to_get_vclock
• grafin/delete-zero-vclock-in-get_cluster_vclock
• i-cod/fix-bug-when-lua-script-name-truncated-by-dot
• i-cod/fix-incorrect-char-in-log-file-name
• i-cod/timeout-adjustment
• iverbin/fix-non-utf8-chars-parsing
• kyukhin/enable-parallel-fragile
• ligurio/add-unittest
• ligurio/fix-typo
• ligurio/support-skip-tap13
• locker/rm-luatest-submodule-v2
• lua-workflow
• master
• mechanik20051988/implement-lua-libs-for-luatests
• sergos/qa-272
• sergos/readme-update
• skaplun/pretest-clean-dis-arm64
• slavakirichenko/refactoring-ci-workflow
• utf8-fixup
• ylobanklov/improve-failed-test-report
• ylobankov/add-retries-option
• ylobankov/bump-gevent
• ylobankov/bump-luatest
• ylobankov/bump-luatest-to-new-version
• ylobankov/change-vardir-default
• ylobankov/consider-flaky-tests
• ylobankov/drop-checksums
• ylobankov/fix-ci
• ylobankov/fix-crash-detect
• ylobankov/fix-ports-issue
• ylobankov/fix-server-start-check
• ylobankov/fix-server-start-check-backup
• ylobankov/fix-test-run
• ylobankov/handle-server-start-errors-in-py-tests
• ylobankov/ignore-sockets-on-artifact-copying
• ylobankov/improve-ports-lua-script
• ylobankov/kill-procs-of-not-started-servers
• ylobankov/read-logfile-safely
• ylobankov/refactor-luatest-helpers
• ylobankov/retry-all-failed-tests
• ylobankov/run-luatest-tests-by-pattern
• ylobankov/switch-to-python2
• ylobankov/update-luatest
• ylobankov/update-requirements

Build # 9430552023

Build Type

Pull #435

github

Committed by Totktonada

Commit Message

Calculate parallel jobs based on available CPUs

We're going to enable new ARM64 runners in CI, where test-run is invoked
in a Docker container. At the same time, the runner is an LXD container
created by the service provider. In this circumstances, the Docker
container sees all the 128 online CPUs, but the runner may have
only some of them available (depending on the pricing plan).

Python 3.3+ has a function to determine available CPUs, so we can reduce
the parallelism to this value. We fall back to the online CPUs count on
Python < 3.3.

After this change, test-run follows a CPU affinity mask set by `taskset`
(and, I guess, by `numactl`).

The change is similar to replacing `nproc --all` to `nproc`.

The change only affects the default behavior, which can be overwritten
by passing the `--jobs` (or `-j`) CLI option or using the
`TEST_RUN_JOBS` environment variable.

Reported in https://github.com/tarantool/tarantool/pull/10102

Pull Request Pull Request #435: Calculate parallel jobs based on available CPUs

Run Details

762 of 1568 branches covered (48.6%)

Branch coverage included in aggregate %.

8 of 11 new or added lines in 2 files covered. (72.73%)

2964 of 4377 relevant lines covered (67.72%)

0.68 hits per line