tarantool / luajit / 8511999542

93%

push

github

cmake: replace prove with CTest

The patch replaces the main test runner `prove(1)` with CTest, see [1]
and [2].

Build and test steps look the same as before:

$ cmake -S . -B build
$ cmake --build build --parallel
$ cmake --build build --target [LuaJIT-test, test]

CMake targets lua-Harness-tests, LuaJIT-tests, PUC-Rio-Lua-5.1-tests,
tarantool-tests and tarantool-c-tests are still operating.

The CMake custom target `test` was replaced by a target with the same
name that is automatically generated by CMake. It is not possible to
attach targets to this automatically generated `test` target.
It means that target `test` is now executing `LuaJIT-test`, but not
`LuaJIT-lint`. To mitigate this, a new target `LuaJIT-check-all` is
introduced. It has the same behaviour as an old `test` target: it runs
all functional tests and linters.

One could use `ctest` tool:

$ ctest --print-labels
Test project <snipped>
All Labels:
  LuaJIT-tests
  PUC-Rio-Lua-5.1-tests
  lua-Harness-tests
  tarantool-c-tests
  tarantool-tests
$ ctest                          # Run all tests.
$ ctest -L tarantool-tests       # Run tests by label.
$ ctest -L tarantool-c-tests     # Ditto.
$ ctest -L lua-Harness-tests     # Ditto.
$ ctest -L LuaJIT-tests          # Ditto.
$ ctest -L PUC-Rio-Lua-5.1-tests # Ditto.
$ ctest --rerun-fail             # Run only the tests
                                 # that failed previously.
$ ctest --verbose                # Print details to stdout.
$ ctest --output-on-failure      # Print details to stdout
                                 # on test failure only.

The benefits are:

- less external dependencies, `prove(1)` is gone, `ctest` is a part of
  CMake
- running tests by test title
- extended test running options in comparison to prove(1)
- unified test output (finally!)

Note that the testsuites in `test/LuaJIT-tests` and
`test/PUC-Rio-Lua-5.1` directories have their own test runners written
in Lua, and currently CTest runs these testsuites as s... (continued)

5659 of 6018 branches covered (94.03%)

Branch coverage included in aggregate %.

21592 of 23416 relevant lines covered (92.21%)

2827293.47 hits per line