tarantool / luajit / 6705421613

71%

tarantool/master: 93%

push

github

cmake: replace prove with CTest

The patch replaces the main test runner prove(1) with CTest, see [1] and
[2].

The benefits are:

- less external dependencies, prove(1) is gone
- running tests by test title
- extended test running options in comparison to prove(1)
- unified test output (finally!)

Note that it is not possible to attach targets to the automatically
generated `test` target. It means that target `test` is now executing
`LuaJIT-test`, but not `LuaJIT-lint`.

Note that the testsuites in `test/LuaJIT-tests` and
`test/PUC-Rio-Lua-5.1` directories have their own test runners and
currently CTest runs these testsuites as single tests. In the future we
could change these test runners to specify tests from outside, and after
this we could run tests separately by CTest in these test suites.

Note that it is not possible to add dependencies to `add_test()` in
CMake, see [3]. It means that all object files and executables must be
built before running `ctest(1)`.

Examples of using CTest in a build directory:

$ ctest                             # Running all tests.
$ ctest -L tarantool                # Running tests in tarantool-tests dir.
$ ctest -L tarantool-c              # Running tests in tarantool-c-tests dir.
$ ctest -L lua-Harness              # Running tests in lua-Harness dir.
$ ctest -L luajit                   # Running tests in LuaJIT dir.
$ ctest -L lua                      # Running tests in PUC-Rio-Lua-5.1 dir.
$ ctest --rerun-fail
$ ctest --output-on-failure

1. https://cmake.org/cmake/help/latest/manual/ctest.1.html
2. https://cmake.org/cmake/help/book/mastering-cmake/chapter/Testing%20With%20CMake%20and%20CTest.html
3. https://gitlab.kitware.com/cmake/cmake/-/issues/8774

5342 of 5972 branches covered (0.0%)

Branch coverage included in aggregate %.

20492 of 23293 relevant lines covered (87.97%)

2750181.75 hits per line