comunica / sparql-benchmark-runner.js / 8894200651

100%

push

github

Rewrite into more modular components with additional metrics (#7)

- The functionality from the input output file, as well as the result aggregation, have been split into more modular components:
- The endpoint availability check now uses a simple HEAD request. This is more lightweight for the endpoint to handle, and does not cause any unnecessary processing.
- The runner now records the following additional metrics to help provide a better view of the variance between replications:
        - Minimum, maximum and average query duration.
        - Minimum, maximum and average result count.
        - Minimum, maximum and average HTTP request count (for Comunica).
        - Minimum, maximum and average result arrival timestamps.
        - Bindings hash for the results, to ensure the same query produces the exact same results across all replications. When the result hash differs between executions, the runner marks it as failed and sets the error to a corresponding error (unless another error has already been reported).
- The runner records the thrown error as the error object now, and serializes the error message in the CSV file by default, to help identify exactly what the error was when a specific query fails.
- The runner now always waits for the endpoint to be available between executions, in case the endpoint crashes and needs some time to recover between subsequent query queries. This ensures the following query will not suffer because of a previous one that crashed the endpoint.

98 of 98 branches covered (100.0%)

Branch coverage included in aggregate %.

225 of 225 new or added lines in 6 files covered. (100.0%)

241 of 241 relevant lines covered (100.0%)

165.46 hits per line