kelindar / bench / 15954319200

push

github

Replace statistical test with BCa boostrap method (#15)

* update readme

* Add BCa bootstrap statistical method and update README

- Introduced BCa (Bias-Corrected accelerated) bootstrap for statistical comparisons.
- Updated benchmark functions to utilize BCa bootstrap for significance testing.
- Added new tests for BCa bootstrap functionality.
- Enhanced README to reflect new statistical methods and usage examples.
- Included copyright headers in multiple files for consistency.

* Refactor benchmark and statistical methods

- Replaced tinystat with gonum/stat for mean calculations in benchmarks.
- Updated formatComparison to improve clarity and accuracy in displaying results.
- Enhanced formatChange to include confidence interval in output.
- Added tests for BCa bootstrap consistency and practical significance checks.

* Refactor BCa bootstrap implementation and improve statistical significance detection

- Renamed BCaBootstrap to bca for consistency and clarity.
- Enhanced significance detection logic to reduce false positives and improve robustness.
- Updated tests to reflect changes in function naming and significance criteria.
- Improved handling of edge cases in formatComparison and bootstrap methods.

* Update BCa bootstrap implementation and tests for improved clarity and accuracy

- Refactored the bootstrap result structure to use a Report type for better clarity.
- Updated statistical comparison logic in formatComparison to utilize the new Report structure.
- Enhanced tests to validate the new CI handling and ensure correct statistical significance checks.
- Revised README to clarify the use of BCa bootstrap and its parameters.

* Enhance README with detailed BCa bootstrap explanation

- Added comprehensive description of the BCa bootstrap method and its application in the library.
- Clarified best practices for independent timings and handling of heavy-tailed data.
- Removed redundant sections to streamline the README content.

* Update b... (continued)

175 of 252 new or added lines in 4 files covered. (69.44%)

399 of 505 relevant lines covered (79.01%)

181464.88 hits per line