f-dangel / curvlinops / 8476309724

90%

push

github

Add heuristic and exact damping to `KFACInverseLinearOperator` (#93)

* Add tests for torch_matmat and torch_matvec

* Add torch_matmat and torch_matvec methods to KFACLinearOperator

* Nicer if-statement

Co-authored-by: sourcery-ai[bot] <58596630+sourcery-ai[bot]@users.noreply.github.com>

* Fix doc string

* Add tests for torch_matmat and torch_matvec for KFACInverseLinearOperator

* Add torch_matmat and torch_matvec to KFACInverseLinearOperator

* Increase test tolerance

* Add tests for heuristic and exact KFAC damping

* Add heuristic and exact damping to KFACInverseLinearOperator

* Simplify if-statement

Co-authored-by: sourcery-ai[bot] <58596630+sourcery-ai[bot]@users.noreply.github.com>

* Merge nested if-statements

Co-authored-by: sourcery-ai[bot] <58596630+sourcery-ai[bot]@users.noreply.github.com>

* Simplify if-statement

Co-authored-by: sourcery-ai[bot] <58596630+sourcery-ai[bot]@users.noreply.github.com>

* Deduce torch_matmat return type from input type

* Remove device check

* Make constant explicit

* Remove leftover import

* Add support for list inputs to torch_matvec

* Add tests for list inputs to torch_matmat and torch_matvec

* Address review feedback

* Switch to case for kfac tests and minor fixes

* Fix flake8

* Refactor torch_matmat of KFACLinearInverse

* Improve docs for damping strategies

* Minor fixes

* Add reference for exact damping

* Run inverse KFAC tests in float64

* Add KFACInverseLinearOperator to docs and improve docstrings

* Improve docstring math

* Add missing backslashes

---------

Co-authored-by: sourcery-ai[bot] <58596630+sourcery-ai[bot]@users.noreply.github.com>

65 of 66 new or added lines in 1 file covered. (98.48%)

1144 of 1272 relevant lines covered (89.94%)

0.9 hits per line