f-dangel / curvlinops / 8451245135

90%

push

github

Add `fisher_type="forward-only"` (FOOF method) option to `KFACLinearOperator` (#98)

* Add tests for KFAC with forward-only fisher_type

* Add forward-only fisher_type (FOOF) option

* Fix typo

* Fix typo

* Add ISAAC reference

* Add clarifying comment

* Add test case where FOOF equals exact GGN

* Fix docstring

* Add cases for single-layer weight-sharing models for which FOOF is exact

* Add test for case where FOOF is exact for weight-sharing models

* Decrease test sensitivity

* Decrease test sensitivity further

* Minor cosmetic fixes

* Use iterator to avoid explicit type hints

7 of 8 new or added lines in 1 file covered. (87.5%)

1090 of 1218 relevant lines covered (89.49%)

0.89 hits per line