pyro-ppl / numpyro / 37894809540

93%

push

github

fix(distributions): keep BernoulliLogits entropy finite for large negative logits (#2331)

* fix(distributions): keep BernoulliLogits entropy finite for large negative logits

exp(-logits) overflowed below about -88 in float32 and the entropy became inf / inf = nan. Compute it at |logits| as softplus(-|a|) + |a| * sigmoid(-|a|), which only involves small non-negative terms.

* Remove the regression test

2 of 2 new or added lines in 1 file covered. (100.0%)

15657 of 16881 relevant lines covered (92.75%)

1.7 hits per line