pyro-ppl / numpyro / 35267012368

93%

push

github

fix(distributions): keep Categorical entropy finite when a category has zero probability (#2276)

CategoricalProbs.entropy computed -(probs * log(probs)).sum(-1), which is NaN
as soon as one category has probability exactly zero, even though such a probs
vector is in the simplex and the category contributes nothing to the entropy.
Use xlogy, as BernoulliProbs.entropy already does in the same module.

1 of 1 new or added line in 1 file covered. (100.0%)

15635 of 16865 relevant lines covered (92.71%)

1.7 hits per line