What is the difference between log_softmax and softmax? How to explain them in mathematics? Thank you!

log_softmax applies logarithm after softmax. softmax: exp(x_i) / exp(x).sum() log_softmax: log( exp(x_i) / exp(x).sum() ) log_softmax essential does log(softmax(x)), but the practical implementation is different and more efficient while doing the same operation. You might want to have a look at…

What is the difference between log_softmax and softmax?

KaiyangZhou (Kaiyang) February 22, 2018, 2:05pm 6

1 Like