Confusion with nn.CrossEntropyLoss

1

I think I’m confused between the cross-entropy loss and the implementation of nn.CrossEntropyLoss. As far as I know, the general formula for cross-entropy loss looks like this.
L(y,s) = - sigma(i=1 to c) {yi * log(si)} (where si is the output of softmax)

However, when I see the documentation for nn.CrossEntropyLoss, it looks like there is no ‘yi’ value (the one-hot vector indicating the target class).

image
image1018×108 7.93 KB

Can anyone help me solve my confusion?"

2

This example code might be helpful which shows how the target is used to index the logits.

1 Like