KL Divergence produces negative values

[tom (Thomas V)]

They still aren’t distributions.
Keep in mind that the loss functions take batches. So you’d want to unsqueeze(0).

Best regards

Thomas