Problem about torch.nn.BCELoss for soft labels

Hi James!

Yes. BCELoss accepts a target (“labels”) consisting of probabilities
that run over 0.0 to 1.0 (inclusive) (so, “soft labels”). They do not have
to be exactly 0.0 or 1.0 (“hard labels”), although they can be.

As a aside, for reasons of numerical stability, you should use
BCEWithLogitsLoss in preference to BCELoss.

Best.

K. Frank