PyTorch Forums
Ignore padding area in loss computation
nlp
saxenarohit
(Rohit Saxena)
October 5, 2022, 5:48pm
9
An alternative way of option B
loss_masked = torch.masked_select(loss, loss_mask) loss_masked.mean()
show post in topic