How to get gradient of loss?

Anyone who could tell me how to get the gradients of loss ? The code is as below:
loss_seg = criterion_seg(outputs_seg, targets_seg[:, 0])

        targets_ins = Variable(labels_ins)
        loss_ins = criterion_ins(outputs_ins, targets_ins[:, 0], n_objects, MAX_N_OBJECTS)

        loss = loss_seg + loss_ins

        optimizer.zero_grad()
        loss.backward()
        optimizer.step()

The gradient of the loss w.r.t. each parameter p is stored in p.grad after the backward. If you want grad of intermediates, you can call e.g. loss_seg.retain_grad().

Best regards

Thomas

2 Likes

Great! Thanks very much.