Gradient clipping in DNN

1

how to prevent the explosion of gradients of weights via gradient clipping

2

You can apply torch.nn.utils.clip_grad_norm_ or torch.nn.utils.clip_grad_value_ on the desired parameters.