Is Gradient Clipping necessary with Adam optimizer?

[davidlee]

Hello PyTorch.

I’m wondering someone needs to consider gradient clipping for exploding gradients even if using Adam optimizer which is more dynamic way than SGD.

Or, should i ignore clipping the gradient since i use Adam optimizer?

Thanks!!