How to clip the gradients corresponding to one of the loss where overall loss multiple components?

I want to clip gradients due to the gradient penalty loss only in WGANGP. Because it causes sudden spikes while training.