Vanishing and Exploding Gradients

Hi,
In the case of the vanishing gradient problem, the loss value would be approx. stagnant. And in exploding gradients problem, the loss value would increase. Right?