How to turn off gradient during GAN training

Thanks for the debugging!
This post might explain the benefits you are seeing.