Since you are working with a GAN, check this post which explains a common issue of trying to use stale activations.