Conditional DCGAN generate the same number for each column

vision
2

I think you are experiencing what is called mode-collapse. There is an amazing paper by founder of pytorch themselves for mitigating this problem.

Wasserstein GAN