How to choose the architecture of a GAN model?

Hello everyone,
I designed a GAN architecture for a specific problem (dermoscopy images) and it is not working. How to choose the right architecture? why kind of architectures you suggest? I tried simple CNN for both the generator and discriminator. I also tried dense blocks for the generator and Patch-GAN for the discrimnator.

Thanks in advance