CNN does not predict properly / does not converge as expected

Sure there are! Just takes a lot of time to learn the tricks. This AI dude just released his way to traing neural networks - to avoid such problems. Have a look