Spatial CNN architecture Loss Oscillation

Hi Guy… I’m having this problem when I use a slice by slice convolution I Get the Losses so Oscillating. What may cause this?
download