I get a strange phenomenon where the mIoU metric on PascalVOC 2012 is always 0.4724, no matter how I switch the backbone and segmentation head, and no matter how the loss becomes (it even becomes nan with my current setup). What could be the reason for this phenomenon? To put more context, I have tried variations of resnet as the backbone with deeplab head as the decoder head.