Why does Resnet34 performs better than Resnet50 in coordinate regression task?

Hey, I’m doing a coordinate regression task for an object.
something like this(not exactly this ), where the label would be (17,40).
So, when I’m using Resnet50 I’m getting poorer results as compared to Resnet34.
Can someone explain me why it could be happening?
Resnet50 despite having more parameters has 1x1 convolutions, does this hurt in my case?