Semantic segmentation perform bad

Was this issue ever resolved? Facing a similar problem.