DETR for only one object detection

I used DETR for object detection on a dataset of single-object samples. Since each sample only has one object to detect, the outputs of all queries are the same. However, DETR performs well when there are multiple objects in each sample. Has anyone else encountered a similar issue?