Faster-RCNN label scores

The Pytorch Faster-RCNN model returns a set of bounding boxes, labels, and scores. Each element of the scores list is the classification score of the label at the same index. Is there a way to obtain, for each detection, the classification score for each label?
Instead of returning a scores with shape (num_detections), I would like to obtain it with shape (num_detections, num_classes).