Thanks a lot, this was set to 100 by default, which might make sense in most cases.
box_detections_per_img (int): maximum number of detections per image, for all classes.
Initialize the model with, say 500 in this way
model(box_detections_per_img=500)