I’m an undergrad working on my senior project which is building a vision-based strawberry inspection system. I used detectron2 to train a model to detect instances of strawberries of various classes in images, prior to that I also trained a model to just identify strawberries in images(which I used to do model-assisted labeling to build the dataset i’m using). But I was wondering if there was a relatively easy way to modify the Mask R-CNN architecture to attach multiple class labels to an given object.
This would be useful for this use-case because I want to identify all the instances of strawberries in the image, but I also want to tag each berry with quality criteria i.e. (green, underripe, overripe, damaged, moldy,… ) there are a lot of berries that have overlapping quality criteria and having the model infer the dominant class seems like a much more noisy problem to solve. Any help would be greatly appreciated!