Deep/Sharp Mask or Mask R-CNN

vision
1

Greetings and apologies if this is just a lazy question, but has anyone implemented either of the FAIR deep/sharp mask or the more recent r-cnn papers? Thanks, really enjoying learning about pytorch.

4 Likes
2

From what I know, there are no public implementations of these papers in pytorch yet.

2 Likes
3

sounds like a challenge for my infinite spare time :slight_smile:

4

i’m also thinking of hacking up MaskRCNN (but not deepmask / sharpmask). Maybe we could work off a common repo.

6 Likes
5

I would love that. Not sure if I’m qualified to help but it would be a good learning experience.

1 Like
6

I would be interested, too. Although from the looks of it, it won’t be a trivial project. It will be great to implement the instance segmentation component. I haven’t found that piece in any of the existing implementations of fast/faster RCNN. Everyone seems to stop at object detection.

Also the pytorch ecosystem for segmentation is a bit small, so this could be a big win for pytorch getting a state of the art segmentation model into the model zoo.

2 Likes
7

@bfortuner @smth Are we going ahead with development of maskRCNN …I am interested…

1 Like
8

did anyone start this? I tried getting either of these 2 work, but they dont work:

https://github.com/felixgwu/mask_rcnn_pytorch

I would love to be able to do this in pytorch.

9

@deepcode I haven’t tried myself but what is the problem with these implementations? why dont they work?

10

Any update on Pytorch implementation of Mask RCNN ?

11

Commenting for updates

12

I’m currently trying to implement Deepmask with Pytorch but I’m struggling with some of the modifications which are done on the preloaded ResNet for the trunk (https://github.com/facebookresearch/deepmask/blob/master/DeepMask.lua)

All of the batchNormalization layers are changed in some way I don’t understand. The function’s called “BNtoFixed” which is imported from imagine-nn utils (https://github.com/szagoruyko/imagine-nn).
Unfortunately, the Pytorch version of imagine-nn is quite small in comparison and does not provide something similar. Also couldn’t find a reference in the Deepmask/Sharpmask papers.

Maybe someone can give me a hint on what this modification is for and how it works or a paper which descripes it.

Thanks in advance

13

Commenting for updates. Did anyone try this?

14

I’m trying to implement Deepmask with Pytorch, so far I have defined the Joint Loss Function, and the model’s learn-able parameters.

I was working on the training phase, and as the paper says that training must be done in an alternative back-propagation fashion across the two branches, I have written the code for the same. But there is some problem with training, I tried to train the model with a Fake Dataset, for minibatches other than the first mini-batch the loss of the model is turning out to be NAN.

Can somebody help me with this?

Here is the link to current version of code : https://github.com/mejanvijay/DeepMask-Pytorch/blob/master/DeepMask-Pytorch-Implementation.ipynb