Rpn_box_reg loss is nan

Even I discussed this issue here. I tried with two different datasets. In both cases, rpn_box_reg becomes nan in first epoch itself.