PyTorch Math Overflow: Hidden Values Doubling every itertation

[chenyuntc (Yun Chen)]

I think the problem may come from self.highway_layers