Training with Half Precision

vision
25

You could use forward hooks as described here which would allow you to check the outputs without changing the forward function in case you are using nn.Modules.

2 Likes