How to call nn.LayerNorm for training

As the topic above, how do i call nn.LayerNorm the same way as nn.BatchNorm. The normalization file from official document has already added the LN; however, i just can’t use the LN like nn.BatchNorm in my script.

1 Like


Could not you import nn.LayerNorm?
What the version do you use?

@crcrpar It seems that im using torch 0.4.0