As the layer normalization is implemented, how could we use it with *Cell module ?
2 Likes
Unfortunately, you can’t. You have to implement it your self as the layer norm are usually applied before the activation of the gates.
Fortunately, pytorch offers an Touchscript optimized implementation on Github. You can find it here.
Have you xample of use?
the link has some examples. Should be enough. Ask if u aren’t clear 