Great, I fixed that, but I’ve figured out that the problem was that I wasn’t setting the momentum parameter in the BatchNorm layers initializations. Since my input data is highly variable, the default value of momentum (0.1) was not proper for my data distribution.
Thanks!