Your the welcome @ptrblck, I will wait as I am not experienced in pytorch.
By the way if by any chance my problem can be valuable, it would be great. My original problem was to understand this one Resnet: problem with test loss. And during the debugging the new problem rise… That’s the life of research 
“See you soon”.