Nn.transformer model show zero loss on train and doesnt work in interferencet

[hadaev8 (Had)]

Here is code
https://colab.research.google.com/drive/1g4ZFCGegOmD-xXL-Ggu7K5LVoJeXYJ75

Im not sure what im doing wrong.
And still cant find tutorial or example with native pytorch transformer.

[zhangguanheng66 (Guanheng George Zhang)]

https://pytorch.org/tutorials/beginner/transformer_tutorial.html

[hadaev8 (Had)]

This example have no decoder