About Transformer in Pytorch 1.2

vision
1

Hi, All.

New Transformer functions in 1.2 are just for seq2seq application ?
Is It no relation with image?

Why is not “Translator” but “Transformer” ?

Thanks in advance.
Best,
@bemoregt.

2

Although the name may be confusing for those in the image processing world (where ‘transformations’ are commonly used) the Transformer is an architecture for machine translation.

‘Translator’ is a general term; ‘Transformer’ is the name of a popular machine translation architecture and the implementation that you see in torch.nn.modules.transformer.py.