If I want to predict numbers (e.g. 12345-> 6, 23456-> 7, 34567-> 8 …) and use the nn.transformer module. Do I need to do Ebidding or linear transform like Linear (1,256) or can I use d_model = 1, and just feed 1,2,3,4,5 … to the input?
If I want to predict numbers (e.g. 12345-> 6, 23456-> 7, 34567-> 8 …) and use the nn.transformer module. Do I need to do Ebidding or linear transform like Linear (1,256) or can I use d_model = 1, and just feed 1,2,3,4,5 … to the input?