PyTorch Forums
Linformer attention mask
nlp
Alymostafa
(Aly Mostafa)
February 16, 2021, 6:19pm
1
How can i make the attention mask of the decoder be the same weights as the Projected weights?