PyTorch Forums
Symmetric Relu stle activation function
nlp
cosmozhang1988
(Xiao Zhang)
June 28, 2019, 12:45am
1
Is the any activation that is in the form of symmetric relu and has been proved to be useful?