Hi, guys,
I’m trying to use SparseTensor to represent weight variables in a fully-connected layer. My ultimate goal of using SparseTensor is to permanently mask some of connections in dense form. Thus, these pruned connections are ignored while calculating and applying gradients. I wonder if this is allowed in pytorch? Thank you.
Best,
Alice