Using SparseTensor as a trainable variable

Hi, guys,

I’m trying to use SparseTensor to represent weight variables in a fully-connected layer. My ultimate goal of using SparseTensor is to permanently mask some of connections in dense form. Thus, these pruned connections are ignored while calculating and applying gradients. I wonder if this is allowed in pytorch? Thank you.

Best,
Alice