Hi,

I’m using a sparse matrix in part of my neural network and I was wondering if there is a way to get the gradients with respect to only the non zero values of a sparse matrix. If I convert the sparse matrix into a dense one, the matrix is going to be too large and it’s going to take too much time to compute the gradient so I want to keep my matrix sparse.

I would appreciate it if someone can help me with this.