Backprop Through Sparse Tensor Is Not Memory Efficient?

[Kevin96 (Kaiwen Wu)]

Thanks for clarification!

Hopefully, in my case, the backprop operation is quite simple. I have implemented an customized backprop operation to solve the memory issue.