Is there a linear solver in PyTorch whose differentiation is implemented ? Is it planned to implement one soon ? If not, how do I go about differentiating it by hand ?

Hi, do you encounter a problem which is the torch.gesv function is much slower on GPU than on CPU when the matrix A is small, such as 30*30?@matthieuheitz

Is there any detailed documentation of the implementation details of torch.gesv? What method is it using? Gaussian elimination? What formula does it use to compute the gradients?