Process matrices by mapping row minimum and maximum values to [-1 1]
I guess your scikit-learn approach is normalizing the entire array, so you might need to normalize the rows separately.
The question is also unrelated to PyTorch so you might get a faster and better answer on e.g. StackOverflow.