Loss doesn't decrease in Simple Example

[ptrblck]

Your current model does not use any non-linearity between the linear layers, so you might want to add it.
Also, have a look at this topic, which had a similar error and where the same use case was discussed.