I got a very weird problem here. I use a very simple deep learning model with only linear layers. However, the training loss does not decrease at all during training.
But when I input some random inputs to my model, it works well… So I don’t think it is the model problem. Must be something wrong with my inputs. I load features from ‘.npy’ file.
Any suggestions would be greatly appreciated.