Does this model have overfitting?
Hi @Foolish,
It is totally normal. The only thing that might concern is “why is the loss suddenly drop so much?” , isn’t it?
Some suggestion if you want to get a better training loss curve
The reason is because you set the learning rate too high. If you want a better loss curve, you might want to take a lower learning rate.
i.e.: your current learning rate: 0.001, try to reduce it by a factor of 10 or 100 -> 0.0001 or 0.00001. Then you will see a better loss curve.
Hope it helps, cheers~
Thank you for your suggestions, I will optimize again.
is it bad if the loss suddenly drop?. The final loss is near zero ,so why does it matter?.