Loss is extremely large and not decreasing but accuracy is increasing

hi, everyone. I have found a problem that my loss prints something like 3e+18 and is not decreasing at all. however, my accuracy is increasing a lot to 0.95. What is the potential problem behind this?

1 Like

The loss or accuracy calculation might be wrong, e.g. you would accumulate the loss for various epochs or use unwanted broadcasting in the accuracy calculation.
I’m just speculating, as it’s hard to debug without seeing some code, so feel free to add more information or code. :wink: