https://www.kaggle.com/jaideepvalani/arcface-humpback-customhead-fastai
HI friends
Please help indentifying the mistake here.
I suspect my weights from new layer are not added properly.
Check out the training output/ArcMarging layer ,
CustomHead from where ArcMargin is invoked.
In what sense are the accuracy and loss unstable?
Do you see large changes running the same script?
If so, you could apply some changes to your code based on the Reproducibility docs.
in version 9 i faced the problem.check accuracy trend.
In the latest version i removed fp16 part which was for reducing the accuracy from float 32 to 16. After that i am not facing the issue.
Not sure how this change solved the issue.
|epoch|train_loss|valid_loss|accuracy|time|
|---|---|---|---|---|
|0|12.588870|13.382115|0.280000|17:32|
|1|12.196980|13.181711|0.281538|17:29|
|2|11.672668|12.770080|0.344615|17:29|
|3|10.707971|12.187392|0.393077|17:29|
|4|9.674417|11.090038|0.526923|17:33|
|5|10.253925|10.354156|0.000000|17:37|
|6|10.353899|10.354156|0.000000|17:22|
|7|10.354124|10.354156|0.000000|17:22|