What optimizer can I use in Resnet?

1

Hello.

When I used Adam optimizer , I got 60% train Acc.
But, When I used SGD optimizer, I got about 90% train Acc.

why did this happening?

1 Like
2

I think Adam is better than SGD in some way. SGD only efficient in some certain circumstances. Maybe you could try another dataset or make some advance on Adam.