I have seen different setting for the parameters for the adamw, and it makes me very confuse. I tried adamw with the same params that I used for adam, but I didnot get any improvement on the performance.
I was wondering if anyone has any suggestion on that?