I have set different learning rate for a specific layer, and I am wondering is there a way to check whether I have set correctly? (I want to print the learning rate for that specific layer) Thanks!
1 Like
If you are using the recommended way of specifying a dict with the per-layer parameters, it should be visible which layers/parameters are using which learning rate.
You could double check the ids of the parameters inside the optimizer and compare it to the parameters in the model.