Different learning rate for a specific layer

You can use the same syntax for custom modules to get the parameters, e.g.:

my_custom_model.my_custom_layer.parameters()

That being said, modules do not contain the learning rate, which is set in the creation of the optimizer.
If you want to use layer-specific learning rates, you could use the per-parameter options.

1 Like