Problem on different learning rate and weight decay in different layers

7

Alexey,

This part of your latest code is wrong:

{'params': [module.parameters() for index, module in enumerate(model.modules) if index != 14]}

It will put the python iterable module.parameters() into a list, and hence the error message. You can convert an iterable into a list for example via: list(module.parameters())