How to set different learning rates for different part of the same tensor?

2

That’s not possible as you would be hitting the same limitations explained in your other topic.