How to learn only a subset of weights in gradient descent keeping the rest constant

2

@tom explains a nice way to achieve this in this post and also mentions the shortcomings of other approaches such as zeroing out the gradients of some elements.