Update only parameters of choosen neurones in the Backpropagation phase of a Neural Network

You could try to manually set their requires_grad attribute to False like here.