PyTorch Forums
Does freezing some layers in a model affect/kill gradients in earlier or later layers?
vision
whoab
April 19, 2019, 5:58am
1
Why are or why not? If the gradient is zero, doesn’t that zero out earlier layers by chain rule