Grad through frozen weights

[ptrblck]

@kmsd

Or does autograd not take the derivative with respect to the frozen weights (only taking it with respect to the activations)

This is the case as seen in this post where the wgrad kernels are missing if I freeze an intermediate layer while the dgrad kernels are still visible.