As per my intutions, they should update every time when we do loss.backward(). Am I in the right directions, experts?