Pytorch comes with its own runtime cuda libraries, but driver has to be installed on each machine separately.