I don’t have an exact answer to your question, but I tried something similar as in your third option here: Torch CUDA unknown error, but CUDA and nvidia-smi properly installed on Azure K8s Service - PyTorch Forums. I’m using Microsoft Azure instead of Google cloud, but same principle for building a docker image. The example I have there correctly installs CUDA and nvidia-smi, so that CUDA 11.4 is detected, but unfortunately pytorch can’t initialize CUDA properly for some reason, so I’d also be interested if you can find a solution using your third option.