I had the same issue, turns out I had installed the CPU only binaries when I was trying to run on the GPU.