You could either run your script with
import os
os.environ["CUDA_VISIBLE_DEVICES"] = "0,1" # or other GPU ids if you want to
#your other imports and code
Or setting it in the terminal before executing your script by
export CUDA_VISIBLE_DEVICES=0,1
If you want to keep it permanent you can add the last variant to your .profile
or your .bashrc