Using a single GPU for a model trained with multiple GPUs

Am I understanding you right: I can inference a model with single gpu that trained by multi gpu, and vise-versa?