my idea is that:create only one model in gpu,then I will do the forward passes under multi-cudastream,
( won’t track the grad,only to get the result of forward pass) Is it safe?
my idea is that:create only one model in gpu,then I will do the forward passes under multi-cudastream,
( won’t track the grad,only to get the result of forward pass) Is it safe?