PyTorch inference with multiple images

vision
2

In my case, I used python concurrent.futures.ProcessPoolExecutor and concurrent.futures.ThreadPoolExecutor to inference 4 images at once.

But, this one might help you.