How to build a pipeline to load model in batch?

Hey everyone,

currently, I have multiple models, like 10,000. I want to query these models with a single input. My current way is to query these models in a sequential way (1 by 1). However, it is not efficient enough. I am curious if there is a way to batch models and put single input to these models and get the response?

Thanks in advance!