Hey everyone,
currently, I have multiple models, like 10,000. I want to query these models with a single input. My current way is to query these models in a sequential way (1 by 1). However, it is not efficient enough. I am curious if there is a way to batch models and put single input to these models and get the response?
Thanks in advance!