TorchServe: Access different models with "--models all" option

I’d like to create a TorchServe handler that draws on 3 models, but I’m not clear on how to access/identify the different models in the script, when starting TorchServe with the --models all option.

Any help appreciated.

Hi @jbm we built our workflow feature to handle such use cases, let me know if this works for you but you’ll be able to define how the 3 models interact in a YAML script

Ah, okay, I’ll have a look. Thanks!