Hi,
I have been working with dynamic batching in TorchServe and managed to increase the batch size to 2. However, when sending multiple requests, the logs indicate that PyTorch is processing them individually rather than batching them together. Could anyone provide guidance on resolving this?