Runtime error: Detected that your are using FX to symbolically trace a dynamo optimized function. This is not supported at the moment

torch.compile
1

Capture
Capture1633×631 33.1 KB

“Runtime error: Detected that your are using FX to symbolically trace a dynamo optimized function. This is not supported at the moment.”
When load increase on the server I get this error. When there are small number of requests it work pretty great but as soon as the load increase I started to get this error. To tackle it I have to start the service again.

2

I am facing the same error.

When im using multithreading with compiled model, i get this error. but if i dont compile the model. the program runs smoothly.