Pytorch jit vs tensorRT

has anyone compared the throughput of a model optimized by both jit and tensorRT?

It seems to depend on the specific network. The biggest speedup I’ve seen was close to three times as fast as PyTorch. The lowest was about one and a quarter times as fast.

1 Like

Thanks for sharing. That’s not too bad. could you share which models showed such speedup? and perhaps the speedup data on some models you have tried? I would really appreciate any details.
Thanks again.