Hi, I was wondering what kind of consequences the introduction of PyTorch 2.0 would have on libtorch ?
If I understand correctly, this means throwing away Torchscript in favour of TorchInductor ? Would the compiled model in pytorch be directly usable in libtorch ?
Thanks in advance for any insights
4 Likes
From @Chillee on Slack:
[TorchScript] is not deprecated. We are not actively developing torchscript, but it will be supported for the foreseeable future, and you’ll be able to use torchscript based backends behind dynamo. We currently have no plans on making torchinductor consume torchscript graphs. We are working on making the kernels it generates exportable to C++, but since the compiler is in Python (and so is much of Triton), I’m not sure there’s that much advantage to making it take in torchscript graphs.
4 Likes
TorchScript was getting more and more stable over the years now we are getting a new cutting edge paradigm with many potential bugs just like the early days of TS. I don’t see why that’s a rational choice.
2 Likes