How to run PyTorch on Pypy

elcolie · October 26, 2022, 1:27am

I have read this post, but it was old topic and wiki page is broken by now.
Any update on pypy running pytorch?

Ref:

github.com/pytorch/pytorch

PyPy support

opened 08:30AM - 09 Mar 19 UTC

lopuhin

oncall: binaries feature triaged

## 🚀 Feature Support pytorch from PyPy -- a fast, compliant alternative impleme…ntation of the Python language (http://pypy.org) ## Motivation While pytorch itself probably won't benefit much from PyPy JIT, but often pytorch is used as a part of larger application, where using PyPy can have speed benefits, e.g. for evaluation, data generation, or other activities. ## Pitch (A clear and concise description of what you want to happen). I can imagine several stages: - PyPy support works by compiling from source - PyPy is integrated into CI - PyPy wheels are built and released ## Additional context Right now it seems that PyPy support, at least for commonly used stuff, is not far from reality, for example this branch https://github.com/lopuhin/pytorch/tree/pypy3.6 works in PyPy 3.6 7.0.0 for a moderately complex application (didn't try running tests yet). Here is a summary of fixes in that branch: 1. working around a compilation issue in the JIT: https://github.com/pytorch/pytorch/commit/0481da14052c09605b38940e08d8cae275c6a8cd - this is definitely a hack to get the compilation working, a proper implementation for PyPy needs to be in place. 2. **[merged]** `PySlice_Unpack` is not yet available in PyPy 3.6 -https://github.com/pytorch/pytorch/commit/752e204c90a782432eed77018e4fe3ad5fa4dbf2 - probably it's ok to merge this. With two above fixes, pytorch compiles on PyPy 3.6. PR https://github.com/pytorch/pytorch/pull/17836 3. **[merged in https://github.com/pybind/pybind11/pull/2146 ]** Applying https://github.com/pybind/pybind11/pull/1494 to pybind11 - https://github.com/pytorch/pytorch/commit/912b0b2a77b3ea0a5bac9fbe3ac5d577c86c6d7. Unfortunately, while the fix seems correct, and pybind11 has partial support and CI for PyPy, more work needs to be done to properly integrate it into pybind11, because other pybind11 tests are failing on a more recent PyPy, see https://github.com/pybind/pybind11/pull/1494 and https://github.com/pybind/pybind11/pull/1720 4. **[merged]** work around PyPy cpyext issue - https://github.com/pytorch/pytorch/commit/00941d8ae4e28bd03245a04c5096297c35a3128d - see https://bitbucket.org/pypy/pypy/issues/2968/segfault-calling-cpyext_tp_new_tuple (thanks @rlamy for the fix!), it seems that it is fine to merge this. PR https://github.com/pytorch/pytorch/pull/17837 Thanks to @xuhdev for an already merged PyPy compilation fix https://github.com/pytorch/pytorch/pull/11857 I submitted PRs for 2 and 4. If anyone can pick other items, that would be great. While these are quite small fixes, still properly integrating them is not a small task, not speaking of setting up CI and supporting it. cc @ezyang