# Cannot Find ptxas **URL:** \ **Category:** torch.compile\ **Created:** [January 20, 2024, 6:59pm UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784 "2024-01-20T18:59:52Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Subzero](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/subzero/32/62272_2.png) [@Subzero](https://discuss.pytorch.org/u/Subzero)\ **Post date:** [January 20, 2024, 6:59pm UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784/1 "2024-01-20T18:59:52Z")
I am trying to use torch.compile and I am receiving the error: RuntimeError: Cannot find ptxas I am on pytorch version 2.1.2+cu121 and on linux. Is there anything I need to check for? I am using triton 2.1.0 as that is what is pytorch warned when I tried to install triton 2.2.0 ---
**Author:** ![ptrblck](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/32/1823_2.png) [@ptrblck](https://discuss.pytorch.org/u/ptrblck)\ **Post date:** [January 20, 2024, 9:13pm UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784/2 "2024-01-20T21:13:33Z")
Could you uninstall `triton` assuming you have manually installed it and just install PyTorch via the provided install commands on our website? It will pull the right `triton` package with all needed dependencies. ---
**Author:** ![marksaroufim](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/marksaroufim/32/36747_2.png) [@marksaroufim](https://discuss.pytorch.org/u/marksaroufim)\ **Post date:** [January 20, 2024, 9:19pm UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784/3 "2024-01-20T21:19:31Z")
when you install pytorch it won’t install triton exactly, we will manually build it using a pin that’s in pytorch core You can see how it works if you do `make triton` here [https://github.com/pytorch/pytorch/blob/main/Makefile#L35](https://github.com/pytorch/pytorch/blob/main/Makefile#L35) ---
**Author:** ![Subzero](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/subzero/32/62272_2.png) [@Subzero](https://discuss.pytorch.org/u/Subzero)\ **Post date:** [January 20, 2024, 9:56pm UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784/4 "2024-01-20T21:56:19Z")
I originally had triton installed from installing pytorch from the install commands on the website. I had read older posts about the issues with ptxas and triton and it seemed that changing the version of triton could had solve the issue, but it did not for my case. I uninstalled triton and then used the install commands from pytorch and it still did not work. ---
**Author:** ![Subzero](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/subzero/32/62272_2.png) [@Subzero](https://discuss.pytorch.org/u/Subzero)\ **Post date:** [January 20, 2024, 9:58pm UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784/5 "2024-01-20T21:58:14Z")
Is there a guide on how to manually build it? Or can you please write out the steps needed to do so? I am not so good with using github and command line usage ---
**Author:** ![ptrblck](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/32/1823_2.png) [@ptrblck](https://discuss.pytorch.org/u/ptrblck)\ **Post date:** [January 21, 2024, 1:23am UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784/6 "2024-01-21T01:23:04Z")
Since when should this be the case? Installing the current stable `2.1.2` PyTorch release as well as the current nightly binary still downloads the `(pytorch)-triton` package (using the specified commit you are pointing to for nightlies): ```python pip install torch Collecting torch Downloading torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl.metadata (25 kB) ... Downloading torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl (670.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 670.2/670.2 MB 5.0 MB/s eta 0:00:00 Downloading triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89.2/89.2 MB 4.9 MB/s eta 0:00:00 ... pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu121 Collecting torch Downloading https://download.pytorch.org/whl/nightly/cu121/torch-2.3.0.dev20240120%2Bcu121-cp310-cp310-linux_x86_64.whl (768.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 768.4/768.4 MB 4.6 MB/s eta 0:00:00 ... Collecting pytorch-triton==2.2.0+e28a256d71 (from torch) Downloading https://download.pytorch.org/whl/nightly/pytorch_triton-2.2.0%2Be28a256d71-cp310-cp310-linux_x86_64.whl (183.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 183.1/183.1 MB 4.2 MB/s eta 0:00:00 ... Successfully installed nvidia-nccl-cu12-2.19.3 pytorch-triton-2.2.0+e28a256d71 torch-2.3.0.dev20240120+cu121 ``` The S3 bucket also stores the wheels here for nightlies: [https://download.pytorch.org/whl/nightly/pytorch-triton/](https://download.pytorch.org/whl/nightly/pytorch-triton/) PyTorch source builds could build `triton` from the commit if you execute the [build script](https://github.com/pytorch/pytorch/blob/2ae66ddba0f466406e577648799e095b35a4bb5a/.github/scripts/build_triton_wheel.py), but I doubt any `pip install` command triggers an LLVM download the the actual `triton` build. @Subzero could you post the exact instructions you are using as I’m seeing `ptxas` in the installed `(pytorch)-triton` package using the mentioned install commands: ```python /home/pbialecki/miniforge3/envs/tmp/lib/python3.10/site-packages/triton/third_party/cuda/bin/ptxas --version ptxas: NVIDIA (R) Ptx optimizing assembler Copyright (c) 2005-2023 NVIDIA Corporation Built on Fri_Sep__8_19:13:29_PDT_2023 Cuda compilation tools, release 12.3, V12.3.52 Build cuda_12.3.r12.3/compiler.33281558_0 ``` ---
**Author:** ![Subzero](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/subzero/32/62272_2.png) [@Subzero](https://discuss.pytorch.org/u/Subzero)\ **Post date:** [January 21, 2024, 3:23am UTC](https://discuss.pytorch.org/t/cannot-find-ptxas/195784/7 "2024-01-21T03:23:30Z")
## Quick conclusion but not an exact solution: I made a new project and used the regular command install like before and there is no error now. Something about the original project, excluding the code as the code works, was causing the error. Below are the exact instructions I used to install and uninstall. ```auto pip uninstall triton Found existing installation: triton 2.1.0 Uninstalling triton-2.1.0: Successfully uninstalled triton-2.1.0 pip uninstall torch -y Found existing installation: torch 2.1.2 Uninstalling torch-2.1.2: Successfully uninstalled torch-2.1.2 pip install torch Collecting torch Obtaining dependency information for torch from https://files.pythonhosted.org/packages/03/f1/13137340776dd5d5bcfd2574c9c6dfcc7618285035cd77240496e5c1a79b/torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl.metadata Using cached torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl.metadata (25 kB) Collecting triton==2.1.0 (from torch) Obtaining dependency information for triton==2.1.0 from https://files.pythonhosted.org/packages/4d/22/91a8af421c8a8902dde76e6ef3db01b258af16c53d81e8c0d0dc13900a9e/triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata Using cached triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.3 kB) Using cached torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl (670.2 MB) Using cached triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89.2 MB) Installing collected packages: triton, torch Successfully installed torch-2.1.2 triton-2.1.0 ./.venv/lib/python3.10/site-packages/triton/third_party/cuda/bin/ptxas --version ptxas: NVIDIA (R) Ptx optimizing assembler Copyright (c) 2005-2023 NVIDIA Corporation Built on Mon_Apr__3_17:13:45_PDT_2023 Cuda compilation tools, release 12.1, V12.1.105 Build cuda_12.1.r12.1/compiler.32688072_0 ``` Doing this, I still receive the error: ```auto Traceback (most recent call last): File "/home/user_n/PycharmProjects/Resnet18 Tests/main.py", line 371, in model_ft = torch.compile(model_ft) File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/ __init__.py", line 1723, in compile return torch._dynamo.optimize(backend=backend, nopython=fullgraph, dynamic=dynamic, disable=disable)(model) File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_dynamo/eval_frame.py", line 610, in optimize compiler_config=backend.get_compiler_config() File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/ __init__.py", line 1571, in get_compiler_config from torch._inductor.compile_fx import get_patched_config_dict File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/compile_fx.py", line 38, in from .fx_passes.joint_graph import joint_graph_passes File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/fx_passes/joint_graph.py", line 8, in from ..pattern_matcher import ( File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/pattern_matcher.py", line 28, in from .lowering import fallback_node_due_to_unsupported_type File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/lowering.py", line 4768, in import_submodule(kernel) File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_dynamo/utils.py", line 1492, in import_submodule importlib.import_module(f"{mod. __name__ }.{filename[:-3]}") File "/usr/lib/python3.10/importlib/ __init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/kernel/bmm.py", line 4, in from ..select_algorithm import ( File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/select_algorithm.py", line 25, in from .codegen.triton import texpr, TritonKernel, TritonPrinter, TritonScheduling File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/codegen/triton.py", line 26, in from ..triton_heuristics import AutotuneHint File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/triton_heuristics.py", line 23, in from .coordinate_descent_tuner import CoordescTuner File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/coordinate_descent_tuner.py", line 8, in if has_triton(): File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/torch/_inductor/utils.py", line 83, in has_triton import triton File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/ __init__.py", line 20, in from .compiler import compile, CompilationError File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/compiler/ __init__.py", line 1, in from .compiler import CompiledKernel, compile, instance_descriptor File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/compiler/compiler.py", line 27, in from .code_generator import ast_to_ttir File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/compiler/code_generator.py", line 8, in from .. import language File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/language/ __init__.py", line 4, in from . import math File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/language/math.py", line 4, in from . import core File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/language/core.py", line 1376, in def minimum(x, y): File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/runtime/jit.py", line 542, in jit return decorator(fn) File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/runtime/jit.py", line 534, in decorator return JITFunction( File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/runtime/jit.py", line 433, in __init__ self.run = self._make_launcher() File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/runtime/jit.py", line 388, in _make_launcher scope = {"version_key": version_key(), File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/runtime/jit.py", line 120, in version_key ptxas = path_to_ptxas()[0] File "/home/user_n/PycharmProjects/Resnet18 Tests/.venv/lib/python3.10/site-packages/triton/common/backend.py", line 119, in path_to_ptxas raise RuntimeError("Cannot find ptxas") RuntimeError: Cannot find ptxas ``` I tried running the two basic examples in [INTRODUCTION TO TORCH.COMPILE](https://pytorch.org/tutorials/intermediate/torch_compile_tutorial.html#introduction-to-torch-compile) and both gave the same error. Then I tried the two basic examples again but this time in a new fresh project and both examples worked. For the new fresh project I install torch using: ```auto pip install torch Collecting torch Obtaining dependency information for torch from https://files.pythonhosted.org/packages/03/f1/13137340776dd5d5bcfd2574c9c6dfcc7618285035cd77240496e5c1a79b/torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl.metadata Using cached torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl.metadata (25 kB) Collecting triton==2.1.0 (from torch) Obtaining dependency information for triton==2.1.0 from https://files.pythonhosted.org/packages/4d/22/91a8af421c8a8902dde76e6ef3db01b258af16c53d81e8c0d0dc13900a9e/triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata Using cached triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.3 kB) Using cached torch-2.1.2-cp310-cp310-manylinux1_x86_64.whl (670.2 MB) Using cached triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89.2 MB) Successfully installed torch-2.1.2 triton-2.1.0 ./.venv/lib/python3.10/site-packages/triton/third_party/cuda/bin/ptxas --version ptxas: NVIDIA (R) Ptx optimizing assembler Copyright (c) 2005-2023 NVIDIA Corporation Built on Mon_Apr__3_17:13:45_PDT_2023 Cuda compilation tools, release 12.1, V12.1.105 Build cuda_12.1.r12.1/compiler.32688072_0 ``` One thing I noticed differently with the new fresh project is: ```auto Obtaining dependency information for MarkupSafe>=2.0 from https://files.pythonhosted.org/packages/36/2a/fab302636634e1f770a26aac212e44cff25522ed3c9189bd8afc9ae2effd/MarkupSafe-2.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading MarkupSafe-2.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB) Downloading MarkupSafe-2.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB) ``` While in my original project MarkupSafe used a cache version: ```auto Requirement already satisfied: MarkupSafe>=2.0 in ./.venv/lib/python3.10/site-packages (from jinja2->torch) (2.1.3) ``` Could the issue have been a slightly out of date version of MarkupSafe? The answer is no: ```auto pip uninstall MarkupSafe Found existing installation: MarkupSafe 2.1.3 Uninstalling MarkupSafe-2.1.3: Successfully uninstalled MarkupSafe-2.1.3 pip install torch Collecting MarkupSafe>=2.0 (from jinja2->torch) Obtaining dependency information for MarkupSafe>=2.0 from https://files.pythonhosted.org/packages/36/2a/fab302636634e1f770a26aac212e44cff25522ed3c9189bd8afc9ae2effd/MarkupSafe-2.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Using cached MarkupSafe-2.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB) Using cached MarkupSafe-2.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB) Installing collected packages: MarkupSafe Successfully installed MarkupSafe-2.1.4 ``` The error persists. ```auto raise RuntimeError("Cannot find ptxas") RuntimeError: Cannot find ptxas ``` Moving my original code to the new fresh project gave no errors. So I believe that something in my original project was causing the issue somehow.