Which PyTorch version is compatible with H100 GPU and CUDA capability sm_90?

1

my CUDA Version: 12.4
my PyTorch version: 1.13

Error: “NVIDIA H100 80GB HBM3 with CUDA capability sm_90 is not compatible with the current PyTorch installation”

Will Pytorch 2.2 work? PyTorch 1.13 appears to only support until sm_86

Or is there any other workaround?

2

I see PyTorch 2.1 has sm_90:

  • Torch: 2.1.0+cu121
  • Torch: [‘sm_50’, ‘sm_60’, ‘sm_70’, ‘sm_75’, ‘sm_80’, ‘sm_86’, ‘sm_90’]

You can check on this with:

print(torch.version)
print(torch.cuda.get_arch_list())

3

Every current stable and nightly release will support your H100.

1 Like