Which GPUs are supported by Torch 2

[ptrblck]

@GeneralAwareness

Do you have another source

No, unfortunately I don’t have another source for a pre-built wheel for xformers.

@GeneralAwareness

I just wanted to add that I tested it without xformers to be hit with no fp16 support so I have to use --no-half. I used that and I knew what was next, and sure enough OOM. I can do 512x512 though so that eliminates Pytorch as the culprit.

Thanks for another confirmation that the PyTorch wheels are not broken for sm_61.

@GeneralAwareness

Btw, this is the best support I have seen in a long time. Thank you.

Sure, happy to help.

@GeneralAwareness

edit #2: I built xformers on my machine and it worked.

That’s great to hear!

@sebby621 also thanks for confirming it, too.

[thot_experiment]

made an account just to chime in positively about the excellent support

can confirm was getting the same error on a 1080Ti and recompiling xformers from source fixed it as detailed in the reddit post linked by @GeneralAwareness

[ZeroCool22 (Emilio)]

Just posting again to say that after the last updates Torch 2 got, now it’s working with the 1080 TI.

And i didn’t need for any extra steps or build, just the same steps of the video.

[FurkanGozukara (Furkan Gözükara)]

yep developer of extension did update. now it is working on 1xxx or 2xxx cards. thank you for letting us know