Created TorchCTS, a conformance test suite for testing backends

While developing a PrivateUse1 backend I found the need to have much heavier testing than what is included. To solve this problem I created TorchCTS, a conformance test suite with > 19k tests, some auto generated, some hand spun for specific hard cases. It has semantic levels and multiple other ways to segment and control what tests you run. I’m looking for feedback from backend developers on areas I need to cover better. Note that it’s beta still and there are multiple hardware vendors I do not have access to and cannot do tests for. https://torchcts.ai

1 Like