I train my model in DDP and introduce torch.compile:
model = torch.compile(model, mode=“max-autotune”)
it worked until triton was installed. So I wonder how to disable triton before torch.compile in max-autotune mode
You could try to disable Triton via selecting the desired backends in torch._inductor.config.max_autotune_gemm_backends
.
1 Like