Inconsistent gradient values for the same input

@sahil_shah Unfortunately that depends on your hardware, you can see here for a more complete answer.

@Naman-ntc Getting deterministic results is tricky, there are many posts on this forum discussing that.
cudnn internaly can use many algorithms, some are deterministic (run twice on the same hardware will give you the same results), some not (run twice on the same hardware can give you different results). You can set the torch.backends.cudnn.determinic flag to True or False to only use deterministic algorithms or all of them.
The output precision will be as all other algorithms up to the input type precision.