Different outputs when using different batch size (only on cuda)

[ptrblck]

@Stapo

how can I reach deterministic outputs on cuda regardless of batch size?

Edit: It turns out that it happens with CPU as well, but seems to be more rare.

There is no guarantee to create bitwise identical results for different workloads as different algorithms can be used internally on the GPU as well as CPU.
If you stick to the Reproducibility docs you can expect to see deterministic results for the same workload as well as framework and library versions, but not for different use cases / workloads.