Torch.multinomial with generator is not determinstic under certain conditions

This seems to be related to this post so make sure you are enabling deterministic algorithms and are using a new PyTorch version.