RuntimeError: Default process group has not been initialized, please make sure to call init_process_group

Have a look a this post which dealt with the same error and which might have been solved using the proposed solutions. :slight_smile: