NCCL WARN NET/IB : Got async event : port error

The Super MICR SYS-821GE-TNHR servers with H100,show messages like this:
103 NCCL WARN NET/IB : mlx5_6:1:Got async event : port error
103 NCCL WARN NET/IB : mlx5_6:1:Got async event : port error
103 NCCL WARN NET/IB : mlx5_6:1:Got async event : port error
103 NCCL WARN NET/IB : mlx5_6:1:Got async event : port error
103 NCCL WARN NET/IB : mlx5_6:1:Got async event : GID table change
103 NCCL WARN NET/IB : mlx5_6:1:Got async event : GID table change
We are not sure whether it is the issue of the platform or the issue of the network or the issue of the server. which looks good. Thanks for your help!
environment:
ubuntu22.04
NCCL:2.23.4
CUDA:12.6.3