[PATCH openEuler-5.10 344/582] RDMA/mlx5: Don't add slave port to unaffiliated list