Network uplink redundancy degraded

[insearchof]

Vmware ESXI 6.7 U3

 

I have 8 ESXI hosts   all eight have 8 network adapters   I use 6 of them two are spare.

On one ESXI host after a power outage I am getting this error all the time now.

 

Stateless event alarm

 

Alarm Definition:

([Event alarm expression: Network Redundancy Degraded] OR [Event alarm expression: Network Redundancy Degraded on DVPorts])

 

Event details:

Uplink redundancy degraded on DVPorts: "3/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1", "43/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1", "175/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1", "241/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1", "6/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1", "176/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1", "7/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1", "265/50 25 82 a7 f1 90 5f ab-e8 64 c2 89 ea 8f 47 a1". Physical NIC vmnic0 is down.

 

The Physical NIC has the primary IP address of the host.

I activated one of my Spare Network adapter but I can not figure out home to swap the VMNIC0 with VMNIC7

 

Any suggestions ?

 

Thank you

[harry89]

hey,

Physical NIC doesn't have any IP address , it has hardcoded Mac address , layer 2 device

Now you need to remove uplink

https://docs.vmware.com/en/VMware-vSphere/6.0/com.vmware.vsphere.hostclient.doc/GUID-E25D7EF6-4CC3-4EFB-BCA7-F0740B5A3630.html

Add uplink

https://docs.vmware.com/en/VMware-vSphere/6.0/com.vmware.vsphere.hostclient.doc/GUID-C69708D0-27AB-4399-A517-CA2BEBBDD3C5.html

At this point vmk0 [management kernel] will be using some other vmmic and not vmnic0 , thus you can safely do it .

 

[insearchof]

I am unable to remove VMK0

 

Remove an Uplink from a vSphere Distributed Switch (vmware.com)  This helped from one place but not from this place.

Need to remove this so I can assign ip address  to VMK7 

[harry89]

No need to remove vmk0 , its vmkernel on host 

just remove vmnic0 and add vmnic 7 as uplink

[insearchof]

Harry

 

When I do that I loss connectivity to the ESXI host all VMS become disconnected.

 

Any screen shots of the best method would be helpful

 

Thanks

 

Tom

[harry89]

Run these commands

esxcfg-vswitch -l

esxcfg-nics -l

esxcfg-vmknic -l

 

Also type esxtop and press "n" and provide screenshot

[insearchof]

Harry

 

[root@TGCSESXI-11:~] esxcfg-vswitch -l
DVS Name Num Ports Used Ports Configured Ports MTU Uplinks
Management 2816 16 512 1500 vmnic0,vmnic7,vmnic1

DVPort ID In Use Client
36 1 vmnic0
37 1 vmnic1
38 1 vmnic7
39 0
3 1 vmk0
43 1 vmk5
266 0
150 0
1 0
265 1 vmk7
244 1 TGKW009.eth0
160 0
173 1 TGCS026.eth0
120 1 TGCS035.eth0
241 1 TGCS030.eth0
238 0
264 0
42 0
161 0
243 0
91 1 TGCS033.eth0
248 1 TGCS021-N2.eth0

DVS Name Num Ports Used Ports Configured Ports MTU Uplinks
DSwitch-HA 2816 7 512 1500 vmnic3,vmnic6

DVPort ID In Use Client
64 1 vmnic6
65 1 vmnic3
66 0
67 0
68 0
69 0
70 0
71 0
4 1 vmk2
74 1 vmk6

DVS Name Num Ports Used Ports Configured Ports MTU Uplinks
DSwitch-ISCSI-1 2816 5 512 1500 vmnic4

DVPort ID In Use Client
8 1 vmnic4
9 0
10 0
11 0
12 0
13 0
14 0
15 0
0 1 vmk3
54 1 TGCS021-N2.eth1

DVS Name Num Ports Used Ports Configured Ports MTU Uplinks
DSwitch-ISCSI-2 2816 4 512 1500 vmnic5

DVPort ID In Use Client
8 1 vmnic5
9 0
10 0
11 0
12 0
13 0
14 0
15 0
0 1 vmk4

DVS Name Num Ports Used Ports Configured Ports MTU Uplinks
DSwitch-Vmotion 2816 4 512 1500 vmnic2

DVPort ID In Use Client
8 1 vmnic2
9 0
10 0
11 0
12 0
13 0
14 0
15 0
0 1 vmk1

[root@TGCSESXI-11:~] esxcfg-nics -l
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic0 0000:02:00.0 ntg3 Up 1000Mbps Full 14:18:77:69:cc:c0 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet
vmnic1 0000:02:00.1 ntg3 Up 1000Mbps Full 14:18:77:69:cc:c1 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet
vmnic2 0000:03:00.0 ntg3 Up 1000Mbps Full 14:18:77:69:cc:c2 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet
vmnic3 0000:03:00.1 ntg3 Up 1000Mbps Full 14:18:77:69:cc:c3 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet
vmnic4 0000:04:00.0 ntg3 Up 1000Mbps Full 00:0a:f7:a0:52:c4 1500 Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet
vmnic5 0000:04:00.1 ntg3 Up 1000Mbps Full 00:0a:f7:a0:52:c5 1500 Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet
vmnic6 0000:04:00.2 ntg3 Up 1000Mbps Full 00:0a:f7:a0:52:c6 1500 Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet
vmnic7 0000:04:00.3 ntg3 Up 1000Mbps Full 00:0a:f7:a0:52:c7 1500 Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet
[root@TGCSESXI-11:~] esxcfg-vmknic -l
Interface Port Group/DVPort/Opaque Network IP Family IP Address Netmask Broadcast MAC Address MTU TSO MSS Enabled Type NetStack
vmk1 0 IPv4 10.10.10.111 255.255.255.0 10.10.10.255 00:50:56:6e:d9:fd 1500 65535 true STATIC defaultTcpipStack
vmk1 0 IPv6 fe80::250:56ff:fe6e:d9fd 64 00:50:56:6e:d9:fd 1500 65535 true STATIC, PREFERRED defaultTcpipStack
vmk2 4 IPv4 10.11.10.111 255.255.255.0 10.11.10.255 00:50:56:68:11:2d 1500 65535 true STATIC defaultTcpipStack
vmk2 4 IPv6 fe80::250:56ff:fe68:112d 64 00:50:56:68:11:2d 1500 65535 true STATIC, PREFERRED defaultTcpipStack
vmk3 0 IPv4 10.12.10.111 255.255.255.0 10.12.10.255 00:50:56:61:35:32 1500 65535 true STATIC defaultTcpipStack
vmk3 0 IPv6 fe80::250:56ff:fe61:3532 64 00:50:56:61:35:32 1500 65535 true STATIC, PREFERRED defaultTcpipStack
vmk4 0 IPv4 10.14.10.111 255.255.255.0 10.14.10.255 00:50:56:6e:43:3a 1500 65535 true STATIC defaultTcpipStack
vmk4 0 IPv6 fe80::250:56ff:fe6e:433a 64 00:50:56:6e:43:3a 1500 65535 true STATIC, PREFERRED defaultTcpipStack
vmk5 43 IPv4 10.2.8.141 255.255.252.0 10.2.11.255 00:50:56:64:82:2f 1500 65535 true STATIC defaultTcpipStack
vmk5 43 IPv6 fe80::250:56ff:fe64:822f 64 00:50:56:64:82:2f 1500 65535 true STATIC, PREFERRED defaultTcpipStack
vmk6 74 IPv4 10.5.16.111 255.255.252.0 10.5.19.255 00:50:56:69:1b:57 1500 65535 true STATIC defaultTcpipStack
vmk6 74 IPv6 fe80::250:56ff:fe69:1b57 64 00:50:56:69:1b:57 1500 65535 true STATIC, PREFERRED defaultTcpipStack
vmk7 265 IPv4 10.2.10.69 255.255.252.0 10.2.11.255 00:50:56:66:e0:f2 1500 65535 true DHCP defaultTcpipStack
vmk7 265 IPv6 fe80::250:56ff:fe66:e0f2 64 00:50:56:66:e0:f2 1500 65535 true STATIC, PREFERRED defaultTcpipStack
vmk0 3 IPv4 10.2.8.111 255.255.252.0 10.2.11.255 14:18:77:69:cc:c0 1500 65535 true STATIC defaultTcpipStack
vmk0 3 IPv6 fe80::1618:77ff:fe69:ccc0 64 14:18:77:69:cc:c0 1500 65535 true STATIC, PREFERRED defaultTcpipStack
[root@TGCSESXI-11:~] esxtop

 

 

 

 

 

[harry89]

Are your VMs TGCS035 and TGCS026 currently up and running . 
You can ping them and reach out them?

I can see the dvs -management already has three uplinks vmnic0, vmnic1 vmnic7

if those vms are reachable , i would suggest them to vmotion to some other host . Once done repeat esxtop "n" and send screenshot

[insearchof]

Harry

 

Yes all VMS on the Hosts are up and running and I can ping all I use Nagios to monitor my system and I would be alerted if they are not reachable

When vmnic0 goes down sometimes Nagios sends me an alert of a server is down also but it really is not.  VMNIC0 stays down for a few seconds then is back online.  Very flaky.  That's why I want to remove it. 

I migrated all VM's off this host and ran esxtop

 

any ideas

[Lalegre]

Hey ,

Regarding the Teaming and Failover policy of the Management portgroup where the vmk0 is connected, you need to check that the vmnic7 is Active. If that vmnic is there then you can safely move the vmnic0 to the unused section.

Of course make sure that the physical port where the vmnic7 is connected is configured the same as where the vmnic0 is connected.

[insearchof]

Laegre

 

When I remove VMNIC0 I loss connectivity  to the HOST I can logon to the host directly but I am limited to what I can do there.

I need to be able to make the changes in vcenter if possible.

 

VMNIC7 is setup as DHCP now I need to make it the same ip address as VMNIC0 

 

IS there a proper method I can use to do this?

 

Every time I try to make VMNIC7 ip address as VMNIC0 it tells me address is in use 

But I am unable to change that address on VMNIC0 

 

at a loss here