I have an edge with two uplinks
Uplink1: trunk(107, 109)
Uplink2: trunk (110,109)
On edge 1 of tier0 gateway I have two interfaces
int1: 10.92.107.11 connected to the vlan backed segment 107
int2: 10.92.110.11 connected to the vlan backed segment 110
From 10.92.107.11 I am able to ping 10.92.107.1 which is gateway ip of the vlan 107 in the physical router
From 10.92.110.11 I am not able to ping 10.92.110.1 which is gateway ip of the vlan 110 in the physical router
===========
esxtop output of the host where edge Vm is deployed
------------------------------------------------
67108935 3600159:VA000164.eth2 vmnic4 DvsPortset-0 3.81 0.00 91.00 0.00 0.00 0.00 0.00 0.00 ====>>trunk tep and uplink2
67108936 3600159:VA000164.eth1 vmnic2 DvsPortset-0 5.72 0.00 74.00 1.91 0.00 116.00 0.00 0.00 ====>>trunk Tep and uplink1
67108937 3600159:VA000164.eth0 vmnic2 DvsPortset-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 ====>>management
------------------------------------------------
Ideally traffic for 10.92.110.1(on VLAN 110) should be going out via switch port 67108935
Ideally traffic for 10.92.107.1(on VLAN 107)should be going out via switch port 67108936
But as per the PCAPs, Drop and trace some how arp traffic for 10.92.110.1 is going via 67108936 and getting dropped
[root@IN-MAA-EX0005:~] pktcap-uw --switchport 67108936 --dir 2 -o - | tcpdump-uw -enr - | grep -i "10.92.110.1"
The switch port id is 0x04000048.
pktcap: The output file is -.
pktcap: No server port specifed, select 47670 as the port.
pktcap: Local CID 2.
pktcap: Listen on port 47670.
pktcap: Main thread: 241994603712.
pktcap: Dump Thread: 241995134720.
pktcap: The output file format is pcapng.
pktcap: Recv Thread: 241995663104.
pktcap: Accept...
pktcap: Vsock connection from port 1095 cid 2.
reading from file -, link-type EN10MB (Ethernet), snapshot length 65535
13:30:00.205250 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
13:30:01.204657 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
13:30:02.204037 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
13:30:03.207305 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
[root@IN-MAA-EX0005:~] pktcap-uw --capture Drop --mac 00:50:56:b2:80:5f -o - | tcpdump-uw -enr -
The session capture point is Drop.
The session filter mac(src or dst) is 00:50:56:b2:80:5f.
pktcap: The output file is -.
pktcap: No server port specifed, select 48910 as the port.
pktcap: Local CID 2.
pktcap: Listen on port 48910.
pktcap: Main thread: 585638776000.
pktcap: Recv Thread: 585639835392.
pktcap: Accept...
pktcap: Dump Thread: 585639307008.
pktcap: Vsock connection from port 1096 cid 2.
pktcap: The output file format is pcapng.
reading from file -, link-type EN10MB (Ethernet), snapshot length 65535
13:34:42.433716 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
13:34:43.433633 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
13:34:44.434558 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
13:34:45.483103 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
13:34:46.484891 00:50:56:b2:80:5f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.92.110.1 (ff:ff:ff:ff:ff:ff) tell 10.92.110.11, length 46
tcpdump-uw: pcap_loop: error reading dump file: Interrupted system call
[root@IN-MAA-EX0005:~] pktcap-uw --capture Drop --mac 00:50:56:b2:80:5f
The session capture point is Drop.
The session filter mac(src or dst) is 00:50:56:b2:80:5f.
No server port specifed, select 49042 as the port.
Output the packet info to console.
Local CID 2.
Listen on port 49042.
Main thread: 698122783936.
Dump Thread: 698123314944.
Recv Thread: 698123843328.
Accept...
Vsock connection from port 1097 cid 2.
13:35:24.454021[1] Captured at Drop point, Drop Reason 'VlanTag Mismatch'. Drop Function 'VSwitch_FwdPolicyCheck'. TSO not enabled, Checksum not offloaded and not verified, SourcePort 67108936, VLAN tag 110, VLAN priority 0, QID 0, headroomlen 266, length 60.
Segment[0] ---- 60 bytes:
0x0000: ffff ffff ffff 0050 56b2 805f 0806 0001
0x0010: 0800 0604 0001 0050 56b2 805f 0a5c 6e0b
0x0020: ffff ffff ffff 0a5c 6e01 0000 0000 0000
0x0030: 0000 0000 0000 0000 0000 0000
13:35:25.453149[2] Captured at Drop point, Drop Reason 'VlanTag Mismatch'. Drop Function 'VSwitch_FwdPolicyCheck'. TSO not enabled, Checksum not offloaded and not verified, SourcePort 67108936, VLAN tag 110, VLAN priority 0, QID 0, headroomlen 266, length 60.
Segment[0] ---- 60 bytes:
0x0000: ffff ffff ffff 0050 56b2 805f 0806 0001
0x0010: 0800 0604 0001 0050 56b2 805f 0a5c 6e0b
0x0020: ffff ffff ffff 0a5c 6e01 0000 0000 0000
0x0030: 0000 0000 0000 0000 0000 0000
13:35:26.452470[3] Captured at Drop point, Drop Reason 'VlanTag Mismatch'. Drop Function 'VSwitch_FwdPolicyCheck'. TSO not enabled, Checksum not offloaded and not verified, SourcePort 67108936, VLAN tag 110, VLAN priority 0, QID 0, headroomlen 266, length 60.
Segment[0] ---- 60 bytes:
0x0000: ffff ffff ffff 0050 56b2 805f 0806 0001
0x0010: 0800 0604 0001 0050 56b2 805f 0a5c 6e0b
0x0020: ffff ffff ffff 0a5c 6e01 0000 0000 0000
0x0030: 0000 0000 0000 0000 0000 0000
13:35:27.455165[4] Captured at Drop point, Drop Reason 'VlanTag Mismatch'. Drop Function 'VSwitch_FwdPolicyCheck'. TSO not enabled, Checksum not offloaded and not verified, SourcePort 67108936, VLAN tag 110, VLAN priority 0, QID 0, headroomlen 266, length 60.
[root@IN-MAA-EX0005:~] pktcap-uw --trace --mac 00:50:56:b2:80:5f --vlan 110
The trace session is enabled.
The session filter mac(src or dst) is 00:50:56:b2:80:5f.
The session filter VLAN is 110.
No server port specifed, select 49469 as the port.
Output the packet info to console.
Local CID 2.
Listen on port 49469.
Main thread: 35673828544.
Dump Thread: 35674359552.
Recv Thread: 35674887936.
Accept...
Vsock connection from port 1099 cid 2.
13:36:51.489851[1] PktHandleID: gAxDWNpFAAA=, Captured at PktFree point, Drop Reason 'VlanTag Mismatch'. Drop Function 'VSwitch_FwdPolicyCheck'. TSO not enabled, Checksum not offloaded and not verified, SourcePort 67108936, VLAN tag 110, VLAN priority 0, QID 0, headroomlen 266, length 60.
PATH:
+- [13:36:51.489802] | VnicTx | 67108936 |
+- [13:36:51.489806] | PortInput | 67108936 |
+- [13:36:51.489808] | PreDVFilter | |
+- [13:36:51.489810] | PostDVFilter | |
+- [13:36:51.489812] | IOChain | | NetMisc_DropBPDUPackets@vmkernel#nover
+- [13:36:51.489813] | EtherswitchDispatch | 67108936 |
+- [13:36:51.489814] | EtherswitchFwdCheckPolicy | 67108936 |
+- [13:36:51.489845] | Drop | |
+- [13:36:51.489849] | PktFree | |
Segment[0] ---- 60 bytes:
0x0000: ffff ffff ffff 0050 56b2 805f 0806 0001
0x0010: 0800 0604 0001 0050 56b2 805f 0a5c 6e0b
0x0020: ffff ffff ffff 0a5c 6e01 0000 0000 0000
0x0030: 0000 0000 0000 0000 0000 0000
13:36:52.491749[2] PktHandleID: APhYWNpFAAA=, Captured at PktFree point, Drop Reason 'VlanTag Mismatch'. Drop Function 'VSwitch_FwdPolicyCheck'. TSO not enabled, Checksum not offloaded and not verified, SourcePort 67108936, VLAN tag 110, VLAN priority 0, QID 0, headroomlen 266, length 60.
PATH:
+- [13:36:52.491710] | VnicTx | 67108936 |
+- [13:36:52.491715] | PortInput | 67108936 |
+- [13:36:52.491717] | PreDVFilter | |
+- [13:36:52.491719] | PostDVFilter | |
+- [13:36:52.491720] | IOChain | | NetMisc_DropBPDUPackets@vmkernel#nover
+- [13:36:52.491722] | EtherswitchDispatch | 67108936 |
+- [13:36:52.491723] | EtherswitchFwdCheckPolicy | 67108936 |
+- [13:36:52.491742] | Drop | |
+- [13:36:52.491747] | PktFree | |
Segment[0] ---- 60 bytes:
0x0000: ffff ffff ffff 0050 56b2 805f 0806 0001
0x0010: 0800 0604 0001 0050 56b2 805f 0a5c 6e0b
0x0020: ffff ffff ffff 0a5c 6e01 0000 0000 0000
0x0030: 0000 0000 0000 0000 0000 0000
13:36:53.490482[3] PktHandleID: gP5cWNpFAAA=, Captured at PktFree point, Drop Reason 'VlanTag Mismatch'. Drop Function 'VSwitch_FwdPolicyCheck'. TSO not enabled, Checksum not offloaded and not verified, SourcePort 67108936, VLAN tag 110, VLAN priority 0, QID 0, headroomlen 266, length 60.
PATH:
+- [13:36:53.490447] | VnicTx | 67108936 |
+- [13:36:53.490452] | PortInput | 67108936 |
+- [13:36:53.490454] | PreDVFilter | |
+- [13:36:53.490456] | PostDVFilter | |
+- [13:36:53.490458] | IOChain | | NetMisc_DropBPDUPackets@vmkernel#nover
+- [13:36:53.490459] | EtherswitchDispatch | 67108936 |
+- [13:36:53.490460] | EtherswitchFwdCheckPolicy | 67108936 |
+- [13:36:53.490476] | Drop | |
+- [13:36:53.490480] | PktFree | |
Segment[0] ---- 60 bytes:
0x0000: ffff ffff ffff 0050 56b2 805f 0806 0001
0x0010: 0800 0604 0001 0050 56b2 805f 0a5c 6e0b
0x0020: ffff ffff ffff 0a5c 6e01 0000 0000 0000
0x0030: 0000 0000 0000 0000 0000 0000