Edge tunnels down

[orddie]

Running NSX-t 3.2.0

The environment is collapsed

The TEP vlan we use is 90 and subnet is 10.0.90/24

management vlan is 80 with subnet is 172.16.80.0/24

ESXi IP's are below

Host A = 172.16.80.4 & 10.090.4

Host B = 172.16.80.5 & 10.0.90.5

Host C = 172.16.80.6 & 10.0.90.6

when I SSH into the edge node and go into VRF 0, I can ping all three 10.0.90.0/24 IP's but the tunnels are showing as down.

 

where should I be looking to resolve this?

 

[Jefferson Cowart]

Are you using VLAN 90 for both host and edge TEPs? If so, move the edges to a separate VLAN. It's supposed to work in 3.2 (and did in 3.1), but there seems to be a bug in 3.2.0 that causes tunnels to not come up when hosts and edges are in the same VLAN.

[orddie]

Does that mean I need to route them?

Example: hosts, 10.0.90.0/24 and edges 10.0.91.0/24 or keep the same subnet and only change the VLAN ID’s between devices 

[Jefferson Cowart]

Correct - You will need a large MTU path between the two subnets.

[orddie]

Please confirm 

 

- do I need to route them?

- keep same subnet but split the devices via Vlan 

- both route and split devices 

[shank89]

The simplest design is to have separate VLANs with their own subnet that can route to each other.

 

Ensure you have a minimum of 1600 MTU.

You may find this video useful https://youtu.be/SFa7RUya9nQ

[orddie]

When I separated the networks, the tunnels came up and all is working as expected now.

bummer that collapsed design does not work.  Thinking about getting 30.1 and starting over.

[shank89]

It actually does work in the latest version and have tested it myself, you need to make sure you use VLAN backed segments to wire the edge vm, but this setup isn't the most streamlined and least complicated way. 

[CyberNils]

Check this KB for supported options:

https://kb.vmware.com/s/article/83743

 

[orddie]

this is most likely my core issue when trying to use a collapsed design.

[amitsingh2021]

Might be there are no VMs associated on NSX segments on the ESX hosts, so that's why tunnel are showing down. Do you have VMs connected on NSX segments?