Active /Standby 4- node edge cluster

[zeeshan qadir]

Hi guys,

We have two data centers, DC1 and DC2. Both are 30msec away. We are not using any federation or multisite in this case.

Currently we have two edge nodes edge-DC1 and edge -DC2 in edge-cluster, edge-DC1 is active and edge-DC2 is standby.

Under normal conditions, all our N/S traffic out of NSX at DC1 and DC2, uses edge-DC1. if edge-DC1 goes down, then edge-DC2 takes over as active, then all N/S traffic will use edge-DC2.  Since preemption is enabled, when edge-DC1 comes back online, edge-DC1 takes over as active node.

Everything is working fine, but I have some questions:

I want to add 2 more edge nodes in edge clusters , something like this:

edge1-DC1 ( active)

edge2-DC1  ( standby)

edge3-DC2 ( standby)

Edge-DC4 ( standby)

This will provide more resiliency but NSX will not allow configuring TO external interfaces on more than 2 edge nodes.

Any idea how can we pull this off ?

Thanks!!

[Dimitri Desmidt]

Hello,

A minor comment first.

An Edge Node is neither active nor standby.

An Edge Node hosts T0 (max 1) + T1 (can be many).

On that Edge Node each hosted T0 and T1 can be Active or Standby.

Conclusion: On an Edge Node you can have a mix of "Active T0 and/or T1" and "Standby T0 and/or T1".

Now about your question we could rephrase as: "Can I do a T0 A/S/S/S"?

The answer is No.

Only 2 Edge Nodes can be selected in a T0 A/S, since you can have only 1 Edge Node for the Active role and 1 Edge Node for the Standby role.

Note: On T1 A/S, it's different.

You have the option "Standby Relocation".

In case 1 of the Edge Node used in this T1 A/S (whatever the Edge Node hosting that T1 Active or the Edge Node hosting that T1 Standby", then another Edge Node will be automatically selected (part the Edge Cluster) to host that T1 so you always keep 2 Edge Nodes for that T1.

Dimitri

[zeeshan qadir]

Thanks, much appreciated!!

On Sat, Jul 13, 2024 at 12:04 PM Dimitri Desmidt via Broadcom <
[e-mail]> wrote:

> Hello, A minor comment first. An Edge Node is neither active nor standby.
> An Edge Node hosts T0 (max 1) + T1 (can be many). On that... -posted to the
> "VMware NSX" community
> [image: Broadcom] <https: community.broadcom.com="">
> VMware NSX
> <https: community.broadcom.com/communities/community-home/digestviewer?communitykey="b76535ef-c5a2-474d-8270-3e83685f020e">
> Post New Message <[e-mail]>
> Re: Active /Standby 4- node edge cluster
> <https: community.broadcom.com/discussion/active-standby-4-node-edge-cluster#bm075b616e-7ac4-4a57-b687-0190ad3e140e="">
> Reply to Group
> <[e-mail]?subject=re:+active+ standby+4-+node+edge+cluster=""> Reply
> to Sender
> <https: community.broadcom.com/communities/all-discussions/postreply?messagekey="075b616e-7ac4-4a57-b687-0190ad3e140e&ListKey=85b018c7-5da6-4006-b970-018ed42bd4d9&SenderKey=2f051d34-d5a8-4efe-9acf-018e0a552aac">
> [image: Dimitri Desmidt]
> <https: community.broadcom.com/people/dimitri-desmidt="">
> Jul 13, 2024 2:03 PM
> Dimitri Desmidt <https: community.broadcom.com/people/dimitri-desmidt="">
>
> Hello,
>
> A minor comment first.
>
> An Edge Node is neither active nor standby.
>
> An Edge Node hosts T0 (max 1) + T1 (can be many).
>
> On that Edge Node each hosted T0 and T1 can be Active or Standby.
>
> Conclusion: On an Edge Node you can have a mix of "Active T0 and/or T1"
> and "Standby T0 and/or T1".
>
> Now about your question we could rephrase as: "Can I do a T0 A/S/S/S"?
>
> The answer is No.
>
> Only 2 Edge Nodes can be selected in a T0 A/S, since you can have only 1
> Edge Node for the Active role and 1 Edge Node for the Standby role.
>
> Note: On T1 A/S, it's different.
>
> You have the option "Standby Relocation".
>
> In case 1 of the Edge Node used in this T1 A/S (whatever the Edge Node
> hosting that T1 Active or the Edge Node hosting that T1 Standby", then
> another Edge Node will be automatically selected (part the Edge Cluster) to
> host that T1 so you always keep 2 Edge Nodes for that T1.
>
> Dimitri
> *Reply to Group Online
> <https: community.broadcom.com/communities/all-discussions/postreply?messagekey="075b616e-7ac4-4a57-b687-0190ad3e140e&ListKey=85b018c7-5da6-4006-b970-018ed42bd4d9">*
> *Reply to Group via Email
> <[e-mail]?subject=re:+active+ standby+4-+node+edge+cluster="">*
> *View Thread
> <https: community.broadcom.com/discussion/active-standby-4-node-edge-cluster#bm075b616e-7ac4-4a57-b687-0190ad3e140e="">*
> *Recommend
> <https: community.broadcom.com:443/discussion/active-standby-4-node-edge-cluster?messagekey="075b616e-7ac4-4a57-b687-0190ad3e140e&cmd=rate&cmdarg=add#bm075b616e-7ac4-4a57-b687-0190ad3e140e">*
> *Forward
> <https: community.broadcom.com/communities/all-discussions/forwardmessages?messagekey="075b616e-7ac4-4a57-b687-0190ad3e140e&ListKey=85b018c7-5da6-4006-b970-018ed42bd4d9">*
> *Flag as Inappropriate
> <https: community.broadcom.com/discussion/active-standby-4-node-edge-cluster?markappropriate="075b616e-7ac4-4a57-b687-0190ad3e140e#bm075b616e-7ac4-4a57-b687-0190ad3e140e">*
>
> -------------------------------------------
> Original Message:
> Sent: Jul 12, 2024 11:53 AM
> From: zeeshan qadir
> Subject: Active /Standby 4- node edge cluster
>
> Hi guys,
>
> We have two data centers, DC1 and DC2. Both are 30msec away. We are not
> using any federation or multisite in this case.
>
> Currently we have two edge nodes edge-DC1 and edge -DC2 in edge-cluster,
> edge-DC1 is active and edge-DC2 is standby.
>
> Under normal conditions, all our N/S traffic out of NSX at DC1 and DC2,
> uses edge-DC1. if edge-DC1 goes down, then edge-DC2 takes over as active,
> then all N/S traffic will use edge-DC2. Since preemption is enabled, when
> edge-DC1 comes back online, edge-DC1 takes over as active node.
>
> Everything is working fine, but I have some questions:
>
> I want to add 2 more edge nodes in edge clusters , something like this:
>
> edge1-DC1 ( active)
>
> edge2-DC1 ( standby)
>
> edge3-DC2 ( standby)
>
> Edge-DC4 ( standby)
>
> This will provide more resiliency but NSX will not allow configuring TO
> external interfaces on more than 2 edge nodes.
>
> Any idea how can we pull this off ?
>
> Thanks!!
>
>
>
>
>
> You are receiving this notification because you followed the 'Active
> /Standby 4- node edge cluster' message thread. If you do not wish to follow
> this, please click here
> <https: community.broadcom.com/higherlogic/common/unfollow.aspx?userkey="4f96a15e-9e1c-47b3-9753-b4fc709c77d3&sKey=KeyRemoved&ItemKey=d912200f-c0c0-4795-892a-0190a79d1e1c">.
>
>
> Update your email preferences
> <https: community.broadcom.com/go.aspx?c="Preferences§ion=email"> to
> choose the types of email you receive
>
> Unsubscribe from all participation emails
> <https: community.broadcom.com/higherlogic/egroups/unsubscribe.aspx?userkey="4f96a15e-9e1c-47b3-9753-b4fc709c77d3&sKey=KeyRemoved&mClass=Social">
>

[Gabriel Requejo]

Dimitri, 

Thanks for your great explanation.

My question about this is, what is the right way to expand an Edge Cluster? Move to T0 A/A??

Thanks in advance!

Gabriel

[Gabriel Requejo]

Great Explanation Dimitri.

The question is how to sort this? Move to a "T0 A/A" configuration?

Thanks in advance!

------------------------------
--
Regards,
Gabriel Requejo
Former VMware PSO Consultant
------------------------------

[Dimitri Desmidt]

You could move to T0 A/A with up to 8 Edge Nodes per T0.

HOWEVER this means you'll will end up with North/South traffic from VMs in DC1 existing via the T0 A/A so through Edge Nodes in DC1 and in DC2.

Indeed your T0 is A/A.

So you'll end up with asymmetric routing between North/South and South/North.

Maybe you don't care if DC1/DC2 are building1/building2 and there is no external stateful firewall that would break asymmetric traffic.

Maybe you do care if DC1/DC2 are Paris/London and there is external stateful firewall that would break asymmetric traffic.

In the latter, you must go with T0 A/S with EN1 in DC1 and EN2 in DC2.
Note: As discussed above, there is no ability to do T0 A/S/S with 3 Edge Nodes.

[Gabriel Requejo]

Dimitri, 

Thanks for your clear explanation.

In my case I have 2 DC in a VCF environment, so every DC its a Workload Domain, so every DC have your own NSX installation.

Just asked you because, in one of the DC has a Edge Cluster with a T0 A/S and want to expand your edge cluster to another vsphere cluster due to migration proposes. Basically they want to expand the same edge cluster to 2 vsphere cluster (1 legacy + 1 new one) move VMs (from legacy to new one) and after migration shrink Edge Cluster on the new one vsphere cluster.

Seems the only one option to acomplish this effort, its move to a T0 A/A and expand cluster to 4 nodes (2 on every vpshere cluster)

If you have a better idea, would be appreciated :)

------------------------------
--
Regards,
Gabriel Requejo
Former VMware PSO Consultant
------------------------------