vSAN1

 View Only
  • 1.  [VSAN] remove witness interface

    Posted Jun 13, 2023 01:02 PM

    Hello,

     

    years ago I configured a vSAN stretched cluster, the witness was on a remote site so I used a dedicated witness interface with a dedicated route as described here:

    https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.vsan-planning.doc/GUID-03204C22-C069-4A18-AD96-26E1E1155D21.html

    Now I converted the stretched cluster to a single site and I wanted to remove the dedicated interface. When I try this on one node the vSAN health service complains abut having to separate cluster partitions. By re-adding the witness interface, the alarm goes away, 

    What is the correct procedure to remove those vSAN witness interfaces?

     

     



  • 2.  RE: [VSAN] remove witness interface

    Posted Jun 13, 2023 01:17 PM

     Can you show the output of the following on the node that you tried removing this? (feel free to change/obfuscate IPs etc.):

    #esxcli vsan network list

    #esxcli vsan cluster unicastagent list

    And can you also indicate what you are removing e.g. are you removing whole vmk or just untagging a service (vsan/witness) from it and if so, which?



  • 3.  RE: [VSAN] remove witness interface

    Posted Jun 13, 2023 01:54 PM

    I tried again, got the partition warning, but after a couple of minutes it went away,

     

    I'm removing the witness traffic from the interface, not the whole vmk:

    esxcli vsan network ip remove -i vmk0

    I will now post the output of the commands, that I captured before the removal.

     

     



  • 4.  RE: [VSAN] remove witness interface

    Posted Jun 13, 2023 01:55 PM

    Interface
    VmkNic Name: vmk0
    IP Protocol: IP
    Interface UUID: 52656dea-68e1-186e-7ca9-797f3a2f3372
    Agent Group Multicast Address: 224.2.3.4
    Agent Group IPv6 Multicast Address: ff19::2:3:4
    Agent Group Multicast Port: 23451
    Master Group Multicast Address: 224.1.2.3
    Master Group IPv6 Multicast Address: ff19::1:2:3
    Master Group Multicast Port: 12345
    Host Unicast Channel Bound Port: 12321
    Data-in-Transit Encryption Key Exchange Port: 0
    Multicast TTL: 5
    Traffic Type: witness

    Interface
    VmkNic Name: vmk3
    IP Protocol: IP
    Interface UUID: 5240662c-6f5e-fe12-0937-9c6041c2335a
    Agent Group Multicast Address: 224.2.3.4
    Agent Group IPv6 Multicast Address: ff19::2:3:4
    Agent Group Multicast Port: 23451
    Master Group Multicast Address: 224.1.2.3
    Master Group IPv6 Multicast Address: ff19::1:2:3
    Master Group Multicast Port: 12345
    Host Unicast Channel Bound Port: 12321
    Data-in-Transit Encryption Key Exchange Port: 0
    Multicast TTL: 5
    Traffic Type: vsan



  • 5.  RE: [VSAN] remove witness interface

    Posted Jun 13, 2023 02:01 PM
      |   view attached

    For some reason I'm not able to post the results of the esxcli vsan cluster unicastagent list command. will add it as txt file

    Attachment(s)

    txt
    vsan.txt   3 KB 1 version


  • 6.  RE: [VSAN] remove witness interface

    Posted Jun 13, 2023 02:38 PM

    At the end I was able to remove all witness interfaces from the 5 node cluster.

    Only the first and the fourth removal caused a temporary partition of the cluster that was cleared after a couple of minutes.