VMware Tanzu Kubernetes Grid Integrated Edition

 I want to create a dev standalone management cluster on vSphere without NSX, LB and DHCP. I want to fix static IP for nodes using Node IPAM.

Achraf BENTABIB's profile image
Achraf BENTABIB posted Jan 09, 2024 09:07 AM

Hello, 

 

I want to create a dev standalone management cluster on vSphere without NSX, LB and DHCP.

So i used the configuration file as bellow with Node IPAM enabled.

 

```

AVI_CA_DATA_B64: ""

AVI_CLOUD_NAME: ""

AVI_CONTROL_PLANE_HA_PROVIDER: "false"

AVI_CONTROL_PLANE_NETWORK: ""

AVI_CONTROL_PLANE_NETWORK_CIDR: ""

AVI_CONTROLLER: ""

AVI_DATA_NETWORK: ""

AVI_DATA_NETWORK_CIDR: ""

AVI_ENABLE: "false"

AVI_LABELS: ""

AVI_MANAGEMENT_CLUSTER_CONTROL_PLANE_VIP_NETWORK_CIDR: ""

AVI_MANAGEMENT_CLUSTER_CONTROL_PLANE_VIP_NETWORK_NAME: ""

AVI_MANAGEMENT_CLUSTER_SERVICE_ENGINE_GROUP: ""

AVI_MANAGEMENT_CLUSTER_VIP_NETWORK_CIDR: ""

AVI_MANAGEMENT_CLUSTER_VIP_NETWORK_NAME: ""

AVI_PASSWORD: ""

AVI_SERVICE_ENGINE_GROUP: ""

AVI_USERNAME: ""

CLUSTER_ANNOTATIONS: 'description:,location:'

CLUSTER_CIDR: 10.96.0.0/11

CLUSTER_PLAN: dev

ENABLE_AUDIT_LOGGING: "false"

ENABLE_CEIP_PARTICIPATION: "false"

ENABLE_MHC: "false"

IDENTITY_MANAGEMENT_TYPE: none

INFRASTRUCTURE_PROVIDER: vsphere

LDAP_BIND_DN: ""

LDAP_BIND_PASSWORD: ""

LDAP_GROUP_SEARCH_BASE_DN: ""

LDAP_GROUP_SEARCH_FILTER: ""

LDAP_GROUP_SEARCH_GROUP_ATTRIBUTE: ""

LDAP_GROUP_SEARCH_NAME_ATTRIBUTE: cn

LDAP_GROUP_SEARCH_USER_ATTRIBUTE: DN

LDAP_HOST: ""

LDAP_ROOT_CA_DATA_B64: ""

LDAP_USER_SEARCH_BASE_DN: ""

LDAP_USER_SEARCH_FILTER: ""

LDAP_USER_SEARCH_NAME_ATTRIBUTE: ""

LDAP_USER_SEARCH_USERNAME: userPrincipalName

OIDC_IDENTITY_PROVIDER_CLIENT_ID: ""

OIDC_IDENTITY_PROVIDER_CLIENT_SECRET: ""

OIDC_IDENTITY_PROVIDER_GROUPS_CLAIM: ""

OIDC_IDENTITY_PROVIDER_ISSUER_URL: ""

OIDC_IDENTITY_PROVIDER_NAME: ""

OIDC_IDENTITY_PROVIDER_SCOPES: ""

OIDC_IDENTITY_PROVIDER_USERNAME_CLAIM: ""

OS_ARCH: amd64

OS_NAME: photon

OS_VERSION: "3"

SERVICE_CIDR: 10.64.0.0/13

TKG_HTTP_PROXY_ENABLED: "false"

VSPHERE_CONTROL_PLANE_DISK_GIB: "20"

VSPHERE_CONTROL_PLANE_ENDPOINT: 192.168.1.100

VSPHERE_CONTROL_PLANE_MEM_MIB: "4096"

VSPHERE_CONTROL_PLANE_NUM_CPUS: "2"

VSPHERE_DATACENTER: /dc01

VSPHERE_DATASTORE: /dc01/datastore/ca

VSPHERE_FOLDER: /dc01/vm/clusterk

VSPHERE_INSECURE: "true"

VSPHERE_NETWORK: /dc01/network/VLAN

VSPHERE_PASSWORD: XXXX

VSPHERE_RESOURCE_POOL: /dc01/host/poolx

VSPHERE_SERVER: 10.10.10.10

VSPHERE_SSH_AUTHORIZED_KEY: ssh-rsa XXXXX

VSPHERE_TLS_THUMBPRINT: ""

VSPHERE_USERNAME: email@email.com

VSPHERE_WORKER_DISK_GIB: "20"

VSPHERE_WORKER_MEM_MIB: "4096"

VSPHERE_WORKER_NUM_CPUS: "2"

WORKER_ROLLOUT_STRATEGY: ""

MANAGEMENT_NODE_IPAM_IP_POOL_GATEWAY: "192.168.1.101"

MANAGEMENT_NODE_IPAM_IP_POOL_ADDRESSES: "192.168.1.102-192.168.1.120"

MANAGEMENT_NODE_IPAM_IP_POOL_SUBNET_PREFIX: "24"

CONTROL_PLANE_NODE_NAMESERVERS: "192.168.1.110, 192.168.1.111"

WORKER_NODE_NAMESERVERS: "192.168.1.110, 192.168.1.111"

NTP_SERVERS: "192.168.1.1"

VSPHERE_TEMPLATE: "/dc01/vm/foldercustom/photon1.27.5"

```

 

But this configuration create a VM in vsphere but continue to check cloud-init with DHCP and continue to print "A start job is running for Wait for Network to be Configured ..."

 

I also notice that the mgmt cluster yaml created enable dhcp...even if used node ipam.

 

```

apiVersion: infrastructure.cluster.x-k8s.io/v1beta1

kind: VSphereMachineTemplate

metadata:

 annotations:

  vmTemplateMoid: null

 name: tkg-mgmt-vsphere-20240109144903-control-plane

 namespace: tkg-system

spec:

 template:

  spec:

   cloneMode: fullClone

   datacenter: /dc01

   datastore: /dc01/datastore/ca

   diskGiB: 20

   folder: /dc/vm/clusterk

   memoryMiB: 4096

   network:

    devices:

    - dhcp4: true

     nameservers:

     - 192.168.1.110

     - 192.168.1.111

     networkName: /dc01/network/VLAN

   numCPUs: 2

   resourcePool: /dc01/host/poolx

   server: 10.10.10.10

   storagePolicyName: ""

   template: /dc01/vm/foldercustom/photon1.27.5

```

 

I use tkg 1.1.0.

 

Can you help me please ?