I experience the same issue and followed below steps to fix the issue:
1. Log in to vCenter Server directly through Terminal Services or a Remote KVM and attempt a connection using the vSphere Client from this system. If this method works, a firewall may be preventing the console from connecting.
2. Configure your firewall to allow communications between the ESXi/ESX host and the workstation running the vSphere Client.
Note: If port 903 is not open or cannot be opened in your environment, enable the vmauthd proxy. This forces remote console communication to be sent on port 902 on the Service Console, instead of 903. By enabling this setting there may be degradation in the performance under heavy usage while communicating to the ESXi/ESX host service console.
Note: In ESXi 4.x, 5.x and 6.0, vmauthd.server.alwaysProxy is, by default, set to true.
To enable the proxy:
a. Log into the ESX host's service console as root.
b. Open /etc/vmware/config using a text editor.
c. Add this line to the file:
vmauthd.server.alwaysProxy = "TRUE"
d. In ESX, run this command to restart xinetd:
service xinetd restart
3. Verify the ESXi/ESX firewall policy:
For ESXi 5.x and 6.0, see About the ESXi 5.x and 6.0 firewall (2005284).
For ESX 3.x to 4.x, see Troubleshooting the firewall policy on an ESX host (1003634).
4. Verify that the ESXi/ESX host and the workstation running the vSphere Client are correctly synced to an NTP service. This is required to satisfy SSL handshaking between the vSphere Client or and the ESXi/ESX host. For more information, see Verifying time synchronization across an ESXi/ESX host environment (1003736).
5. DNS problems are a common cause of virtual machine console problems. Verify name resolution in your environment. For more information, see:
- Identifying issues with and setting up name resolution on ESXi/ESX Server (1003735)
- Configuring name resolution for VMware vCenter Server (1003713)
After verifying DNS, open a command prompt on the vSphere Client machine and run these commands:
ipconfig /flushdns
ipconfig /registerdns