An ESX server does not have an IP. You have vmkernel interfaces, on which you can enable management traffic or not. The IP you see on vCenter/vSphere Client is the first assigned vmkernel for management, but it is not mandatory that your management interfaces keep this address or not.
As Avinash21 said, VMs and management interfaces does not depend on each other.
For simplicity, you CAN change the IP address, no problem at all. If you have vCenter, you may have problems and need to reconnect to the new IP. If you have DNS, you may need to reconfigure the DNS entry for this host.