I have removed and readded hosts from VC many times without issue.
When you add them back in, it will ask you where you want the virtual machines to be shown in the "Virtual machines and templates" view. - i.e. it won't retain their position, which is a bit of pain.
If you're using a license server, I'd recommend you set your hosts to unlicensed before you change the ip address (which will return the license to the license server), and relicense after the change. I've found problems in the past where licences "get lost" if you don't do it this way.
Also as DNS is critical, you want to make sure
you can resolve your hosts by hostname, fully qualified name and reverse lookup.
Good luck.
If you found this helpful please consider the use of the Helpful /Correct buttons to award points. Thanks !!