Its not that bad. I did many times. You need to install what is required. Ex: SSO,Inventory Service, vCenter Server and web client is sufficient somecases.
Well, I would consider performing the following if you have an existing VC database.
- Take the DB back up file.
- Install SQL and Restore the DB on new server.
- Install VC and create ODBC links etc..