What version of ESX are you using? If the ESX server is managed by Virtual Center, what version of VC?
The ports that need to be opened are different for different versions, but for ESX3.5 and VC 2.5, you need the following:
ESX: ports 443, 902, and 903
VC: port 443
For earlier versions of VC, you will probably need:
ESX: ports 443, 902, and 903
VC: port 443, 902