Please download driver from the below link where you can find VMware ESXi 5.0 Driver for Brocade HBAs and CNAs.
http://downloads.vmware.com/d/details/dt_esxi50_brocade_bfa_3010/dHRAYnRoandiZHAlJQ==
And please refer below screen shot which I taken from my lab environment. I think it will go smoothly.
CCho-MBP:Downloads ccho$ ls -l BCD-bfa-3.0.1.0-00000-503860.zip
-rw-r--r--@ 1 ccho staff 2223128 Feb 14 22:04 BCD-bfa-3.0.1.0-00000-503860.zip
CCho-MBP:Downloads ccho$ scp BCD-bfa-3.0.1.0-00000-503860.zip root@172.16.140.162:/tmp
Password:
BCD-bfa-3.0.1.0-00000-503860.zip 100% 2171KB 2.1MB/s 00:00
CCho-MBP:Downloads ccho$ ssh root@172.16.140.162
Password:
The time and date of this login have been sent to the system logs.
VMware offers supported, powerful system administration tools. Please
see www.vmware.com/go/sysadmintools for details.
The ESXi Shell can be disabled by an administrative user. See the
vSphere Security documentation for more information.
~ # cd /tmp
/tmp # unzip BCD-bfa-3.0.1.0-00000-503860.zip
Archive: BCD-bfa-3.0.1.0-00000-503860.zip
inflating: BCD-bfa-3.0.1.0-00000-offline_bundle-503860.zip
inflating: scsi-bfa-3.0.1.0-1OEM.500.0.0.472560.x86_64.vib
inflating: doc/README.txt
/tmp # unzip BCD-bfa-3.0.1.0-00000-offline_bundle-503860.zip
Archive: BCD-bfa-3.0.1.0-00000-offline_bundle-503860.zip
inflating: index.xml
inflating: vendor-index.xml
inflating: metadata.zip
inflating: vib20/scsi-bfa/Brocade_bootbank_scsi-bfa_3.0.1.0-1OEM.500.0.0.472560.vib
/tmp # esxcli software vib list > esxcli_software_vib_list.txt
/tmp # ls -l
-rw-r--r-- 1 root root 2223128 Feb 13 08:53 BCD-bfa-3.0.1.0-00000-503860.zip
-rw-r--r-- 1 root root 1110239 Feb 13 08:54 BCD-bfa-3.0.1.0-00000-offline_bundle-503860.zip
drwxrwxrwx 1 root root 512 Feb 13 08:54 doc
-rw-r--r-- 1 root root 6076 Feb 13 08:56 esxcli_software_vib_list.txt
-rw-r--r-- 1 root root 320 Feb 13 08:54 index.xml
-rw-r--r-- 1 root root 2630 Feb 13 08:54 metadata.zip
-rw-r--r-- 1 root root 1110134 Feb 13 08:54 scsi-bfa-3.0.1.0-1OEM.500.0.0.472560.x86_64.vib
-rw-r--r-- 1 root root 2097152 Feb 13 08:18 test
-rw-r--r-- 1 root root 387 Feb 13 08:54 vendor-index.xml
drwxr-xr-x 1 root root 512 Feb 13 08:54 vib20
drwx------ 1 root root 512 Feb 10 10:49 vmware-root
Remarks) I am not sure which one is correct but I think you can only install one of two. Refer the second output. It says that host is not changed and reboot is not required. Try one by one.
/tmp # esxcli software vib install -v /tmp/scsi-bfa-3.0.1.0-1OEM.500.0.0.472560.x86_64.vib
Installation Result
Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
Reboot Required: true
VIBs Installed: Brocade_bootbank_scsi-bfa_3.0.1.0-1OEM.500.0.0.472560
VIBs Removed:
VIBs Skipped:
/tmp # esxcli software vib install -v /tmp/vib20/scsi-bfa/Brocade_bootbank_scsi-bfa_3.0.1.0-1OEM.500.0.0.472560.vib
Installation Result
Message: Host is not changed.
Reboot Required: false
VIBs Installed:
VIBs Removed:
VIBs Skipped: Brocade_bootbank_scsi-bfa_3.0.1.0-1OEM.500.0.0.472560
~ # esxcli software vib list | grep -i brocade
scsi-bfa 3.0.1.0-1OEM.500.0.0.472560 Brocade VMwareCertified 2012-02-13
Will this help of you? I hope so.