ESXi

 View Only
Expand all | Collapse all

Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

  • 1.  Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Jul 31, 2016 07:54 AM

    Hi.

    New installation. We have the following:

    IBM vb3700 San connected via SAS

    3x Lenovo x3650 M5's with N2225 HBA's (two in each host).


    So each host connects via two separate HBAs to each SAN controller.

    On the san, each HBA is showing and mapped to the correct host. However, in VMWare, it is only seeing one path, and one HBA.

    On the san, the OS type selected for each host is generic (as specified in IBM document).

    Am I missing something? I should be seeing two connections from each host to the v3700, only the one active path shows.



  • 2.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Jul 31, 2016 11:25 PM

    Can you attach a image including your storage adapters ?



  • 3.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 02, 2016 02:34 AM

    Ok, so from the san

    within vmware

    Each host is the same. Only one HBA seems to be working.

    The setup is like the following with each host

    had vmware support look at it and they are stumped. I have followed the redbooks setup guide for this

    Here is the information VMWare has collected in-case it helps anyone else (note the driver is a later version)

    ESXi Version : VMware ESXi 6.0.0 Update 2 build-3620759

    Hostname : localhost

    Host IP : 127.0.0.1

    Date : Tue Aug  2 01:32:58 UTC 2016

    Uptime : 1:32:58 up 2 days, 21:24:06, load average: 0.01, 0.01, 0.01

    Hardware : Lenovo System x3650 M5: -[5462AC1]-

    [root@localhost:~] esxcfg-scsidevs -a

    vmhba0  lsi_msgpt3        link-n/a sas.500605b00b8935f0 (0000:0b:00.0) Avago (LSI Logic) Fusion-MPT 12GSAS SAS3008 PCI-Express

    vmhba1  lsi_msgpt3        link-n/a sas.500605b00b893750 (0000:01:00.0) Avago (LSI Logic) Fusion-MPT 12GSAS SAS3008 PCI-Express

    vmhba2  lsi_mr3 link-n/a  sas.500605b00baf13e0 (0000:15:00.0) Avago (LSI / Symbios Logic) MegaRAID SAS Fury Controller

    vmhba32 usb-storage       link-n/a usb.vmhba32 () USB

    [root@localhost:~] vmkload_mod -s lsi_msgpt3 | grep Version

    Version: 12.00.00.00-1OEM.600.0.0.2768847

    [root@localhost:~] vmkchdev -l | grep -i vmhba0

    0000:0b:00.0 1000:0097 1014:04be vmkernel vmhba0

    + As per the VMware HCL, the driver is not compatible

    http://www.vmware.com/resources/compatibility/detail.php?deviceCategory=io&productid=39344&deviceCategory=io&details=1&releases=275&VID=1000&DID=0097&SVID=1014&SSID=04be&page=1&display_interval=10&sortColumn=Partner&sortOrder=Asc

    esxcfg-scsidevs -A

    vmhba1 naa.6005076300808e0c5800000000000000

    vmhba1 naa.6005076300808e0c5800000000000001

    vmhba1 naa.6005076300808e0c5800000000000002

    vmhba32     mpx.vmhba32:C0:T0:L0

    [root@localhost:/vmfs/volumes/5782af9e-9b746f00-7f35-0894ef133f28/Logs/Host3] esxcli software vib list | grep -i lsi-msgpt3

    lsi-msgpt3 12.00.00.00-1OEM.600.0.0.2768847 Avago   VMwareCertified   2016-07-10

    lsu-lsi-lsi-msgpt3-plugin 1.0.0-1vmw.600.0.0.2494585 VMware  VMwareCertified   2016-07-10



  • 4.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 03, 2016 02:21 AM

    That is really strange, anyway have you tried reboot your hosts ? Reboot the host worked in this another thread: dW:Eserver:IBM System Storage:v3700 Direct SAS Host Attach - IBM System Storage Forum



  • 5.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 04, 2016 09:29 PM

    Yes, rebooted all the hosts. I have IBM looking in to it now. They recommended the following IBM Port Mapping Instructions For Direct-Attached SAS Hosts - United States which I did, but makes no difference, even after a reboot.



  • 6.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 05, 2016 02:48 AM

    Have you tried invert the cables ? For example, the cable connected on node canister 1 change to connect to canister #2 ?



  • 7.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 05, 2016 09:40 AM

    Not yet. I'm about to start removing cables as I'm getting no-where with support.



  • 8.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 06, 2016 05:04 PM

    Hi,

    were you able to find the solution to the problem?



  • 9.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 07, 2016 08:13 AM

    Not yet.

    One thing I have noticed. From the BIOS of the server, I can load each HBA's bios and see the connected SAN. In this state, the SAN correctly reports both HBA's as active. As soon as ESXi starts booting, HBA0 goes inactive, and HBA1 active.

    Flicked this back to vmware support.

    In the meantime, I am going to attempt to upgrade the firmware and drivers.



  • 10.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 07, 2016 09:23 AM

    Can you please update this post with results? How are things with VMware support go? Are they of any help?



  • 11.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 08, 2016 12:42 AM

    I'll update when I hear back from VMWare. it's looking like a VMWare driver/firmware issue with the hba's.

    not sure if you can help, but what's the easiest way to upgrade the drivers in vmware, and actually flash the firmware? Seems I can only do it directly from a linux/windows machiene.



  • 12.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path
    Best Answer

    Posted Aug 08, 2016 05:05 AM

    I have resolved the issue.

    It seems the Lenovo VMWware Image is shipping with the wrong driver.

    Installed the following as an update: VMware Compatibility Guide - I/O Device Search

    I used the lsi-msgpt3 version, as the mpt3sas version was not being used?

    Updated from version 12 to version 13 https://my.vmware.com/group/vmware/details?downloadGroup=DT-ESXI60-AVAGO-LSI-MSGPT3-13000000-1OEM&productId=491

    Rebooted and now I have multipathing. The adapter has changed in VMWare from MT Fusion 12GB SAS to Avago (LSI) 3008. Not sure what's going on there, since it is an MT Fusion?

    Both paths now show.

    Here is another host I have not updated yet for comparison

    Thanks for your help.



  • 13.  RE: Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

    Posted Aug 26, 2016 06:27 AM

    Hi,

    The same problem.

    - 2 Servers x3550 M5 with HBA SAS N2225.

    - 1 Storwize V3700

    I update the Driver.