Brocade Fibre Channel Networking Community

Expand all | Collapse all

G Ports in FMS mode / FICON Connections

  • 1.  G Ports in FMS mode / FICON Connections

    Posted 03-22-2019 07:46 AM

    Hi everyone,

     

    Kernel: 2.6.14.2
    Fabric OS: v7.4.1d
    Made on: Thu Jul 14 23:11:53 2016
    Flash: Sat Jun 10 13:44:08 2017
    BootProm: 1.0.11

     

    My switch is used to connect both FCP and FICON connections, which I have two seperate zones for. We have new Tape Drives that are giving us issues. A couple of problems I've encountered:

     

    1. 3 Ports are 'stuck' as G Ports. Since it is in FMS Mode, when I try to Portdisable, it disables a port 4:

     

    ODC3.Switch.C5:admin> switchshow
    switchName: ODC3.Switch.C5
    switchType: 109.1
    switchState: Online
    switchMode: Native
    switchRole: Subordinate
    switchDomain: 197
    switchId: fffcc5
    switchWwn: 10:00:c4:f5:7c:63:8b:d4
    zoning: ON (Fabric_A_Prod_V03)
    switchBeacon: OFF
    FC Router: OFF
    FC Router BB Fabric ID: 128
    Address Mode: 0
    HIF Mode: ON
    
    Index Port Address Media Speed State Proto
    ==================================================
    0 0 c50000 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5"
    1 1 c50100 id N8 No_Light FC
    2 2 c50200 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:00
    3 3 c50100 id N16 No_Light FC
    4 4 c50a00 id N16 No_Light FC
    5 5 c50c00 id N16 No_Light FC
    6 6 c50300 id N16 No_Light FC
    7 7 c50700 id N8 No_Light FC
    8 8 c50800 id N16 Online FC F-Port c0:50:76:d7:10:00:11:51
    9 9 c50400 id N16 No_Light FC
    10 10 c50a00 id N16 Online FC G-Port
    11 11 c50b00 id N16 Online FC F-Port c0:50:76:d7:10:00:11:91
    12 12 c51200 id N16 No_Light FC
    13 13 c50d00 id N16 Online FC F-Port 50:01:04:f0:00:af:93:2b
    14 14 c50e00 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:02
    15 15 c50f00 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5"
    16 16 c51000 id N8 No_Light FC
    17 17 c51100 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:30
    18 18 c51200 id N16 No_Light FC
    19 19 c51300 id N16 No_Light FC
    20 20 c51400 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:33
    21 21 c51500 id N16 Online FC F-Port c0:50:76:d7:10:00:16:11
    22 22 c51600 id N16 Online FC F-Port c0:50:76:d7:10:00:16:51
    23 23 c51700 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5" (upstream)
    24 24 c51800 -- N16 No_Module FC (No POD License) Disabled
    25 25 c51900 -- N16 No_Module FC (No POD License) Disabled
    26 26 c51a00 -- N16 No_Module FC (No POD License) Disabled
    27 27 c51b00 -- N16 No_Module FC (No POD License) Disabled
    28 28 c51c00 -- N16 No_Module FC (No POD License) Disabled
    29 29 c51d00 -- N16 No_Module FC (No POD License) Disabled
    30 30 c51e00 -- N16 No_Module FC (No POD License) Disabled
    31 31 c51f00 -- N16 No_Module FC (No POD License) Disabled
    32 32 c52000 -- N16 No_Module FC (No POD License) Disabled
    33 33 c52100 -- N16 No_Module FC (No POD License) Disabled
    34 34 c52200 -- N16 No_Module FC (No POD License) Disabled
    35 35 c52300 -- N16 No_Module FC (No POD License) Disabled
    36 36 c52400 -- N16 No_Module FC (No POD License) Disabled
    37 37 c52500 -- N16 No_Module FC (No POD License) Disabled
    38 38 c52600 -- N16 No_Module FC (No POD License) Disabled
    39 39 c52700 -- N16 No_Module FC (No POD License) Disabled
    40 40 c52800 -- N16 No_Module FC (No POD License) Disabled
    41 41 c52900 id N16 No_Light FC (No POD License) Disabled
    42 42 c52a00 id N16 No_Light FC (No POD License) Disabled
    43 43 c52b00 id N16 No_Light FC (No POD License) Disabled
    44 44 c52c00 -- N16 No_Module FC (No POD License) Disabled
    45 45 c52d00 -- N16 No_Module FC (No POD License) Disabled
    46 46 c52e00 -- N16 No_Module FC (No POD License) Disabled
    47 47 c52f00 -- N16 No_Module FC (No POD License) Disabled
    
    
    ODC3.Switch.C5:admin> portdisable 10
    
    
    ODC3.Switch.C5:admin> switchshow
    switchName: ODC3.Switch.C5
    switchType: 109.1
    switchState: Online
    switchMode: Native
    switchRole: Subordinate
    switchDomain: 197
    switchId: fffcc5
    switchWwn: 10:00:c4:f5:7c:63:8b:d4
    zoning: ON (Fabric_A_Prod_V03)
    switchBeacon: OFF
    FC Router: OFF
    FC Router BB Fabric ID: 128
    Address Mode: 0
    HIF Mode: ON
    
    Index Port Address Media Speed State Proto
    ==================================================
    0 0 c50000 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5"
    1 1 c50100 id N8 No_Light FC
    2 2 c50200 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:00
    3 3 c50100 id N16 No_Light FC
    4 4 c50a00 id N16 No_Light FC Disabled (Persistent)
    5 5 c50c00 id N16 No_Light FC
    6 6 c50300 id N16 No_Light FC
    7 7 c50700 id N8 No_Light FC
    8 8 c50800 id N16 Online FC F-Port c0:50:76:d7:10:00:11:51
    9 9 c50400 id N16 No_Light FC
    10 10 c50a00 id N16 Online FC G-Port
    11 11 c50b00 id N16 Online FC F-Port c0:50:76:d7:10:00:11:91
    12 12 c51200 id N16 No_Light FC
    13 13 c50d00 id N16 Online FC F-Port 50:01:04:f0:00:af:93:2b
    14 14 c50e00 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:02
    15 15 c50f00 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5"
    16 16 c51000 id N8 No_Light FC
    17 17 c51100 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:30
    18 18 c51200 id N16 No_Light FC
    19 19 c51300 id N16 No_Light FC
    20 20 c51400 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:33
    21 21 c51500 id N16 Online FC F-Port c0:50:76:d7:10:00:16:11
    22 22 c51600 id N16 Online FC F-Port c0:50:76:d7:10:00:16:51
    23 23 c51700 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5" (upstream)
    24 24 c51800 -- N16 No_Module FC (No POD License) Disabled
    25 25 c51900 -- N16 No_Module FC (No POD License) Disabled
    26 26 c51a00 -- N16 No_Module FC (No POD License) Disabled
    27 27 c51b00 -- N16 No_Module FC (No POD License) Disabled
    28 28 c51c00 -- N16 No_Module FC (No POD License) Disabled
    29 29 c51d00 -- N16 No_Module FC (No POD License) Disabled
    30 30 c51e00 -- N16 No_Module FC (No POD License) Disabled
    31 31 c51f00 -- N16 No_Module FC (No POD License) Disabled
    32 32 c52000 -- N16 No_Module FC (No POD License) Disabled
    33 33 c52100 -- N16 No_Module FC (No POD License) Disabled
    34 34 c52200 -- N16 No_Module FC (No POD License) Disabled
    35 35 c52300 -- N16 No_Module FC (No POD License) Disabled
    36 36 c52400 -- N16 No_Module FC (No POD License) Disabled
    37 37 c52500 -- N16 No_Module FC (No POD License) Disabled
    38 38 c52600 -- N16 No_Module FC (No POD License) Disabled
    39 39 c52700 -- N16 No_Module FC (No POD License) Disabled
    40 40 c52800 -- N16 No_Module FC (No POD License) Disabled
    41 41 c52900 id N16 No_Light FC (No POD License) Disabled
    42 42 c52a00 id N16 No_Light FC (No POD License) Disabled
    43 43 c52b00 id N16 No_Light FC (No POD License) Disabled
    44 44 c52c00 -- N16 No_Module FC (No POD License) Disabled
    45 45 c52d00 -- N16 No_Module FC (No POD License) Disabled
    46 46 c52e00 -- N16 No_Module FC (No POD License) Disabled
    47 47 c52f00 -- N16 No_Module FC (No POD License) Disabled
    
    
    ODC3.Switch.C5:admin> portenable 10
    
    
    ODC3.Switch.C5:admin> switchshow
    switchName: ODC3.Switch.C5
    switchType: 109.1
    switchState: Online
    switchMode: Native
    switchRole: Subordinate
    switchDomain: 197
    switchId: fffcc5
    switchWwn: 10:00:c4:f5:7c:63:8b:d4
    zoning: ON (Fabric_A_Prod_V03)
    switchBeacon: OFF
    FC Router: OFF
    FC Router BB Fabric ID: 128
    Address Mode: 0
    HIF Mode: ON
    
    Index Port Address Media Speed State Proto
    ==================================================
    0 0 c50000 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5"
    1 1 c50100 id N8 No_Light FC
    2 2 c50200 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:00
    3 3 c50100 id N16 No_Light FC
    4 4 c50a00 id N16 No_Light FC
    5 5 c50c00 id N16 No_Light FC
    6 6 c50300 id N16 No_Light FC
    7 7 c50700 id N8 No_Light FC
    8 8 c50800 id N16 Online FC F-Port c0:50:76:d7:10:00:11:51
    9 9 c50400 id N16 No_Light FC
    10 10 c50a00 id N16 Online FC G-Port
    11 11 c50b00 id N16 Online FC F-Port c0:50:76:d7:10:00:11:91
    12 12 c51200 id N16 No_Light FC
    13 13 c50d00 id N16 Online FC F-Port 50:01:04:f0:00:af:93:2b
    14 14 c50e00 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:02
    15 15 c50f00 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5"
    16 16 c51000 id N8 No_Light FC
    17 17 c51100 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:30
    18 18 c51200 id N16 No_Light FC
    19 19 c51300 id N16 No_Light FC
    20 20 c51400 id N16 Online FC F-Port 50:06:0e:80:07:e0:72:33
    21 21 c51500 id N16 Online FC F-Port c0:50:76:d7:10:00:16:11
    22 22 c51600 id N16 Online FC F-Port c0:50:76:d7:10:00:16:51
    23 23 c51700 id 8G Online FC LS E-Port 10:00:c4:f5:7c:56:f2:d1 "ODC1.Switch.B5" (upstream)
    24 24 c51800 -- N16 No_Module FC (No POD License) Disabled
    25 25 c51900 -- N16 No_Module FC (No POD License) Disabled
    26 26 c51a00 -- N16 No_Module FC (No POD License) Disabled
    27 27 c51b00 -- N16 No_Module FC (No POD License) Disabled
    28 28 c51c00 -- N16 No_Module FC (No POD License) Disabled
    29 29 c51d00 -- N16 No_Module FC (No POD License) Disabled
    30 30 c51e00 -- N16 No_Module FC (No POD License) Disabled
    31 31 c51f00 -- N16 No_Module FC (No POD License) Disabled
    32 32 c52000 -- N16 No_Module FC (No POD License) Disabled
    33 33 c52100 -- N16 No_Module FC (No POD License) Disabled
    34 34 c52200 -- N16 No_Module FC (No POD License) Disabled
    35 35 c52300 -- N16 No_Module FC (No POD License) Disabled
    36 36 c52400 -- N16 No_Module FC (No POD License) Disabled
    37 37 c52500 -- N16 No_Module FC (No POD License) Disabled
    38 38 c52600 -- N16 No_Module FC (No POD License) Disabled
    39 39 c52700 -- N16 No_Module FC (No POD License) Disabled
    40 40 c52800 -- N16 No_Module FC (No POD License) Disabled
    41 41 c52900 id N16 No_Light FC (No POD License) Disabled
    42 42 c52a00 id N16 No_Light FC (No POD License) Disabled
    43 43 c52b00 id N16 No_Light FC (No POD License) Disabled
    44 44 c52c00 -- N16 No_Module FC (No POD License) Disabled
    45 45 c52d00 -- N16 No_Module FC (No POD License) Disabled
    46 46 c52e00 -- N16 No_Module FC (No POD License) Disabled
    47 47 c52f00 -- N16 No_Module FC (No POD License) Disabled
    
    
    
    ODC3.Switch.C5:admin> errshow -r
    Fabric OS: v7.4.1d
    2019/03/21-12:52:09, [FICU-1021], 684, FID 128, INFO, ODC3.Switch.C5, Port Addrs (0x0A) have been Unblocked by CLI.
    
    
    
    2019/03/21-12:51:54, [FICU-1020], 683, FID 128, INFO, ODC3.Switch.C5, Port Addrs (0x0A) have been Blocked by CLI.

     

    2. These connections are all FCP and FICON, no TCPIP at all. With that said, is there a function to remember paths?  Meaning if a device connects and establishes with the host, will the path be 'remembered' by its WWN number?  

     

    This was experienced when testing one drive port and switch port at a time:  Port 5, when connected to the switch and brought online from the Mainframe, finds a path to a drive that’s expected at Port 12, though Port 12 was not connected. This happens on multiple ports

     

    I hate to reboot the switch (I have never had to since I deployed them into production), but if its neccessary to get my ports out of G Port state or 'forget' any paths, I would not hesitate to do so. Has the community encountered these issues before and what worked for them? Note, I also have sent the SupportSave to Brocade. If they see anything, I will surely post the reply... if anyone runs into this issue.

     

    Thanks,

     

    David


    #GPortFMSFICONSTKTAPE
    #BrocadeFibreChannelNetworkingCommunity


  • 2.  Re: G Ports in FMS mode / FICON Connections

    Posted 03-28-2019 06:31 AM

    Hi Everyone,

     

    Just an update. We found a setting in the configuration for this switch that was turned on:  The WWN PID Mode

     

    Switch.admin> configshow | grep -i pid
    fabric.ops.mode.pidFormat:1
    fabric.wwnPidMode:1

     

    Why this was turned on, I'm not sure. But it seems to be very promising as the reason why I saw so very weird behavior. Apparently this setting assigns a port to a device's WWN at first connection and persistently remembers it. I have disabled the setting, but it looks like I need to power cycle or reboot to free up my 'stuck' ports.

     

    David

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 3.  Re: G Ports in FMS mode / FICON Connections

    Posted 04-05-2019 01:34 PM

    Hello,

     

    to be honest i dont have a lot of experience with FICON infra. 

    I've reviewed Brocade Favir OS FICON adminsitrator guide for FOS 7.4

     

    There is statement:

     

    Do not enable WWN-based persistent PIDs for FICON environments.

     

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 4.  Re: G Ports in FMS mode / FICON Connections

    Posted 04-08-2019 12:14 PM
      |   view attached

    The WWN Based persistent PID feature tells the switch to persistently bind a port address to a WWN. When enabled for FICON, this is a ticking time bomb. Although all devices and channels login to the name server with a WWN, a WWN in FICON has little to no meaning.

     

    The IODF, created with HCD, effectively does what zoning in open systems does. HCD uses the upper 2 byes of the fibre channel address (PID). This is referred to as a link address in HCD. See attached for a discussion on how link addressing and port addressing works in FICON.

     

    If the PID is bound to a WWN, then when that device is removed and a new device connected to the same port, it will get a new address because it has a new WWN and the previous address is bound to the previous WWN. This will conflict with what is in the gen. Furthermore, it may get a different ALPA.

     

    Example: A push pull was done to upgrade a storage array. The system programmer thinks all the port addresses on the ports remained the same and therefore does not have to make any HCD changes. With persistent PID binding to the WWN, the port address will in fact change because the interface on the storage array will have a new WWN.

     

    Once this happens, you can't simply disable PID to WWN binding because the PID for the port already changed. You will need to use the portaddress with the --unbind option followed by portaddress with the --bind option to set the port address on the port to match what is the expected link address in HCD


    #BrocadeFibreChannelNetworkingCommunity

    Attachment(s)