Brocade Fibre Channel Networking Community

Expand all | Collapse all

Port Throttled and Invalid_Word Errors

  • 1.  Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 11:19 AM

    I have two switches that I can't get connected.  Here are the details:

     

    Switch #1
    ===================
    Brocade 4900 (HP StorageWorks 4/64)
    FOS 6.4.3
    4GB transceiver

     

    Switch #2
    ===================
    Brocade 6510 (HP StorageWorks SN6000B)
    FOS 7.2.1d
    16GB transceiver

     

    I'm getting a "Disabled (Port Throttled)" error on the 6510 when I connect the switches with the default configuration. I've tried changing the port from 16GB to 4GB  but get a ton of "Invalid_word" errors. I've replaced the fiber jumper and different ports/transceivers but can't get them talking. I tried setting the fill word but that apparently only applies to 8GB transceivers. Here are the port configs for both switches. What am I missing?

     

    Brocade 4900 -- portcfgshow 26
    Area Number: 26
    Speed Level: AUTO(HW)
    Fill Word: 0(Idle-Idle)
    AL_PA Offset 13: OFF
    Trunk Port ON
    Long Distance OFF
    VC Link Init OFF
    Locked L_Port OFF
    Locked G_Port OFF
    Disabled E_Port OFF
    Locked E_Port OFF
    ISL R_RDY Mode OFF
    RSCN Suppressed OFF
    Persistent Disable OFF
    LOS TOV enable OFF
    NPIV capability ON
    QOS E_Port OFF
    Port Auto Disable: OFF
    Mirror Port OFF
    F_Port Buffers OFF
    Fault Delay: 0(R_A_TOV)
    NPIV PP Limit: 126

     

    Brocade 6510 -- portcfgshow 23
    Area Number: 23
    Octet Speed Combo: 1(16G|8G|4G|2G)
    Speed Level: 4G
    AL_PA Offset 13: OFF
    Trunk Port ON
    Long Distance OFF
    VC Link Init OFF
    Locked L_Port OFF
    Locked G_Port OFF
    Disabled E_Port OFF
    Locked E_Port OFF
    ISL R_RDY Mode OFF
    RSCN Suppressed OFF
    Persistent Disable OFF
    LOS TOV enable OFF
    NPIV capability ON
    QOS Port AE
    Port Auto Disable: OFF
    Rate Limit OFF
    EX Port OFF
    Mirror Port OFF
    SIM Port OFF
    Credit Recovery ON
    F_Port Buffers OFF
    E_Port Credits OFF
    Fault Delay: 0(R_A_TOV)
    NPIV PP Limit: 126
    CSCTL mode: OFF
    D-Port mode: OFF
    D-Port over DWDM: OFF
    Compression: OFF
    Encryption: OFF
    FEC: ON
    Non-DFE: OFF

     


    #storagenetworking
    #BrocadeFibreChannelNetworkingCommunity
    #fibrechannel
    #san


  • 2.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 11:43 AM

    David,

     

    what type of SFP+ are you use in 6510 ? 8G or 16G ?

     

    additional, i would suggest to upgrade the 4900 to latest release 6.4.3h and the 6510 to 7.2.1g


    #BrocadeFibreChannelNetworkingCommunity


  • 3.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 11:49 AM

     

    what type of SFP+ are you use in 6510 ? 8G or 16G ?

     

      16GB.  Should I try an 8GB transceiver?

     

    Additional, i would suggest to upgrade the 4900 to latest release 6.4.3h and the 6510 to 7.2.1g

     
      I would but the 4900 will be decom'd shortly and coordinating downtime for connected hosts is a bit of a challenge.  
     
    FWIW, my plan is to connect the 6510 to this fabric and get the zoning info and then cutover connections one at a time.  I'll decom the 4900 after I move the last connection.
     

    #BrocadeFibreChannelNetworkingCommunity


  • 4.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 11:57 AM

    David,

     

    about the SFP, please see my second post, and yes you shold use 8G.

     

    about fillword, have you tried to set on 4900 Mode 3 ?

     

    unplug the FC Cable

    portcfgpersistentdisable port_number

    portcfgfillword port_number

    portcfgpersistentenable port_number

    plug the cable back

     

    -> I would but the 4900 will be decom'd shortly and coordinating downtime for connected hosts is a bit of a challenge.  

     

    firmwaredownload is no-disruptive.


    #BrocadeFibreChannelNetworkingCommunity


  • 5.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 12:40 PM

    Well, before I saw your response I installed an 8GB transceiver in the 6510 and performed a portcfgdefault on the port.  It connected and successfully downloaded fabric information (yay!).  What's curious, though not really a problem, is that both sides connected at 2GB instead of 4GB (the lowest-common demonimator).  

     

    Is there anything else I need to do?

     

    Here's a portshow from the 6510

    portIndex: 23
    portName: port23
    portHealth: HEALTHY

    Authentication: None
    portDisableReason: None
    portCFlags: 0x1
    portFlags: 0x10000907 PRESENT ACTIVE E_PORT G_PORT U_PORT LOGICAL_ONLINE LOGI
    N
    LocalSwcFlags: 0x0
    portType: 24.0
    POD Port: Port is licensed
    portState: 1 Online
    Protocol: FC
    portPhys: 6 In_Sync portScn: 16 E_Port
    port generation number: 418
    state transition count: 416

    portId: 161700
    portIfId: 43020013
    portWwn: 20:17:50:eb:1a:ea:3e:42
    portWwn of device(s) connected:

    Distance: normal
    portSpeed: N2Gbps

    FEC: Inactive
    Credit Recovery: Inactive
    LE domain: 0
    FC Fastwrite: OFF
    Interrupts: 0 Link_failure: 0 Frjt: 0
    Unknown: 0 Loss_of_sync: 0 Fbsy: 0
    Lli: 0 Loss_of_sig: 0
    Proc_rqrd: 3 Protocol_err: 0
    Timed_out: 0 Invalid_word: 0
    Rx_flushed: 0 Invalid_crc: 0
    Tx_unavail: 0 Delim_err: 0
    Free_buffer: 0 Address_err: 0
    Overrun: 0 Lr_in: 0
    Suspended: 0 Lr_out: 0
    Parity_err: 0 Ols_in: 0
    2_parity_err: 0 Ols_out: 0
    CMI_bus_err: 0


    #BrocadeFibreChannelNetworkingCommunity


  • 6.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 01:08 PM

    is port 23 on 6510 the ISL port to 4900 ?

     

    ->portSpeed: N2Gbps

     

    the port negotiated at 2Gb with.

     

    are you sure on the 4900 th eSFP inserted is 4G ?

     

    please post "sfpshow" from the port in question on 4900


    #BrocadeFibreChannelNetworkingCommunity


  • 7.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 01:59 PM

    Here's the port connected to the 6150, negotiated at 2GB.  I Googled the vendor PN and it definitely seems to be a 4GB transceiver

     

    Identifier: 3 SFP
    Connector: 7 LC
    Transceiver: 150c402001000000 100,200,400_MB/s M5,M6 sw Inter_dist
    Encoding: 1 8B10B
    Baud Rate: 42 (units 100 megabaud)
    Length 9u: 0 (units km)
    Length 9u: 0 (units 100 meters)
    Length 50u: 15 (units 10 meters)
    Length 62.5u:7 (units 10 meters)
    Length Cu: 0 (units 1 meter)
    Vendor Name: FINISAR CORP.
    Vendor OUI: 00:90:65
    Vendor PN: FTLF8524P2BNV-HP
    Vendor Rev: A
    Wavelength: 850 (units nm)
    Options: 0032 Loss_of_Sig,Tx_Disable
    BR Max: 0
    BR Min: 0
    Serial No: PEK1HSU
    Date Code: 081106
    DD Type: 0x68
    Enh Options: 0xd8
    Status/Ctrl: 0x82
    Alarm flags[0,1] = 0x5, 0x40
    Warn Flags[0,1] = 0x5, 0x40
    Alarm Warn
    low high low high
    Temperature: 39 Centigrade -25 95 -20 90
    Current: 5.490 mAmps 1.000 17.000 2.000 14.000
    Voltage: 3313.4 mVolts 2700.0 3900.0 2900.0 3700.0
    RX Power: -9.3 dBm (116.8 uW) 10.0 uW 1259.0 uW 15.8 uW 794.0 uW
    TX Power: -4.6 dBm (346.9 uW) 67.0 uW 631.0 uW 79.0 uW 631.0 uW

     

    And here's the one on the 6150:

     

    Identifier: 3 SFP
    Connector: 7 LC
    Transceiver: 540c404000000000 2,4,8_Gbps M5,M6 sw Short_dist
    Encoding: 1 8B10B
    Baud Rate: 85 (units 100 megabaud)
    Length 9u: 0 (units km)
    Length 9u: 0 (units 100 meters)
    Length 50u (OM2): 5 (units 10 meters)
    Length 50u (OM3): 0 (units 10 meters)
    Length 62.5u:2 (units 10 meters)
    Length Cu: 0 (units 1 meter)
    Vendor Name: HP-F BROCADE
    Vendor OUI: 00:05:1e
    Vendor PN: AJ716B
    Vendor Rev: A
    Wavelength: 850 (units nm)
    Options: 003a Loss_of_Sig,Tx_Fault,Tx_Disable
    BR Max: 0
    BR Min: 0
    Serial No: UAF413410000PRU
    Date Code: 131011
    DD Type: 0x68
    Enh Options: 0xfa
    Status/Ctrl: 0x82
    Alarm flags[0,1] = 0x5, 0x0
    Warn Flags[0,1] = 0x5, 0x0
    Alarm Warn
    low high low high
    Temperature: 49 Centigrade -10 90 -5 85
    Current: 8.082 mAmps 1.000 17.000 2.000 14.000
    Voltage: 3259.1 mVolts 2900.0 3700.0 3000.0 3600.0
    RX Power: -17.9 dBm (16.2 uW) 10.0 uW 1258.9 uW 15.8 uW 1000.0 uW
    TX Power: -3.4 dBm (460.0 uW) 125.9 uW 631.0 uW 158.5 uW 562.3 uW


    #BrocadeFibreChannelNetworkingCommunity


  • 8.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 05:57 PM
    I would start worrying about the very low RX db values here. These would most likley clock up a fair amount of port errors. The SFP is unrelated to the fillword as it is tied to the ASIC. Thats where the serdes chip resides. I think when using the 8G SFP you got lucky on speed negotiation timers. Use a new OM3 or OM4 cable and connect them again. The DB RX values should normally be around -5db on a short-distance link with these SFP's. -17dB is way off the chart.
    See for more info over here: http://www.erwinvanlonden.net/2012/03/the-importance-of-clean-fibre-optics/

    @DavidHickok wrote:

    Here's the port connected to the 6150, negotiated at 2GB.  I Googled the vendor PN and it definitely seems to be a 4GB transceiver

     

    Identifier: 3 SFP
    Connector: 7 LC
    Transceiver: 150c402001000000 100,200,400_MB/s M5,M6 sw Inter_dist
    Encoding: 1 8B10B
    Baud Rate: 42 (units 100 megabaud)
    Length 9u: 0 (units km)
    Length 9u: 0 (units 100 meters)
    Length 50u: 15 (units 10 meters)
    Length 62.5u:7 (units 10 meters)
    Length Cu: 0 (units 1 meter)
    Vendor Name: FINISAR CORP.
    Vendor OUI: 00:90:65
    Vendor PN: FTLF8524P2BNV-HP
    Vendor Rev: A
    Wavelength: 850 (units nm)
    Options: 0032 Loss_of_Sig,Tx_Disable
    BR Max: 0
    BR Min: 0
    Serial No: PEK1HSU
    Date Code: 081106
    DD Type: 0x68
    Enh Options: 0xd8
    Status/Ctrl: 0x82
    Alarm flags[0,1] = 0x5, 0x40
    Warn Flags[0,1] = 0x5, 0x40
    Alarm Warn
    low high low high
    Temperature: 39 Centigrade -25 95 -20 90
    Current: 5.490 mAmps 1.000 17.000 2.000 14.000
    Voltage: 3313.4 mVolts 2700.0 3900.0 2900.0 3700.0
    RX Power: -9.3 dBm (116.8 uW) 10.0 uW 1259.0 uW 15.8 uW 794.0 uW
    TX Power: -4.6 dBm (346.9 uW) 67.0 uW 631.0 uW 79.0 uW 631.0 uW

     

    And here's the one on the 6150:

     

    Identifier: 3 SFP
    Connector: 7 LC
    Transceiver: 540c404000000000 2,4,8_Gbps M5,M6 sw Short_dist
    Encoding: 1 8B10B
    Baud Rate: 85 (units 100 megabaud)
    Length 9u: 0 (units km)
    Length 9u: 0 (units 100 meters)
    Length 50u (OM2): 5 (units 10 meters)
    Length 50u (OM3): 0 (units 10 meters)
    Length 62.5u:2 (units 10 meters)
    Length Cu: 0 (units 1 meter)
    Vendor Name: HP-F BROCADE
    Vendor OUI: 00:05:1e
    Vendor PN: AJ716B
    Vendor Rev: A
    Wavelength: 850 (units nm)
    Options: 003a Loss_of_Sig,Tx_Fault,Tx_Disable
    BR Max: 0
    BR Min: 0
    Serial No: UAF413410000PRU
    Date Code: 131011
    DD Type: 0x68
    Enh Options: 0xfa
    Status/Ctrl: 0x82
    Alarm flags[0,1] = 0x5, 0x0
    Warn Flags[0,1] = 0x5, 0x0
    Alarm Warn
    low high low high
    Temperature: 49 Centigrade -10 90 -5 85
    Current: 8.082 mAmps 1.000 17.000 2.000 14.000
    Voltage: 3259.1 mVolts 2900.0 3700.0 3000.0 3600.0
    RX Power: -17.9 dBm (16.2 uW) 10.0 uW 1258.9 uW 15.8 uW 1000.0 uW
    TX Power: -3.4 dBm (460.0 uW) 125.9 uW 631.0 uW 158.5 uW 562.3 uW



    #BrocadeFibreChannelNetworkingCommunity


  • 9.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-21-2016 08:43 AM

    Erwin,

     

    Thanks and good advice.  Since I only need this connection for a short period (primarily to get the zoning information updated) I think I'll be OK.  If it turns out I need to keep it up longer I'll definitely start swapping out cables, transceivers, etc.  I have another set of these to do so we'll see how that one goes :-).

     

      --David


    #BrocadeFibreChannelNetworkingCommunity


  • 10.  Re: Port Throttled and Invalid_Word Errors

    Posted 01-31-2018 03:07 AM

    No doubt! This is due to the compatibility of the SFP module, we also enconuter such same problem! At last, we resolved it with Vendor Brocade SFP!


    #BrocadeFibreChannelNetworkingCommunity


  • 11.  Re: Port Throttled and Invalid_Word Errors

    Posted 02-08-2019 09:55 AM

    Hi..in my case I installed an 8GB transceiver in the 6510 and performed a portcfgdefault on the port. It connected and successfully downloaded fabric information (yay!). What's curious, though not really a problem, is that both sides connected at 2GB instead of 4GB.


    #BrocadeFibreChannelNetworkingCommunity


  • 12.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 12:07 PM

    can you post please output from "sfpshow" from the port in question on 4900 ?


    #BrocadeFibreChannelNetworkingCommunity


  • 13.  Re: Port Throttled and Invalid_Word Errors

    Posted 04-20-2016 11:47 AM

    sorry,.... I see you use 16G SFP.

     

    if the SFP on 4900 is a old Finisar, is most probabble this caused the problem.

     

    do you have 4G Brocade branded SFP for Brocade 4900 and can replace the 16G on 6510 with 8G SFP+ ?


    #BrocadeFibreChannelNetworkingCommunity