Brocade Fibre Channel Networking Community

Expand all | Collapse all

ISL between 5100/4100 Latency issues

  • 1.  ISL between 5100/4100 Latency issues

    Posted 10-24-2014 08:51 AM

    2014/10/23-23:46:46, [AN-1010], 30, FID 128, WARNING, i-mqn-fcsw-cor-03, Severe latency bottleneck detected at slot 0 port 38.

    I have no enc out errors on either switch. Latency is on the 5100 ISL port.

     

    I see the timeouts - how do I add buffer credits to 4100 trunk E-port without disruption? Do I make same change on 5100 ISL port?

    I appreciate any help possible - thanks.

     

     

    Here is portstats on edge switch (a 4100) ISL port master

     

    i-mqn-fcsw-edg-15:admin> portstatsshow 4
    stat_wtx 3820108748 4-byte words transmitted
    stat_wrx 210202436 4-byte words received
    stat_ftx 89301479 Frames transmitted
    stat_frx 44860311 Frames received
    stat_cdr_frx 0 Class 2 frames received
    stat_c3_frx 44838257 Class 3 frames received
    stat_lc_rx 9782 Link control frames received
    stat_mc_rx 0 Multicast frames received
    stat_mc_to 0 Multicast timeouts
    stat_mc_tx 0 Multicast frames transmitted
    tim_rdy_pri 450 Time R_RDY high priority
    tim_txcrd_z 1042541 Time BB credit zero (2.5Us ticks)
    er_enc_in 0 Encoding errors inside of frames
    er_crc 0 Frames with CRC errors
    er_trunc 0 Frames shorter than minimum
    er_toolong 0 Frames longer than maximum
    er_bad_eof 0 Frames with bad end-of-frame
    er_enc_out 0 Encoding error outside of frames
    er_bad_os 0 Invalid ordered set
    er_rx_c3_timeout 112 Class 3 receive frames discarded due to timeout
    er_tx_c3_timeout 0 Class 3 transmit frames discarded due to timeout
    er_c3_dest_unreach 8 Class 3 frames discarded due to destination unreachable
    er_other_discard 2 Other discards
    er_zone_discard 0 Class 3 frames discarded due to zone mismatch
    er_crc_good_eof 0 Crc error with good eof
    er_inv_arb 0 Invalid ARB
    open 0 loop_open
    transfer 0 loop_transfer
    opened 0 FL_Port opened
    starve_stop 0 tenancies stopped due to starvation
    fl_tenancy 0 number of times FL has the tenancy
    nl_tenancy 0 number of times NL has the tenancy
    zero_tenancy 0 zero tenancy

     

     

     

    Here is ISL port on 5100

     

    i-mqn-fcsw-cor-03:admin> portstatsshow 38
    stat_wtx 4246547488 4-byte words transmitted
    stat_wrx 3273242009 4-byte words received
    stat_ftx 44134421 Frames transmitted
    stat_frx 88099810 Frames received
    stat_c2_frx 0 Class 2 frames received
    stat_c3_frx 88078225 Class 3 frames received
    stat_lc_rx 12015 Link control frames received
    stat_mc_rx 0 Multicast frames received
    stat_mc_to 0 Multicast timeouts
    stat_mc_tx 0 Multicast frames transmitted
    tim_rdy_pri 0 Time R_RDY high priority
    tim_txcrd_z 1588767 Time TX Credit Zero (2.5Us ticks)
    tim_txcrd_z_vc 0- 3: 0 0 0 0
    tim_txcrd_z_vc 4- 7: 2934508 0 0 0
    tim_txcrd_z_vc 8-11: 0 0 0 0
    tim_txcrd_z_vc 12-15: 0 0 0 0
    er_enc_in 0 Encoding errors inside of frames
    er_crc 0 Frames with CRC errors
    er_trunc 0 Frames shorter than minimum
    er_toolong 0 Frames longer than maximum
    er_bad_eof 0 Frames with bad end-of-frame
    er_enc_out 0 Encoding error outside of frames
    er_bad_os 0 Invalid ordered set
    er_rx_c3_timeout 0 Class 3 receive frames discarded due to timeout
    er_tx_c3_timeout 38 Class 3 transmit frames discarded due to timeout
    er_c3_dest_unreach 0 Class 3 frames discarded due to destination unreachable
    er_other_discard 0 Other discards
    er_type1_miss 0 frames with FTB type 1 miss
    er_type2_miss 0 frames with FTB type 2 miss
    er_type6_miss 0 frames with FTB type 6 miss
    er_zone_miss 0 frames with hard zoning miss
    er_lun_zone_miss 0 frames with LUN zoning miss
    er_crc_good_eof 0 Crc error with good eof
    er_inv_arb 0 Invalid ARB
    open 0 loop_open
    transfer 0 loop_transfer
    opened 0 FL_Port opened
    starve_stop 0 tenancies stopped due to starvation
    fl_tenancy 0 number of times FL has the tenancy
    nl_tenancy 0 number of times NL has the tenancy
    zero_tenancy 0 zero tenancy


    #BrocadeFibreChannelNetworkingCommunity


  • 2.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 09:10 AM

    pbarwick,

     

    before you made some change, check with command "portbuffershow" the buffer usage on affected ports.

     

    another option is, you can try to disable QoS, and set the Port's as LE.

     

    such operation are disruptive.

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 3.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 09:37 AM

    I have qos disabled already on the ISL ports.

     

    So do I set ISL ports on both side to LE or just on the 4100?

    Will traffic fail over to my secondary trunk port, or should I have storage access shutdown?

     

    Thanks so much for your help.

     

    -Patrick

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 4.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 09:55 AM

    Patrick,

     

    what is the output of "portbuffershow" ?

     

    -->>So do I set ISL ports on both side to LE or just on the 4100?

     

    both side

     

    --->>Will traffic fail over to my secondary trunk port,...

     

    how many Trunk group have you created ?

     

    if you have Only ONE Trunk Group, the operation is disruptive.

     

    "trunkshow" command, display trunking information

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 5.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 10:02 AM

    portbuffershow. relevant ports are 

     

    33 - 8 - ( - ) - ( - ) 0 - -
    34 E - 8 - ( - ) - ( - ) 26 26 2km
    35 E - 8 - ( - ) - ( - ) 26 26 <2km
    36 - 8 - ( - ) - ( - ) 0 - -
    37 - 8 - ( - ) - ( - ) 0 - -
    38 E - 8 - ( 64) - ( 256) 26 26 2km
    39 E - 8 - ( - ) - ( - ) 26 26 <2km 1620

     

    Trunkshow for this edge switch.

     

    2: 38-> 4 10:00:00:05:1e:02:17:24 15 deskew 16 MASTER
    34-> 0 10:00:00:05:1e:02:17:24 15 deskew 15

     

    Thanks for quick responses.

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 6.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 10:04 AM

    I do have another edge switch on 2 more trunk ports - that hosts are connected to, so disruption so be on only half the paths.

    I am thinking this would be ok to change off hours.

     

    Also, will the portcfgfillword need to be adjusted since 4gb and 8gb talk differently?

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 7.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 10:22 AM

    patrick,

     

    sorry to say, you should post all relevant information at same time.

     

    if you are not sure how you san is configiured, run SAN-health and send me it by email

     

    abongiorno@techhelp24.net

     

    from trunkshow output you post here, show to me you have only ONE trunk group

     

    now you talk

     

    --->>>I do have another edge switch on 2 more trunk ports 

     

    trunk group and trunk port is not the same

     

    --->>>Also, will the portcfgfillword need to be adjusted since 4gb and 8gb talk differently?

     

    best practices is, since you have TWO different speed switch to set the port speed as fixed in this case at 4Gb and not as Auto Negotiation.

     

    and yes, portcfgfillword should have same value.

     

    additional I would check the FOS release and if necessary to upgrade to.


    #BrocadeFibreChannelNetworkingCommunity


  • 8.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 10:36 AM

    OK - I'll set port speed. I have read that this helps.

     

    Proper trunkshow output.

     

    i-mqn-fcsw-cor-03:admin> trunkshow
    1: 35-> 35 10:00:00:27:f8:87:30:70 2 deskew 15 MASTER
    39-> 39 10:00:00:27:f8:87:30:70 2 deskew 29

    2: 38-> 4 10:00:00:05:1e:02:17:24 15 deskew 16 MASTER
    34-> 0 10:00:00:05:1e:02:17:24 15 deskew 15

     

    4100 - Fabric OS:  v6.4.2a

    5100  - Fabric OS:  v7.2.1a

     

    I will run San Health and email you. - thanks again for your assistance.

     


    #BrocadeFibreChannelNetworkingCommunity


  • 9.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 11:14 AM

    Are you with Brocade? Techhelp24.net email address is not a brocade address is it?

     

     

     


    #BrocadeFibreChannelNetworkingCommunity


  • 10.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 11:20 AM


  • 11.  Re: ISL between 5100/4100 Latency issues

    Posted 10-24-2014 12:09 PM

    I set ISL port speeds to 4g - thanks for your help Antonio, I see you help a lot on this site, much appreciated !!

    If latency error does not go away, I'll set portlongdistance to LE as you stated, because it is disruptive.

     

     


    #BrocadeFibreChannelNetworkingCommunity