[f-nsp] Perfomance problem with J-BxGMR4 on BI15000

Andrew Ermishin eas at etherway.ru
Mon Oct 17 09:05:59 EDT 2011


Hello mans.

I have a lot prefomance problem with older BigIron 1500.

config:

#show ver
  SW: Version 08.0.01wT53 Copyright (c) 1996-2004 Foundry Networks, Inc.
      Compiled on Jun 18 2010 at 15:16:32 labeled as B2R08001w
      (3860139 bytes) from Primary B2R08001w.bin
  HW: BigIron 15000 Router, V2(0104), SYSIF version 21, Serial #: Non-exist
==========================================================================
SL 1: J-BxGMR4 JetCore Management Module, SYSIF 2 (Mini GBIC), M4, ACTIVE


#show mod
     Module                                 Status    Ports Starting MAC
 S1: J-BxGMR4 JetCore Management Module, SY M4, ACTIV   8   0004.809d.2c00
 S2: J-BxGC16 JetCore Gig Copper Module, SY OK         16   0004.809d.2c00
 S3: J-BxG16 JetCore Gig Fiber Module, SYSI OK         16   0004.809d.2c40
 S4: J-BxG16 JetCore Gig Fiber Module, SYSI OK         16   0004.809d.2c00
 S5: J-BxG16 JetCore Gig Fiber Module, SYSI OK         16   0004.809d.2c00
 S6: B10G Fiber Switch Module, SYSIF 2      OK          1   0004.809d.2c00
 S7:
 S8:
 S9:
S10:
S11:
S12:
S13:
S14:
S15:


#show ip
Global Settings
  ttl: 64, arp-age: 10, bootp-relay-max-hops: 4
  router-id : 91.197.x.x
  enabled : UDP-Broadcast-Forwarding  RARP  OSPF
  disabled: Route-Only  Directed-Broadcast-Forwarding  BGP4 Source-Route  IRDP Load-Sharing  Proxy-ARP  RIP  DVMRP  VRRP  VRRP-Extended


Interface e 3/15 is uplink to ISP.

b#show inter e 3/15
GigabitEthernet3/15 is up, line protocol is up
  Hardware is GigabitEthernet, address is 0004.809d.2c00 (bia 0004.809d.2c4e)
  Configured speed 1Gbit, actual 1Gbit, configured duplex fdx, actual fdx
  Member of 1 L2 VLANs, port is tagged, port state is FORWARDING
  STP configured to OFF, priority is level0, flow control disabled
  mirror disabled, monitor disabled
  Not member of any active trunks
  Not member of any configured trunks
  No port name
  MTU 1518 bytes, encapsulation ethernet
  300 second input rate: 471580792 bits/sec, 72367 packets/sec, 48.31% utilization
  300 second output rate: 423314784 bits/sec, 72394 packets/sec, 43.48% utilization
  2385257258 packets input, 5434283720833 bytes, 0 no buffer
  Received 445 broadcasts, 0 multicasts, 2385256813 unicasts
  0 input errors, 0 CRC, 0 frame, 0 ignored
  0 filtered, 0 runts, 0 giants, DMA received 6680224531 packets, 1521871549 jumbos
  2454349663 packets output, 5188385999313 bytes, 0 underruns
  Transmitted 2788 broadcasts, 0 multicasts, 2454346875 unicasts
  0 output errors, 0 collisions, DMA transmitted 6749316954 packets, 394194349 jumbos


#show cam-p mod 3 detail

==== SLOT 3 CAM PARTITION ====

IGC: 8 (0x08)
Number of CAM devices per IGC:  1
Number of hw entries per CAM:  0x08000
Total size of CAM = 2Mbits
complete CAM index range per IGC:
  (sw) 1 - 54066  (1 - 0x0d332), total entries: 54066 (0x0d332)
  (hw) 0 - 32767  (0 - 0x07fff), total entries: 32768 (0x08000)
Percentage of CAM hardware entries for each partition:
  Layer3 = 21299 (1.299987Mbits)        (64.999389%)
      Level3 = 2047 (0.124938Mbits)     (6.246948%)
      Level2 = 2048 (0.125Mbits)        (6.25%)
  Layer2 = 3277 (0.200012Mbits) (10.000610%)
  Layer4 = 8192 (0.5Mbits)      (25%)

Layer 3 sw index range:
  L3 L3 1 - 4095        (0x00001 - 0x00fff), free 4095 (0x00fff)
  L3 L2 4096 - 8191     (0x01000 - 0x01fff), free 4090 (0x00ffa)
  L3    8192 - 42597    (0x02000 - 0x0a665), free 34357 (0x08635)
layer 3 hw index range (inversely mapped):
        21298 - 0       (0x05332 - 0x00000)
L2 index range:
  (sw) 42598 - 45874    (0x0a666 - 0x0b332), free 2590 (0x00a1e)
  (hw) 21299 - 24575    (0x05333 - 0x05fff)
L4 pool 3 index range:
  (sw) 45875 - 48434    (0x0b333 - 0x0bd32), free 2560 (0x00a00)
  (hw) 24576 - 27135    (0x06000 - 0x069ff)
L4 pool 2 index range:
  (sw) 48435 - 50994    (0x0bd33 - 0x0c732), free 2560 (0x00a00)
  (hw) 27136 - 29695    (0x06a00 - 0x073ff)
L4 pool 1 index range:
  (sw) 50995 - 53554    (0x0c733 - 0x0d132), free 2560 (0x00a00)
  (hw) 29696 - 32255    (0x07400 - 0x07dff)
L4 pool 0 index range:
  (sw) 53555 - 54066    (0x0d133 - 0x0d332), free 504 (0x001f8)
  (hw) 32256 - 32767    (0x07e00 - 0x07fff)

IGC: 9 (0x09)
Number of CAM devices per IGC:  1
Number of hw entries per CAM:  0x08000
Total size of CAM = 2Mbits
complete CAM index range per IGC:
  (sw) 1 - 54066  (1 - 0x0d332), total entries: 54066 (0x0d332)
  (hw) 0 - 32767  (0 - 0x07fff), total entries: 32768 (0x08000)
Percentage of CAM hardware entries for each partition:
  Layer3 = 21299 (1.299987Mbits)        (64.999389%)
      Level3 = 2047 (0.124938Mbits)     (6.246948%)
      Level2 = 2048 (0.125Mbits)        (6.25%)
  Layer2 = 3277 (0.200012Mbits) (10.000610%)
  Layer4 = 8192 (0.5Mbits)      (25%)

Layer 3 sw index range:
  L3 L3 1 - 4095        (0x00001 - 0x00fff), free 4095 (0x00fff)
  L3 L2 4096 - 8191     (0x01000 - 0x01fff), free 4096 (0x01000)
  L3    8192 - 42597    (0x02000 - 0x0a665), free 34402 (0x08662)
layer 3 hw index range (inversely mapped):
        21298 - 0       (0x05332 - 0x00000)
L2 index range:
  (sw) 42598 - 45874    (0x0a666 - 0x0b332), free 2594 (0x00a22)
  (hw) 21299 - 24575    (0x05333 - 0x05fff)
L4 pool 3 index range:
  (sw) 45875 - 48434    (0x0b333 - 0x0bd32), free 2560 (0x00a00)
  (hw) 24576 - 27135    (0x06000 - 0x069ff)
L4 pool 2 index range:
  (sw) 48435 - 50994    (0x0bd33 - 0x0c732), free 2560 (0x00a00)
  (hw) 27136 - 29695    (0x06a00 - 0x073ff)
L4 pool 1 index range:
  (sw) 50995 - 53554    (0x0c733 - 0x0d132), free 2560 (0x00a00)
  (hw) 29696 - 32255    (0x07400 - 0x07dff)
L4 pool 0 index range:
  (sw) 53555 - 54066    (0x0d133 - 0x0d332), free 504 (0x001f8)
  (hw) 32256 - 32767    (0x07e00 - 0x07fff)

IGC: 10 (0x0a)
Number of CAM devices per IGC:  1
Number of hw entries per CAM:  0x08000
Total size of CAM = 2Mbits
complete CAM index range per IGC:
  (sw) 1 - 54066  (1 - 0x0d332), total entries: 54066 (0x0d332)
  (hw) 0 - 32767  (0 - 0x07fff), total entries: 32768 (0x08000)
Percentage of CAM hardware entries for each partition:
  Layer3 = 21299 (1.299987Mbits)        (64.999389%)
      Level3 = 2047 (0.124938Mbits)     (6.246948%)
      Level2 = 2048 (0.125Mbits)        (6.25%)
  Layer2 = 3277 (0.200012Mbits) (10.000610%)
  Layer4 = 8192 (0.5Mbits)      (25%)

Layer 3 sw index range:
  L3 L3 1 - 4095        (0x00001 - 0x00fff), free 4095 (0x00fff)
  L3 L2 4096 - 8191     (0x01000 - 0x01fff), free 4091 (0x00ffb)
  L3    8192 - 42597    (0x02000 - 0x0a665), free 33764 (0x083e4)
layer 3 hw index range (inversely mapped):
        21298 - 0       (0x05332 - 0x00000)
L2 index range:
  (sw) 42598 - 45874    (0x0a666 - 0x0b332), free 2569 (0x00a09)
  (hw) 21299 - 24575    (0x05333 - 0x05fff)
L4 pool 3 index range:
  (sw) 45875 - 48434    (0x0b333 - 0x0bd32), free 2560 (0x00a00)
  (hw) 24576 - 27135    (0x06000 - 0x069ff)
L4 pool 2 index range:
  (sw) 48435 - 50994    (0x0bd33 - 0x0c732), free 2560 (0x00a00)
  (hw) 27136 - 29695    (0x06a00 - 0x073ff)
L4 pool 1 index range:
  (sw) 50995 - 53554    (0x0c733 - 0x0d132), free 2560 (0x00a00)
  (hw) 29696 - 32255    (0x07400 - 0x07dff)
L4 pool 0 index range:
  (sw) 53555 - 54066    (0x0d133 - 0x0d332), free 504 (0x001f8)
  (hw) 32256 - 32767    (0x07e00 - 0x07fff)

IGC: 11 (0x0b)
Number of CAM devices per IGC:  1
Number of hw entries per CAM:  0x08000
Total size of CAM = 2Mbits
complete CAM index range per IGC:
  (sw) 1 - 54066  (1 - 0x0d332), total entries: 54066 (0x0d332)
  (hw) 0 - 32767  (0 - 0x07fff), total entries: 32768 (0x08000)
Percentage of CAM hardware entries for each partition:
  Layer3 = 21299 (1.299987Mbits)        (64.999389%)
      Level3 = 2047 (0.124938Mbits)     (6.246948%)
      Level2 = 2048 (0.125Mbits)        (6.25%)
  Layer2 = 3277 (0.200012Mbits) (10.000610%)
  Layer4 = 8192 (0.5Mbits)      (25%)

Layer 3 sw index range:
  L3 L3 1 - 4095        (0x00001 - 0x00fff), free 4095 (0x00fff)
  L3 L2 4096 - 8191     (0x01000 - 0x01fff), free 4071 (0x00fe7)
  L3    8192 - 42597    (0x02000 - 0x0a665), free 33864 (0x08448)
layer 3 hw index range (inversely mapped):
        21298 - 0       (0x05332 - 0x00000)
L2 index range:
  (sw) 42598 - 45874    (0x0a666 - 0x0b332), free 2588 (0x00a1c)
  (hw) 21299 - 24575    (0x05333 - 0x05fff)
L4 pool 3 index range:
  (sw) 45875 - 48434    (0x0b333 - 0x0bd32), free 2560 (0x00a00)
  (hw) 24576 - 27135    (0x06000 - 0x069ff)
L4 pool 2 index range:
  (sw) 48435 - 50994    (0x0bd33 - 0x0c732), free 2560 (0x00a00)
  (hw) 27136 - 29695    (0x06a00 - 0x073ff)
L4 pool 1 index range:
  (sw) 50995 - 53554    (0x0c733 - 0x0d132), free 2560 (0x00a00)
  (hw) 29696 - 32255    (0x07400 - 0x07dff)
L4 pool 0 index range:
  (sw) 53555 - 54066    (0x0d133 - 0x0d332), free 504 (0x001f8)
  (hw) 32256 - 32767    (0x07e00 - 0x07fff)


but if upstream traffic more then 350Mbit/sec (~35-40% util.), we have serious speed degradation into Internet.

#show backplane
_______________________________________________________________________
Slot  Mod   FreeQ    DMADrop    BPDrop    WriteDrop     Last
-----------------------------------------------------------------------
 1   J-BxGMR 1571       0          0       3869     D:1  H:12M:0 S:37
             1645       0          0          0     D:1  H:12M:0 S:37
 2   J-BxGC1 1643       0          0          0     D:1  H:12M:0 S:44
             1645       0          0          0     D:1  H:12M:0 S:44
             1645       0          0          0     D:1  H:12M:0 S:44
             1643       0          0          0     D:1  H:12M:0 S:44
 3   J-BxG16 1643       0          0          0     D:1  H:12M:0 S:37
             1642       0          0          0     D:1  H:12M:0 S:37
             1642       0          0          0     D:1  H:12M:0 S:37
             1641       0        976       5266     D:1  H:12M:0 S:37
 4   J-BxG16 1642       0          0          0     D:1  H:12M:0 S:44
             1641       0          0          0     D:1  H:12M:0 S:44
             1643       0          0          0     D:1  H:12M:0 S:44
             1641       0          0          0     D:1  H:12M:0 S:44
 5   J-BxG16 1642       0          0          0     D:1  H:12M:0 S:44
             1643       0          0          0     D:1  H:12M:0 S:44
             1645       0          0          0     D:1  H:12M:0 S:44
             1644       0          0          0     D:1  H:12M:0 S:44
 6   B10G       0       0          0          1     D:1  H:12M:0 S:4
Backplane polling is DISABLED

I see some backplane drops at module 3. Why is it?






-- 
wbr, Andrey Ermishin.




More information about the foundry-nsp mailing list