[rbak-nsp] HW Failure on SE-100 Card Carrier 2

Alireza Soltanian soltanian at gmail.com
Sat May 8 01:42:33 EDT 2010


Hi

We had a strange problem on one of our SE-100s:

The physical ports on the device became inactive and none of them worked
anymore.

 

I checked the ports and I got this message:

 

[local]Redback(config-card)#show port all 

Slot/Port:Ch:SubCh  Type                 State

2/1                 ethernet             No card  

2/2                 ethernet             No card  

2/3                 ethernet             No card  

2/4                 ethernet             No card  

2/5                 ethernet             Unavailable  

2/6                 ethernet             Unavailable  

2/7                 ethernet             Unavailable  

2/8                 ethernet             Unavailable  

2/9                 ethernet             Unavailable  

2/10                ethernet             Unavailable  

2/11                ethernet             Unavailable  

2/12                ethernet             Unavailable  

2/13                ethernet             Unavailable  

2/14                ethernet             Unavailable  

2/15                ethernet             No card  

2/16                ethernet             Unconfigured  

2/17                ethernet             Unconfigured  

2/18                ethernet             Unconfigured  

2/19                ethernet             Unconfigured  

2/20                ethernet             No card  

2/21                ethernet             No card  

2/22                ethernet             Unconfigured  

 

 

I tried to shutdown on diagnose the card. After finishing the diagnose and
turn on the card I received this log:

 

May 7 15:19:44: %CSM-6-PORT: ethernet 2/2 link state DOWN, admin is DOWN

May 7 15:19:44: %CSM-6-PORT: ethernet 2/3 link state DOWN, admin is DOWN

May 7 15:19:44: %CSM-6-PORT: ethernet 2/4 link state DOWN, admin is DOWN

May 7 15:19:44: %CSM-6-PORT: ethernet 2/15 link state DOWN, admin is DOWN

May 7 15:19:44: %CSM-6-PORT: ethernet 2/20 link state DOWN, admin is DOWN

May 7 15:19:44: %CSM-6-PORT: ethernet 2/21 link state DOWN, admin is DOWN

May 7 15:19:45: %CSM-6-CARD: slot 2, ALARM_CLEARED: Circuit pack power-on
diagnostic failed

May 7 15:19:52: %CSM-6-CARD: card carrier INSERTED in slot 2

May 7 15:19:52: %CSM-6-CARD: MIC number 1 ge-2-port REMOVED from slot 2

May 7 15:19:52: %CSM-6-CARD: MIC number 2 fe-12-port REMOVED from slot 2

May 7 15:19:55: %CSM-6-CARD: MIC number 1 ge-2-port INSERTED in slot 2

May 7 15:19:56: %CSM-6-CARD: MIC number 2 fe-12-port INSERTED in slot 2

May 7 15:19:57: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:19:57: %LOG-6-TDM_CONS:     [pktSlot_01]
bringinElf_block():linecard slot  2:EPPA Mem Verify
failed:memaddr[0x00000038],  read val[0x0000053c], write val[0x0040053c]

May 7 15:19:57: %LOG-6-TDM_CONS: 

May 7 15:19:57: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:19:57: %LOG-6-TDM_CONS:     [pktSlot_01] PPA Loader error: linecard
slot  2 ppaNo(4) status(0x00000000) bringinElf_block

May 7 15:19:57: %LOG-6-TDM_CONS: 

May 7 15:19:57: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:19:57: %LOG-6-TDM_CONS:     [pktSlot_01]
bringinElf_block():linecard slot  2:EPPA Mem Verify
failed:memaddr[0x00050038],  read val[0x0000053c], write val[0x0040053c]

May 7 15:19:57: %LOG-6-TDM_CONS: 

May 7 15:19:57: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:19:57: %LOG-6-TDM_CONS:     [pktSlot_01] PPA Loader error: linecard
slot  2 ppaNo(4) status(0x00000000) bringinElf_block

May 7 15:19:57: %LOG-6-TDM_CONS: 

May 7 15:19:57: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:19:57: %LOG-6-TDM_CONS:     [pktSlot_01]
bringinElf_block():linecard slot  2:EPPA Mem Verify
failed:memaddr[0x01f00118],  read val[0x64f2616d], write val[0x6472616d]

May 7 15:19:57: %LOG-6-TDM_CONS: 

May 7 15:19:57: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:19:57: %LOG-6-TDM_CONS:     [pktSlot_01] PPA Loader error: linecard
slot  2 ppaNo(4) status(0x00000000) bringinElf_block

May 7 15:19:57: %LOG-6-TDM_CONS: 

May 7 15:20:00: %CSM-6-CARD: slot 2, ALARM_MAJOR: Circuit pack power-on
diagnostic failed

May 7 15:20:00: %CSM-6-CARD: Initialization failure on card carrier in slot
2

May 7 15:20:01: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:20:01: %LOG-6-TDM_CONS:     [pktSlot_01] linecard slot  2:
GENERIC_FAILURE: Memory or Communication Failure - zero program didn't
finish in time - EPPA, 60 iterations

May 7 15:20:01: %LOG-6-TDM_CONS: 

May 7 15:20:01: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:20:01: %LOG-6-TDM_CONS:     [pktSlot_01]
localPktCardDownloadBlocking(linecard slot  2)failed.

May 7 15:20:01: %LOG-6-TDM_CONS: 

May 7 15:20:01: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:20:01: %LOG-6-TDM_CONS:     [pktSlot_01] linecard slot  2:
GENERIC_FAILURE: PPA download failure

May 7 15:20:01: %LOG-6-TDM_CONS: 

May 7 15:20:01: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:20:01: %LOG-6-TDM_CONS:     [pktSlot_01] pktCBCardEnable(linecard
slot  2) card failed. Exit.

May 7 15:20:01: %LOG-6-TDM_CONS: 

May 7 15:20:01: %LOG-6-TDM_CONS: pktLayer   :ERROR:HI:logger():

May 7 15:20:01: %LOG-6-TDM_CONS:     [pktSlot_01] pktCBCardEnable(linecard
slot  2)failed.

May 7 15:20:01: %LOG-6-TDM_CONS:

 

 

Also based on the show hardware detail ,I have HW Failure:

 

Slot              : 2                Type              : carrier         

EEPROM id/ver     : 0x5a/4           SlipFpga rev      : 0x0             

IPPA memory       : N/A              EPPA memory       : N/A             

Temperature       : N/A              

Card Status       : HW failure       POD Status        : Fail            

Card State        : PPA download failure

ODD Status        : Not Available    

Ports Entitled    : All              

Active Alarms     : Circuit pack power-on diagnostic failed

MIC 1             : Not Present      Serial No         : UNAVAILABLE     

MIC 2             : Not Present      Serial No         : UNAVAILABLE     

 

 

Any Idea what was happened and What should I do now?

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/redback-nsp/attachments/20100508/60bec735/attachment-0001.html>


More information about the redback-nsp mailing list