[rbak-nsp] 4PORT-10G crash

Marcin Kuczera marcin at leon.pl
Wed May 29 05:20:08 EDT 2013 

Hello,

recently we had 3 linecard crashes in our SE600 within a week (last 2 
within 20 minutes)
Redback Networks SmartEdge OS Version SEOS-11.1.2.7-Release


What is suspected:

May 29 08:23:00: %CSM-6-CARD: card 10ge-4-port INSERTED in slot 1
May 29 08:23:01: %SYSLOG-1-ALERT: csm: FPGA mismatch detected on card
10ge-4-port in slot 1


   1 : 10ge-4-port                 1 : 10ge-4-port               Yes IEUDR

there is no M flag here that FPGA upgrade is required...
Some kind of bug ?


Now we have waiting SEOS-11.1.2.7p2-Release in a case of next crash,
but - anyone faced similar problems with SEOS-11.1.2.7-Release ??

Regards,
Marcin



May 29 08:22:39: %CSM-6-CARD: Reloading ppas in slot 1
May 29 08:22:51: %CSM-6-CARD: card 10ge-4-port REMOVED from slot 1
May 29 08:22:51: %PM-1-ALERT: Process EPPA IPC SLOT 1, pid 0x81010003,
is not responding.
May 29 08:22:52: [0001]: %SNMP-6-INFO: entConfigChange notification sent
to 10.100.10.21:162
May 29 08:22:52: [0001]: %SNMP-6-INFO: rbnCardAlarm notification sent to
10.100.10.21:162
May 29 08:22:57: %SYSMON-5-GEN_FTP: Core file
/ata0/p02/ppa/crashSlot01IppaCore.gz FTPed to /md/ successfully
May 29 08:23:00: %CSM-6-CARD: card 10ge-4-port INSERTED in slot 1
May 29 08:23:01: %SYSLOG-1-ALERT: csm: FPGA mismatch detected on card
10ge-4-port in slot 1
May 29 08:23:02: [0001]: %SNMP-6-INFO: entConfigChange notification sent
to 10.100.10.21:162
May 29 08:23:02: [0001]: %SNMP-6-INFO: rbnCardAlarm notification sent to
10.100.10.21:162
May 29 08:23:04: %CSM-6-CARD: card 10ge-4-port REMOVED from slot 1
May 29 08:23:04: %CSM-3-CARD_ERR: Ignoring insert event for unknown card
in slot 1 (card_type = 1) [csm_vx_proc_card_insert]
May 29 08:23:04: %SNMP-6-INFO: The last entity configuration change
notification was sent out 2.00 (less than 5.00) seconds before.
Suppressing this one.
May 29 08:23:05: [0001]: %SNMP-6-INFO: rbnCardAlarm notification sent to
10.100.10.21:162
May 29 08:23:14: %CSM-6-CARD: card 10ge-4-port INSERTED in slot 1
May 29 08:23:15: %SYSLOG-1-ALERT: csm: FPGA mismatch detected on card
10ge-4-port in slot 1
May 29 08:23:15: [0001]: %SNMP-6-INFO: entConfigChange notification sent
to 10.100.10.21:162
May 29 08:23:16: [0001]: %SNMP-6-INFO: rbnCardAlarm notification sent to
10.100.10.21:162
May 29 08:23:19: %SYSLOG-2-CRIT: /netbsd: CTRL]: _ptdread: Missing SOP @
descriptor 0xa8000000c4003a30 (drop)
May 29 08:23:19: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003a40 (drop)
May 29 08:23:19: %QOS-6-INFO: qos info: PPA just reborn 0
May 29 08:23:19: %CSM-6-CARD: card 10ge-4-port INSERTED in slot 1 READY
May 29 08:23:19: %PPAINFRA-6-ISTART_INFO:
a1f9c86d/0000000005/940900000:01/EPPA/EU00:Ready to receive packets
May 29 08:23:19: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003a50 (drop)
May 29 08:23:19: %PPAINFRA-6-ISTART_INFO:
9f46e560/0000000005/842700000:01/IPPA/EU00:Ready to receive packets
May 29 08:23:19: %QOS-6-INFO: qos info: iPPA reg on slot 1
May 29 08:23:19: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003a60 (drop)
May 29 08:23:20: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003a70 (drop)
May 29 08:23:20: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003a80 (drop)
May 29 08:23:20: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003a90 (drop)
May 29 08:23:20: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003aa0 (drop)
May 29 08:23:20: %QOS-6-INFO: qos info: PPA just reborn 0
May 29 08:23:20: %QOS-6-INFO: qos info: ePPA reg on slot 1
May 29 08:23:20: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003ab0 (drop)
May 29 08:23:20: %CSM-6-CARD: Card in slot 1 entering In Service state.
May 29 08:23:20: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003ac0 (drop)
May 29 08:23:21: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003ad0 (drop)
May 29 08:23:21: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003ae0 (drop)
May 29 08:23:21: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003af0 (drop)
May 29 08:23:21: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b00 (drop)
May 29 08:23:21: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b10 (drop)
May 29 08:23:21: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b20 (drop)
May 29 08:23:21: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b30 (drop)
May 29 08:23:22: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b40 (drop)
May 29 08:23:22: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b50 (drop)
May 29 08:23:22: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b60 (drop)
May 29 08:23:22: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b70 (drop)
May 29 08:23:22: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b80 (drop)
May 29 08:23:22: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003b90 (drop)
May 29 08:23:23: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003ba0 (drop)
May 29 08:23:23: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003bb0 (drop)
May 29 08:23:23: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003bc0 (drop)
May 29 08:23:23: %CSM-6-PORT: ethernet 1/1 link state UP service state
UP, overall admin is UP
May 29 08:23:23: %CSM-6-PORT: ethernet 1/2 link state UP service state
UP, overall admin is UP
May 29 08:23:23: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003bd0 (drop)
May 29 08:23:23: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003be0 (drop)
May 29 08:23:23: %SYSLOG-2-CRIT: /netbsd: ptd: 1/0:1 [IPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4003bf0 (drop)
May 29 08:23:23: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004600 (drop)
May 29 08:23:24: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004610 (drop)
May 29 08:23:24: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004620 (drop)
May 29 08:23:24: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004630 (drop)
May 29 08:23:24: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004640 (drop)
May 29 08:23:24: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004650 (drop)
May 29 08:23:24: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004660 (drop)
May 29 08:23:25: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004670 (drop)
May 29 08:23:25: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004680 (drop)
May 29 08:23:25: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004690 (drop)
May 29 08:23:25: %CSM-6-PORT: ethernet 1/3 link state UP service state
UP, overall admin is UP
May 29 08:23:25: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c40046a0 (drop)
May 29 08:23:25: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c40046b0 (drop)
May 29 08:23:25: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c40046c0 (drop)
May 29 08:23:25: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c40046d0 (drop)
May 29 08:23:26: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c40046e0 (drop)
May 29 08:23:26: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c40046f0 (drop)
May 29 08:23:26: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004700 (drop)
May 29 08:23:26: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004710 (drop)
May 29 08:23:26: %SYSLOG-2-CRIT: /netbsd: ptd: 1/1:1 [EPPA:CTRL]:
_ptdread: Missing SOP @ descriptor 0xa8000000c4004720 (drop)

More information about the redback-nsp mailing list