[c-nsp] Cisco 3750 Reboot Issue

[Erik Fritzler]

Has anyone experienced crashes with the 3750-12S switches. We have tried 12.2(44), 12.2(50), 12.2(53), and 12.2(55) to alleviate the issue but no difference. I had read about a cisco bug for a memory leak where enabling ip routing on the switch was a workaround. I have tried this, but no change. The switches will stay up for 2-3 days then crash again. One switch just has 2 layer 2 etherchannel interfaces configured, the other is a distribution layer with single dot1q trunks. Here is a copy of the log for the crash event.

Oct 18 17:58:26: %PLATFORM-1-CRASHED: System previously crashed with the following message:
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Cisco IOS Software, C3750 Software (C3750-IPSERVICESK9-M), Version 12.2(50)SE1, RELEASE SOFTWARE (fc2)
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Copyright (c) 1986-2009 by Cisco Systems, Inc.
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Compiled Mon 06-Apr-09 08:19 by amvarma
Oct 18 17:58:26: %PLATFORM-1-CRASHED:
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!
Oct 18 17:58:26: %PLATFORM-1-CRASHED:
Oct 18 17:58:26: %PLATFORM-1-CRASHED: SRR0 = 0x01963184  SRR1 = 0x00029230  SRR2 = 0x006B79A4  SRR3 = 0x00021000
Oct 18 17:58:26: %PLATFORM-1-CRASHED: ESR = 0x00000000  DEAR = 0x00000000  TSR = 0x8C000000  DBSR = 0x10000000
Oct 18 17:58:26: %PLATFORM-1-CRASHED:
Oct 18 17:58:26: %PLATFORM-1-CRASHED: CPU Register Context:
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Vector = 0x00002000  PC = 0x00A70FBC  MSR = 0x00029230  CR = 0x30000003
Oct 18 17:58:26: %PLATFORM-1-CRASHED: LR = 0x00A70F80  CTR = 0x019584F0  XER = 0xE000005F
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R0 = 0x00A70F80  R1 = 0x02FA5F38  R2 = 0x00000000  R3 = 0x0376087C
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R4 = 0x00000000  R5 = 0x00000000  R6 = 0x00000000  R7 = 0x00000000
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R8 = 0x00007530  R9 = 0x00000000  R10 = 0x00000000  R11 = 0x00000005
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R12 = 0xC197AFF2  R13 = 0x00110000  R14 = 0x019568F0  R15 = 0x00000000
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R16 = 0x00000000  R17 = 0x00000000  R18 = 0x00000000  R19 = 0x00000000
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R20 = 0x00000000  R21 = 0x00000000  R22 = 0x00000000  R23 = 0x025E0000
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R24 = 0xAB1234AB  R25 = 0x027297F0  R26 = 0x035A42D0  R27 = 0x00000000
Oct 18 17:58:26: %PLATFORM-1-CRASHED: R28 = 0x0272B8A4  R29 = 0x01EC5BD4  R30 = 0x027297F0  R31 = 0x00000000
Oct 18 17:58:26: %PLATFORM-1-CRASHED:
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Stack trace:
Oct 18 17:58:26: %PLATFORM-1-CRASHED: PC = 0x00A70FBC, SP = 0x02FA5F38
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 00: SP = 0x02FA5F48    PC = 0x00A70F80
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 01: SP = 0x02FA5F78    PC = 0x019535D8
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 02: SP = 0x02FA5F90    PC = 0x01953028
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 03: SP = 0x02FA5FC8    PC = 0x01953C7C
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 04: SP = 0x02FA5FE0    PC = 0x01956780
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 05: SP = 0x02FA5FF8    PC = 0x01956990
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 06: SP = 0x02FA6000    PC = 0x00A72F48
Oct 18 17:58:26: %PLATFORM-1-CRASHED: Frame 07: SP = 0x00000000    PC = 0x00A69A18
Oct 18 17:58:26: %PLATFORM-1-CRASHED:

Any help would be greatly appreciated.

Erik Fritzler
Director of NOC Services
Dark Fiber Solutions, Inc.
600 ½ Grant Ave.
York, NE 68467