[cisco-nas] frequent reboot of AS-5200's
Pierre Nepveu
pnepveu at videotron.net
Tue Sep 14 13:51:22 EDT 2004
hi guys,
you both asked for <sh stack> within 7 minutes of one another ! We should have a
new Olympic event : synchronized help desk just for you !
Here goes :
(this one is not very fresh... about 1 1/2 day. Below is the freshest I've got -
about 5 hours. Thanks for your help!)
as01-91q-mtl#sh stack
Minimum process stacks:
Free/Size Name
1732/2000 Reset ipc queue
2420/4000 Init
1220/2000 Microcom DSP download Process
1456/2000 RADIUS INITCONFIG
1012/2000 MAI Action Process
2884/4000 Exec
1672/2000 Async tty Reset
2272/4000 Virtual Exec
Interrupt level stacks:
Level Called Unused/Size Name
1 17193915 2544/3000 Async (CL-CD2430) transmit interrupts
2 20615196 2200/3000 Async (CD2430/Mica) receive interrupts
3 4596 2908/3000 Serial interface state change interrupt
4 22397619 2364/3000 Network interfaces
5 21868 2896/3000 Console Uart
6 2 2852/3000 DSX1 interface
System was restarted by error - software forced crash, PC 0x221CEAD2
5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE (fc1)
TAC Support: http://www.cisco.com/tac
Compiled Tue 22-Jul-03 18:16 by hqluong (current version)
Image text-base: 0x22033FAC, data-base: 0x00005000
Stack trace from system failure:
FP: 0x2132D4, RA: 0x221D281C
FP: 0x2132E0, RA: 0x221D2AE2
FP: 0x213304, RA: 0x221C893E
FP: 0x213314, RA: 0x221C8A0A
FP: 0x21331C, RA: 0x2215C950
FP: 0x21332C, RA: 0x2215CC60
FP: 0x213398, RA: 0x2215C9DA
FP: 0x2133B4, RA: 0x2204DF1E
***************************************************
******* Information of Last System Crash **********
***************************************************
as01-91q-mtl#
-/-/-/-/-/-/
as05-mtl#sh ver
Cisco Internetwork Operating System Software
IOS (tm) 5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE
(fc1)
TAC Support: http://www.cisco.com/tac
Copyright (c) 1986-2003 by cisco Systems, Inc.
Compiled Tue 22-Jul-03 18:16 by hqluong
Image text-base: 0x22033FAC, data-base: 0x00005000
ROM: System Bootstrap, Version 11.1(474A) [jdisimon 104], INTERIM SOFTWARE
BOOTFLASH: 5200 Software (AS5200-BOOT-L), Version 11.1(7)AA, EARLY DEPLOYMENT
RELEASE SOFTWARE (fc2)
as05-mtl uptime is 14 hours, 59 minutes
System restarted by error - software forced crash, PC 0x221CEAD2 at 22:46:16 EDT
Mon Sep 13 2004
System image file is "flash:c5200-is-l.113-11b.T3.bin", booted via flash
cisco AS5200 (68030) processor (revision B) with 8192K/4096K bytes of memory.
Processor board ID 04277090
Bridging software.
X.25 software, Version 3.0.0.
SuperLAT software copyright 1990 by Meridian Technology Corp).
Primary Rate ISDN software, Version 1.1.
Mother board with terminator card.
1 Ethernet/IEEE 802.3 interface(s)
50 Serial network interface(s)
48 terminal line(s)
2 Channelized T1/PRI port(s)
128K bytes of non-volatile configuration memory.
8192K bytes of processor board System flash (Read ONLY)
4096K bytes of processor board Boot flash (Read/Write)
Configuration register is 0x2102
as05-mtl#sh stack
Minimum process stacks:
Free/Size Name
1732/2000 Reset ipc queue
2420/4000 Init
1220/2000 Microcom DSP download Process
1452/2000 RADIUS INITCONFIG
2272/4000 Virtual Exec
1012/2000 MAI Action Process
2596/4000 Exec
1672/2000 Async tty Reset
Interrupt level stacks:
Level Called Unused/Size Name
1 5263579 2544/3000 Async (CL-CD2430) transmit interrupts
2 3874824 2200/3000 Async (CD2430/Mica) receive interrupts
3 2007 2908/3000 Serial interface state change interrupt
4 7170726 2364/3000 Network interfaces
5 17261 2896/3000 Console Uart
6 2 2852/3000 DSX1 interface
System was restarted by error - software forced crash, PC 0x221CEAD2
5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE (fc1)
TAC Support: http://www.cisco.com/tac
Compiled Tue 22-Jul-03 18:16 by hqluong (current version)
Image text-base: 0x22033FAC, data-base: 0x00005000
Stack trace from system failure:
FP: 0x213DEC, RA: 0x221D281C
FP: 0x213DF8, RA: 0x221D2AE2
FP: 0x213E1C, RA: 0x221C893E
FP: 0x213E2C, RA: 0x221C8A0A
FP: 0x213E34, RA: 0x2215C950
FP: 0x213E44, RA: 0x2215CC60
FP: 0x213EB0, RA: 0x2215C9DA
FP: 0x213ECC, RA: 0x2204DF1E
***************************************************
******* Information of Last System Crash **********
***************************************************
as05-mtl#
pn
cd /pub; more beer
Le 2004-09-14 à 10:31, Aaron Leonard a écrit:
AL> Pierre,
AL>
AL>
AL> Please provide the output of "show version" and "show stack"
AL> from one of these 5200s after it has crashed and rebooted.
AL>
AL> Aaron
AL>
AL> --
AL>
AL> > hello all,
AL>
AL> > as of late, we experience sudden an unexplained reboots with the following
AL> > symptoms :
AL>
AL> > as07-xxx uptime is 15 hours, 17 minutes
AL> > System restarted by error - software forced crash, PC 0x221CEAD2 at 14:57:30 EDT Sun Sep 5 2004
AL>
AL> > as12-xxx uptime is 15 hours, 50 minutes
AL> > System restarted by error - software forced crash, PC 0x221CEAD2 at 14:25:31 EDT Sun Sep 5 2004
AL>
AL> > as16-xxx uptime is 15 hours, 32 minutes
AL> > System restarted by error - software forced crash, PC 0x221CEAD2 at 14:43:11 EDT Sun Sep 5 2004
AL>
AL> > as02-yyy uptime is 18 hours, 42 minutes
AL> > System restarted by error - software forced crash, PC 0x221CEAD2 at 11:35:00 EDT Sun Sep 5 2004
AL>
AL> > as03-yyy uptime is 17 hours, 39 minutes
AL> > System restarted by error - software forced crash, PC 0x221CEAD2 at 12:38:28 EDT Sun Sep 5 2004
AL>
AL> > (xxx and yyy are 2 different POPs). As you can see, the reboots are synchronized
AL> > in time. This leads me to think we have a reccurence of a problem we had a few
AL> > months back : there is a virus or worm that overwhelms those poor boxes and
AL> > forces a crash. The luser logs into a box, crashes it, hits redial, crashes
AL> > another box, redials again, crashes yet a third box and then quits.
AL>
AL> > I see two possible solutions :
AL> > 1. filter out the exact problem (if I can pinpoint it)
AL> > 2. install an IOS that is immune to the problem (and will not introduce new
AL> > ones, hopefully!)
AL>
AL> > --More info--
AL> > Current IOS is : IOS (tm) 5200 Software (C5200-IS-L), Version 11.3(11b)T3
AL> > System image file is "flash:c5200-is-l.113-11b.T3.bin"
AL>
AL> > Applied filter is :
AL> > interface Group-Async1
AL> > ip unnumbered Ethernet0
AL> > ip access-group 109 in
AL>
AL> > access-list 109 deny tcp any any eq 135
AL> > access-list 109 deny tcp any any eq 445
AL> > access-list 109 deny tcp any any eq 5000
AL> > access-list 109 deny icmp any any
AL> > access-list 109 permit ip xx.yy.zz.0 0.0.0.255 any
AL> > access-list 109 deny ip any any
AL>
AL> > (where xx.yy.zz is the netblock this NAS belongs to - this is the poor man's
AL> > reverse-path verify)
AL>
AL> > Any suggestion of improved filter is welcome. Any suggestion of an IOS that fits
AL> > in
AL> > cisco AS5200 (68030) processor (revision A) with 8192K/4096K bytes of memory.
AL> > 8192K bytes of processor board System flash (Read ONLY)
AL> > is alos welcome. (IP/Plus image not necessary - this just what we have not and
AL> > it works, so - not broken, not fixed!)
AL>
AL> > Thanks !
AL>
AL> > -------------------------------------------------------------------
AL> > Pierre Nepveu, CCNP tel: +1 514.380-4289
AL> > Administrateur de reseau +1 888.INFOVTL x 4289
AL> > Ingenierie / Acces Internet fax: +1 514 899-8452
AL> > Videotron Telecom Ltee (VTL) - Montreal (Quebec), Canada
AL> > -------------------------------------------------------------------
AL>
AL>
AL>
AL> > _______________________________________________
AL> > cisco-nas mailing list
AL> > cisco-nas at puck.nether.net
AL> > https://puck.nether.net/mailman/listinfo/cisco-nas
AL>
More information about the cisco-nas
mailing list