[cisco-nas] frequent reboot of AS-5200's
Mark Johnson
mljohnso at cisco.com
Tue Sep 14 15:09:00 EDT 2004
At 01:51 PM 9/14/2004 -0400, Pierre Nepveu wrote:
>hi guys,
>
>you both asked for <sh stack> within 7 minutes of one another ! We should
>have a
>new Olympic event : synchronized help desk just for you !
There are quite a few bugs that may relate to this sort of problem (the
cause is likely ISDN and memory utilization), one of which is CSCdp40742,
fixed in 12.1(9).
Is it possible to upgrade at least one of your router's (say to the latest
12.1), to see how that reacts? Seems like you should no soon if it made a
positive improvement.
mark
>Here goes :
>(this one is not very fresh... about 1 1/2 day. Below is the freshest I've
>got -
>about 5 hours. Thanks for your help!)
>
>as01-91q-mtl#sh stack
>Minimum process stacks:
> Free/Size Name
> 1732/2000 Reset ipc queue
> 2420/4000 Init
> 1220/2000 Microcom DSP download Process
> 1456/2000 RADIUS INITCONFIG
> 1012/2000 MAI Action Process
> 2884/4000 Exec
> 1672/2000 Async tty Reset
> 2272/4000 Virtual Exec
>
>Interrupt level stacks:
>Level Called Unused/Size Name
> 1 17193915 2544/3000 Async (CL-CD2430) transmit interrupts
> 2 20615196 2200/3000 Async (CD2430/Mica) receive interrupts
> 3 4596 2908/3000 Serial interface state change interrupt
> 4 22397619 2364/3000 Network interfaces
> 5 21868 2896/3000 Console Uart
> 6 2 2852/3000 DSX1 interface
>
>System was restarted by error - software forced crash, PC 0x221CEAD2
>5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE (fc1)
>TAC Support: http://www.cisco.com/tac
>Compiled Tue 22-Jul-03 18:16 by hqluong (current version)
>Image text-base: 0x22033FAC, data-base: 0x00005000
>
>
>Stack trace from system failure:
>FP: 0x2132D4, RA: 0x221D281C
>FP: 0x2132E0, RA: 0x221D2AE2
>FP: 0x213304, RA: 0x221C893E
>FP: 0x213314, RA: 0x221C8A0A
>FP: 0x21331C, RA: 0x2215C950
>FP: 0x21332C, RA: 0x2215CC60
>FP: 0x213398, RA: 0x2215C9DA
>FP: 0x2133B4, RA: 0x2204DF1E
>
>
>***************************************************
>******* Information of Last System Crash **********
>***************************************************
>
>
>as01-91q-mtl#
>
> -/-/-/-/-/-/
>
>as05-mtl#sh ver
>Cisco Internetwork Operating System Software
>IOS (tm) 5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE
>(fc1)
>TAC Support: http://www.cisco.com/tac
>Copyright (c) 1986-2003 by cisco Systems, Inc.
>Compiled Tue 22-Jul-03 18:16 by hqluong
>Image text-base: 0x22033FAC, data-base: 0x00005000
>
>ROM: System Bootstrap, Version 11.1(474A) [jdisimon 104], INTERIM SOFTWARE
>BOOTFLASH: 5200 Software (AS5200-BOOT-L), Version 11.1(7)AA, EARLY DEPLOYMENT
>RELEASE SOFTWARE (fc2)
>
>as05-mtl uptime is 14 hours, 59 minutes
>System restarted by error - software forced crash, PC 0x221CEAD2 at
>22:46:16 EDT
>Mon Sep 13 2004
>System image file is "flash:c5200-is-l.113-11b.T3.bin", booted via flash
>
>cisco AS5200 (68030) processor (revision B) with 8192K/4096K bytes of memory.
>Processor board ID 04277090
>Bridging software.
>X.25 software, Version 3.0.0.
>SuperLAT software copyright 1990 by Meridian Technology Corp).
>Primary Rate ISDN software, Version 1.1.
>Mother board with terminator card.
>1 Ethernet/IEEE 802.3 interface(s)
>50 Serial network interface(s)
>48 terminal line(s)
>2 Channelized T1/PRI port(s)
>128K bytes of non-volatile configuration memory.
>8192K bytes of processor board System flash (Read ONLY)
>4096K bytes of processor board Boot flash (Read/Write)
>
>Configuration register is 0x2102
>
>as05-mtl#sh stack
>Minimum process stacks:
> Free/Size Name
> 1732/2000 Reset ipc queue
> 2420/4000 Init
> 1220/2000 Microcom DSP download Process
> 1452/2000 RADIUS INITCONFIG
> 2272/4000 Virtual Exec
> 1012/2000 MAI Action Process
> 2596/4000 Exec
> 1672/2000 Async tty Reset
>
>Interrupt level stacks:
>Level Called Unused/Size Name
> 1 5263579 2544/3000 Async (CL-CD2430) transmit interrupts
> 2 3874824 2200/3000 Async (CD2430/Mica) receive interrupts
> 3 2007 2908/3000 Serial interface state change interrupt
> 4 7170726 2364/3000 Network interfaces
> 5 17261 2896/3000 Console Uart
> 6 2 2852/3000 DSX1 interface
>
>System was restarted by error - software forced crash, PC 0x221CEAD2
>5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE (fc1)
>TAC Support: http://www.cisco.com/tac
>Compiled Tue 22-Jul-03 18:16 by hqluong (current version)
>Image text-base: 0x22033FAC, data-base: 0x00005000
>
>
>Stack trace from system failure:
>FP: 0x213DEC, RA: 0x221D281C
>FP: 0x213DF8, RA: 0x221D2AE2
>FP: 0x213E1C, RA: 0x221C893E
>FP: 0x213E2C, RA: 0x221C8A0A
>FP: 0x213E34, RA: 0x2215C950
>FP: 0x213E44, RA: 0x2215CC60
>FP: 0x213EB0, RA: 0x2215C9DA
>FP: 0x213ECC, RA: 0x2204DF1E
>
>
>***************************************************
>******* Information of Last System Crash **********
>***************************************************
>
>
>as05-mtl#
>
>
>pn
>cd /pub; more beer
>
>
>Le 2004-09-14 à 10:31, Aaron Leonard a écrit:
>
>AL> Pierre,
>AL>
>AL>
>AL> Please provide the output of "show version" and "show stack"
>AL> from one of these 5200s after it has crashed and rebooted.
>AL>
>AL> Aaron
>AL>
>AL> --
>AL>
>AL> > hello all,
>AL>
>AL> > as of late, we experience sudden an unexplained reboots with the
>following
>AL> > symptoms :
>AL>
>AL> > as07-xxx uptime is 15 hours, 17 minutes
>AL> > System restarted by error - software forced crash, PC 0x221CEAD2
>at 14:57:30 EDT Sun Sep 5 2004
>AL>
>AL> > as12-xxx uptime is 15 hours, 50 minutes
>AL> > System restarted by error - software forced crash, PC 0x221CEAD2
>at 14:25:31 EDT Sun Sep 5 2004
>AL>
>AL> > as16-xxx uptime is 15 hours, 32 minutes
>AL> > System restarted by error - software forced crash, PC 0x221CEAD2
>at 14:43:11 EDT Sun Sep 5 2004
>AL>
>AL> > as02-yyy uptime is 18 hours, 42 minutes
>AL> > System restarted by error - software forced crash, PC 0x221CEAD2
>at 11:35:00 EDT Sun Sep 5 2004
>AL>
>AL> > as03-yyy uptime is 17 hours, 39 minutes
>AL> > System restarted by error - software forced crash, PC 0x221CEAD2
>at 12:38:28 EDT Sun Sep 5 2004
>AL>
>AL> > (xxx and yyy are 2 different POPs). As you can see, the reboots are
>synchronized
>AL> > in time. This leads me to think we have a reccurence of a problem we
>had a few
>AL> > months back : there is a virus or worm that overwhelms those poor
>boxes and
>AL> > forces a crash. The luser logs into a box, crashes it, hits redial,
>crashes
>AL> > another box, redials again, crashes yet a third box and then quits.
>AL>
>AL> > I see two possible solutions :
>AL> > 1. filter out the exact problem (if I can pinpoint it)
>AL> > 2. install an IOS that is immune to the problem (and will not
>introduce new
>AL> > ones, hopefully!)
>AL>
>AL> > --More info--
>AL> > Current IOS is : IOS (tm) 5200 Software (C5200-IS-L), Version
>11.3(11b)T3
>AL> > System image file is "flash:c5200-is-l.113-11b.T3.bin"
>AL>
>AL> > Applied filter is :
>AL> > interface Group-Async1
>AL> > ip unnumbered Ethernet0
>AL> > ip access-group 109 in
>AL>
>AL> > access-list 109 deny tcp any any eq 135
>AL> > access-list 109 deny tcp any any eq 445
>AL> > access-list 109 deny tcp any any eq 5000
>AL> > access-list 109 deny icmp any any
>AL> > access-list 109 permit ip xx.yy.zz.0 0.0.0.255 any
>AL> > access-list 109 deny ip any any
>AL>
>AL> > (where xx.yy.zz is the netblock this NAS belongs to - this is the
>poor man's
>AL> > reverse-path verify)
>AL>
>AL> > Any suggestion of improved filter is welcome. Any suggestion of an
>IOS that fits
>AL> > in
>AL> > cisco AS5200 (68030) processor (revision A) with 8192K/4096K
>bytes of memory.
>AL> > 8192K bytes of processor board System flash (Read ONLY)
>AL> > is alos welcome. (IP/Plus image not necessary - this just what we
>have not and
>AL> > it works, so - not broken, not fixed!)
>AL>
>AL> > Thanks !
>AL>
>AL> > -------------------------------------------------------------------
>AL> > Pierre Nepveu, CCNP tel: +1 514.380-4289
>AL> > Administrateur de reseau +1 888.INFOVTL x 4289
>AL> > Ingenierie / Acces Internet fax: +1 514 899-8452
>AL> > Videotron Telecom Ltee (VTL) - Montreal (Quebec), Canada
>AL> > -------------------------------------------------------------------
>AL>
>AL>
>AL>
>AL> > _______________________________________________
>AL> > cisco-nas mailing list
>AL> > cisco-nas at puck.nether.net
>AL> > https://puck.nether.net/mailman/listinfo/cisco-nas
>AL>
More information about the cisco-nas
mailing list