[cisco-nas] frequent reboot of AS-5200's
Pierre Nepveu
pnepveu at videotron.net
Tue Sep 14 17:39:21 EDT 2004
Mark,
thanks. I'll try that and keep you posted.
pn
cd /pub; more beer
Le 2004-09-14 à 11:09, Mark Johnson a écrit:
MJ> At 01:51 PM 9/14/2004 -0400, Pierre Nepveu wrote:
MJ> >hi guys,
MJ> >
MJ> >you both asked for <sh stack> within 7 minutes of one another ! We should
MJ> >have a
MJ> >new Olympic event : synchronized help desk just for you !
MJ>
MJ> There are quite a few bugs that may relate to this sort of problem (the
MJ> cause is likely ISDN and memory utilization), one of which is CSCdp40742,
MJ> fixed in 12.1(9).
MJ>
MJ> Is it possible to upgrade at least one of your router's (say to the latest
MJ> 12.1), to see how that reacts? Seems like you should no soon if it made a
MJ> positive improvement.
MJ>
MJ> mark
MJ>
MJ>
MJ> >Here goes :
MJ> >(this one is not very fresh... about 1 1/2 day. Below is the freshest I've
MJ> >got -
MJ> >about 5 hours. Thanks for your help!)
MJ> >
MJ> >as01-91q-mtl#sh stack
MJ> >Minimum process stacks:
MJ> > Free/Size Name
MJ> > 1732/2000 Reset ipc queue
MJ> > 2420/4000 Init
MJ> > 1220/2000 Microcom DSP download Process
MJ> > 1456/2000 RADIUS INITCONFIG
MJ> > 1012/2000 MAI Action Process
MJ> > 2884/4000 Exec
MJ> > 1672/2000 Async tty Reset
MJ> > 2272/4000 Virtual Exec
MJ> >
MJ> >Interrupt level stacks:
MJ> >Level Called Unused/Size Name
MJ> > 1 17193915 2544/3000 Async (CL-CD2430) transmit interrupts
MJ> > 2 20615196 2200/3000 Async (CD2430/Mica) receive interrupts
MJ> > 3 4596 2908/3000 Serial interface state change interrupt
MJ> > 4 22397619 2364/3000 Network interfaces
MJ> > 5 21868 2896/3000 Console Uart
MJ> > 6 2 2852/3000 DSX1 interface
MJ> >
MJ> >System was restarted by error - software forced crash, PC 0x221CEAD2
MJ> >5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE (fc1)
MJ> >TAC Support: http://www.cisco.com/tac
MJ> >Compiled Tue 22-Jul-03 18:16 by hqluong (current version)
MJ> >Image text-base: 0x22033FAC, data-base: 0x00005000
MJ> >
MJ> >
MJ> >Stack trace from system failure:
MJ> >FP: 0x2132D4, RA: 0x221D281C
MJ> >FP: 0x2132E0, RA: 0x221D2AE2
MJ> >FP: 0x213304, RA: 0x221C893E
MJ> >FP: 0x213314, RA: 0x221C8A0A
MJ> >FP: 0x21331C, RA: 0x2215C950
MJ> >FP: 0x21332C, RA: 0x2215CC60
MJ> >FP: 0x213398, RA: 0x2215C9DA
MJ> >FP: 0x2133B4, RA: 0x2204DF1E
MJ> >
MJ> >
MJ> >***************************************************
MJ> >******* Information of Last System Crash **********
MJ> >***************************************************
MJ> >
MJ> >
MJ> >as01-91q-mtl#
MJ> >
MJ> > -/-/-/-/-/-/
MJ> >
MJ> >as05-mtl#sh ver
MJ> >Cisco Internetwork Operating System Software
MJ> >IOS (tm) 5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE
MJ> >(fc1)
MJ> >TAC Support: http://www.cisco.com/tac
MJ> >Copyright (c) 1986-2003 by cisco Systems, Inc.
MJ> >Compiled Tue 22-Jul-03 18:16 by hqluong
MJ> >Image text-base: 0x22033FAC, data-base: 0x00005000
MJ> >
MJ> >ROM: System Bootstrap, Version 11.1(474A) [jdisimon 104], INTERIM SOFTWARE
MJ> >BOOTFLASH: 5200 Software (AS5200-BOOT-L), Version 11.1(7)AA, EARLY DEPLOYMENT
MJ> >RELEASE SOFTWARE (fc2)
MJ> >
MJ> >as05-mtl uptime is 14 hours, 59 minutes
MJ> >System restarted by error - software forced crash, PC 0x221CEAD2 at
MJ> >22:46:16 EDT
MJ> >Mon Sep 13 2004
MJ> >System image file is "flash:c5200-is-l.113-11b.T3.bin", booted via flash
MJ> >
MJ> >cisco AS5200 (68030) processor (revision B) with 8192K/4096K bytes of memory.
MJ> >Processor board ID 04277090
MJ> >Bridging software.
MJ> >X.25 software, Version 3.0.0.
MJ> >SuperLAT software copyright 1990 by Meridian Technology Corp).
MJ> >Primary Rate ISDN software, Version 1.1.
MJ> >Mother board with terminator card.
MJ> >1 Ethernet/IEEE 802.3 interface(s)
MJ> >50 Serial network interface(s)
MJ> >48 terminal line(s)
MJ> >2 Channelized T1/PRI port(s)
MJ> >128K bytes of non-volatile configuration memory.
MJ> >8192K bytes of processor board System flash (Read ONLY)
MJ> >4096K bytes of processor board Boot flash (Read/Write)
MJ> >
MJ> >Configuration register is 0x2102
MJ> >
MJ> >as05-mtl#sh stack
MJ> >Minimum process stacks:
MJ> > Free/Size Name
MJ> > 1732/2000 Reset ipc queue
MJ> > 2420/4000 Init
MJ> > 1220/2000 Microcom DSP download Process
MJ> > 1452/2000 RADIUS INITCONFIG
MJ> > 2272/4000 Virtual Exec
MJ> > 1012/2000 MAI Action Process
MJ> > 2596/4000 Exec
MJ> > 1672/2000 Async tty Reset
MJ> >
MJ> >Interrupt level stacks:
MJ> >Level Called Unused/Size Name
MJ> > 1 5263579 2544/3000 Async (CL-CD2430) transmit interrupts
MJ> > 2 3874824 2200/3000 Async (CD2430/Mica) receive interrupts
MJ> > 3 2007 2908/3000 Serial interface state change interrupt
MJ> > 4 7170726 2364/3000 Network interfaces
MJ> > 5 17261 2896/3000 Console Uart
MJ> > 6 2 2852/3000 DSX1 interface
MJ> >
MJ> >System was restarted by error - software forced crash, PC 0x221CEAD2
MJ> >5200 Software (C5200-IS-L), Version 11.3(11b)T3, RELEASE SOFTWARE (fc1)
MJ> >TAC Support: http://www.cisco.com/tac
MJ> >Compiled Tue 22-Jul-03 18:16 by hqluong (current version)
MJ> >Image text-base: 0x22033FAC, data-base: 0x00005000
MJ> >
MJ> >
MJ> >Stack trace from system failure:
MJ> >FP: 0x213DEC, RA: 0x221D281C
MJ> >FP: 0x213DF8, RA: 0x221D2AE2
MJ> >FP: 0x213E1C, RA: 0x221C893E
MJ> >FP: 0x213E2C, RA: 0x221C8A0A
MJ> >FP: 0x213E34, RA: 0x2215C950
MJ> >FP: 0x213E44, RA: 0x2215CC60
MJ> >FP: 0x213EB0, RA: 0x2215C9DA
MJ> >FP: 0x213ECC, RA: 0x2204DF1E
MJ> >
MJ> >
MJ> >***************************************************
MJ> >******* Information of Last System Crash **********
MJ> >***************************************************
MJ> >
MJ> >
MJ> >as05-mtl#
MJ> >
MJ> >
MJ> >pn
MJ> >cd /pub; more beer
MJ> >
MJ> >
MJ> >Le 2004-09-14 à 10:31, Aaron Leonard a écrit:
MJ> >
MJ> >AL> Pierre,
MJ> >AL>
MJ> >AL>
MJ> >AL> Please provide the output of "show version" and "show stack"
MJ> >AL> from one of these 5200s after it has crashed and rebooted.
MJ> >AL>
MJ> >AL> Aaron
MJ> >AL>
MJ> >AL> --
MJ> >AL>
MJ> >AL> > hello all,
MJ> >AL>
MJ> >AL> > as of late, we experience sudden an unexplained reboots with the
MJ> >following
MJ> >AL> > symptoms :
MJ> >AL>
MJ> >AL> > as07-xxx uptime is 15 hours, 17 minutes
MJ> >AL> > System restarted by error - software forced crash, PC 0x221CEAD2
MJ> >at 14:57:30 EDT Sun Sep 5 2004
MJ> >AL>
MJ> >AL> > as12-xxx uptime is 15 hours, 50 minutes
MJ> >AL> > System restarted by error - software forced crash, PC 0x221CEAD2
MJ> >at 14:25:31 EDT Sun Sep 5 2004
MJ> >AL>
MJ> >AL> > as16-xxx uptime is 15 hours, 32 minutes
MJ> >AL> > System restarted by error - software forced crash, PC 0x221CEAD2
MJ> >at 14:43:11 EDT Sun Sep 5 2004
MJ> >AL>
MJ> >AL> > as02-yyy uptime is 18 hours, 42 minutes
MJ> >AL> > System restarted by error - software forced crash, PC 0x221CEAD2
MJ> >at 11:35:00 EDT Sun Sep 5 2004
MJ> >AL>
MJ> >AL> > as03-yyy uptime is 17 hours, 39 minutes
MJ> >AL> > System restarted by error - software forced crash, PC 0x221CEAD2
MJ> >at 12:38:28 EDT Sun Sep 5 2004
MJ> >AL>
MJ> >AL> > (xxx and yyy are 2 different POPs). As you can see, the reboots are
MJ> >synchronized
MJ> >AL> > in time. This leads me to think we have a reccurence of a problem we
MJ> >had a few
MJ> >AL> > months back : there is a virus or worm that overwhelms those poor
MJ> >boxes and
MJ> >AL> > forces a crash. The luser logs into a box, crashes it, hits redial,
MJ> >crashes
MJ> >AL> > another box, redials again, crashes yet a third box and then quits.
MJ> >AL>
MJ> >AL> > I see two possible solutions :
MJ> >AL> > 1. filter out the exact problem (if I can pinpoint it)
MJ> >AL> > 2. install an IOS that is immune to the problem (and will not
MJ> >introduce new
MJ> >AL> > ones, hopefully!)
MJ> >AL>
MJ> >AL> > --More info--
MJ> >AL> > Current IOS is : IOS (tm) 5200 Software (C5200-IS-L), Version
MJ> >11.3(11b)T3
MJ> >AL> > System image file is "flash:c5200-is-l.113-11b.T3.bin"
MJ> >AL>
MJ> >AL> > Applied filter is :
MJ> >AL> > interface Group-Async1
MJ> >AL> > ip unnumbered Ethernet0
MJ> >AL> > ip access-group 109 in
MJ> >AL>
MJ> >AL> > access-list 109 deny tcp any any eq 135
MJ> >AL> > access-list 109 deny tcp any any eq 445
MJ> >AL> > access-list 109 deny tcp any any eq 5000
MJ> >AL> > access-list 109 deny icmp any any
MJ> >AL> > access-list 109 permit ip xx.yy.zz.0 0.0.0.255 any
MJ> >AL> > access-list 109 deny ip any any
MJ> >AL>
MJ> >AL> > (where xx.yy.zz is the netblock this NAS belongs to - this is the
MJ> >poor man's
MJ> >AL> > reverse-path verify)
MJ> >AL>
MJ> >AL> > Any suggestion of improved filter is welcome. Any suggestion of an
MJ> >IOS that fits
MJ> >AL> > in
MJ> >AL> > cisco AS5200 (68030) processor (revision A) with 8192K/4096K
MJ> >bytes of memory.
MJ> >AL> > 8192K bytes of processor board System flash (Read ONLY)
MJ> >AL> > is alos welcome. (IP/Plus image not necessary - this just what we
MJ> >have not and
MJ> >AL> > it works, so - not broken, not fixed!)
MJ> >AL>
MJ> >AL> > Thanks !
MJ> >AL>
MJ> >AL> > -------------------------------------------------------------------
MJ> >AL> > Pierre Nepveu, CCNP tel: +1 514.380-4289
MJ> >AL> > Administrateur de reseau +1 888.INFOVTL x 4289
MJ> >AL> > Ingenierie / Acces Internet fax: +1 514 899-8452
MJ> >AL> > Videotron Telecom Ltee (VTL) - Montreal (Quebec), Canada
MJ> >AL> > -------------------------------------------------------------------
MJ> >AL>
MJ> >AL>
MJ> >AL>
MJ> >AL> > _______________________________________________
MJ> >AL> > cisco-nas mailing list
MJ> >AL> > cisco-nas at puck.nether.net
MJ> >AL> > https://puck.nether.net/mailman/listinfo/cisco-nas
MJ> >AL>
MJ>
MJ>
More information about the cisco-nas
mailing list