[c-nsp] 7200 LNS Rebooting

[e ninja]

Kurt,

The enclosed captures are badly formatted irrespective, the cause of this
crash seems to be a memory corruption/leak or one of the thousands (no
kiddin) of bugs reported daily in the cisco ios T (technology) train.

You will not be serving your business and customers well if you stay on the
T-train because it simply contains way too many bugs. The rule of thumb is -
only use the T-train if and only if a_really_really_must_have feature was
recently introduced in it.

Staying on the T-trains would turn your network into an external QA test-bed
for cisco ;-)

/eninja




On Tue, Feb 12, 2008 at 8:12 PM, Kurt Bales <kwbales at kwbales.net> wrote:

> Hey Guys,
>
> I have a customer with a 7200-G1 acting as an LNS (currently terminating
> about 400 PPPoE Sessions). The machine has been locking up and rebooting
> for
> the past week. As shown below this router is running 12.4(15)T1 AdvIP.
>
> Other than upgrading to T3, does anybody have any suggestions on where to
> look. I am some what concerned about the Processor memory pool being
> marked
> as corrupted in the show stacks from the last reboot.
>
> Here is from the sh ver:
>
>
> ############################################################################
> #######
> EQ_7204G1_LNS uptime is 36 minutes
> System returned to ROM by error - an unknown failure, PC 0x606AB234 at
> 14:07:43 AEDST Wed Feb 13 2008
> System restarted at 14:10:32 AEDST Wed Feb 13 2008
> System image file is "disk2:c7200-advipservicesk9-mz.124-15.T1.bin"
>
> ############################################################################
> #######
>
> Next here is an intersting part from the show stacks:
>
>
> ############################################################################
> #######
> ------------------ show memory summary ------------------
>
>
>                Head    Total(b)     Used(b)     Free(b)   Lowest(b)
> Largest(b)
> Processor   6567F9C0  >        0  >        0  >        0           0
> Corrupted
>      I/O    C000000    67108864     3653240    63455624    63159952
> 58144252
> Transient   7B000000    16777216       10688    16766528    16339872
> 16766528
>
>
>
>
>          Processor memory
>
> Alloc PC        Size     Blocks      Bytes    What
>
>  Corrupted pool
>
> ############################################################################
> #######
>
> And here is some output from the router just now:
>
> ############################################################################
> #######
> EQ_7204G1_LNS#show memory summary
>                Head    Total(b)     Used(b)     Free(b)   Lowest(b)
> Largest(b)
> Processor   65682110   899145228    45124180   854021048   853868616
> 345497100
>      I/O    C000000    67108864     3814420    63294444    63184992
> 62674620
> Transient   7B000000    16777216       10688    16766528    16756956
> 16766528
>
> ############################################################################
> #######
>
> Previously in another reboot, show stacks included the following:
>
>
> ############################################################################
> #######
> Feb 10 18:49:52.236 AEDST: %LINK-3-UPDOWN: Interface Virtual-Access59,
> changed state to down
> Feb 10 18:49:52.236 AEDST: %SYS-2-LINKED: Bad enqueue of 0 in queue
> 657F481C
> -Process= "Pool Manager", ipl= 4, pid= 6,  -Traceback= 0x612DA868
> 0x60008D64
> 0x6001FA00 0x6001FC40
> Feb 10 18:49:52.236 AEDST: %SYS-2-LINKED: Bad enqueue of 0 in queue
> 657F481C
> -Process= "Pool Manager", ipl= 4, pid= 6,  -Traceback= 0x612DA868
> 0x60008D64
> 0x6001FA00 0x6001FC40
> Feb 10 18:49:52.256 AEDST: %SYS-2-LINKED: Bad enqueue of 0 in queue
> 657F49A8
> -Process= "Pool Manager", ipl= 4, pid= 6,  -Traceback= 0x612DA868
> 0x60008D64
> 0x6001FA00 0x6001FC40
> Feb 10 18:49:52.256 AEDST: %SYS-2-LINKED: Bad enqueue of 0 in queue
> 657F49A8
> -Process= "Pool Manager", ipl= 4, pid= 6,  -Traceback= 0x612DA868
> 0x60008D64
> 0x6001FA00 0x6001FC40
> File bootflash:crashinfo_20080210-074952 open failed (-1): File is
> read-only
> Feb 10 18:49:52.328 AEDST: %SYS-2-CFORKMEM: Process creation of DFS flush
> periodic failed (no memory). -Process= "Crash writer", ipl= 0, pid= 18,
> -Traceback= 0x612DA868 0x6257CA58 0x6257CCD8 0x6011E9E4 0x6010DDF4
> 0x6010D248 0x6012582C 0x617F2708 0x617EEF5C 0x61380CB8 0x61380E98
> 0x61381578
> 0x613822B4 0x612F0A88 0x612EFAF0 0x612F08FC
>
> ############################################################################
> #######
>
>
> Kurt Bales
>
> _______________________________________________
> cisco-nsp mailing list  cisco-nsp at puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/
>