[c-nsp] ASR9001 Boot loop after upgrade iosxr 4.3.1-->4.3.4

somphong pokfai somphong.pokfai at gmail.com
Sat Feb 15 04:44:39 EST 2014


Hi all,

my asr9001 boot loop after upgrade iosxr 4.3.1-->4.3.4

logging
-------------------

¾†ùü˜

½µÁ¥±•‘Q¡ÕÁݵ•‰µǺÉÅéÍ၉偑…ͽµ…ÍÕ5)5)5ÿStarting Initialization of
FMAN0ÍÙ¡ÉÁÅÍÁÉÁ]éÅÙÁáÅ奁mMIå-I=55=9u±5)5

Loading ucode for FMAN0, size: 6992, ver: 101.08.00

Starting Initialization of FMAN1

Loading ucode for FMAN1, size: 6992, ver: 101.08.00

Serdes Protocol: 0x10


CPU Reset Reason = 0x0001

Initializing GIGE SW...

PPC P40X0 (partnum 0x8023), Revision 02.00, (Core Version 02.00)


  Sys Clock:  100 Mhz

 Core Clock: 1500 Mhz

 Plat Clock:  800 Mhz

  LBC Clock:   25 Mhz

  MEM Clock: 1300 Mhz




System Bootstrap, Version 1.36(20130207:160819) [ASR9K ROMMON],

Copyright (c) 1994-2013 by Cisco Systems, Inc.


Compiled Thu 07-Feb-13 21:38 by dasomasu


Board Type:     0x100401

CPU Board => Rev: 0x3

=========

  FPGA ver: 01.0e

      CBC: 16.72



DTI programmed with latest image


TIMEX programmed with latest image

MLAN init done: ready to connect to the network

BCM5482PhyInit () : Port 0 --> SFP Not present

BCM5482PhyInit () : Port 1 --> SFP Not present


set_chassis_type: chassis_type=0xef0400 found=TRUE

ASR9001E (P40X0 PPC) RSP platform with 8192 Mb of main memory


program load complete, entry point: 0x100000, size: 0x2ac20

Set baud rate to: 9600

                      program load complete, entry point: 0x100000, size:
0x2ac20

Set baud rate to: 9600

                      program load complete, entry point: 0x100000, size:
0x2ac20

Set baud rate to: 9600

                      MBI Candidate =
disk0:asr9k-os-mbi-4.3.1/0x100000/mbiasr9k-rp.vm

MBI Candidate = disk0:asr9k-os-mbi-4.3.4/0x100000/mbiasr9k-rp.vm


    CARD_SLOT_NUMBER: 0

        CPU_INSTANCE: 1

MBI Validation starts ...


Disabling both Mgt LAN ports

Enabling Cluster Port 0 and disabling Port 1

BCM5482 cluster port-1 reset done !!

Port 0. SFP Not Ready (0:0). Init failed


dtsec_init_hw: configuring DTSEC (port 8) for: 1GB, Full Duplex

Interface link changed state to UP.

Interface link state up.


MBI validation sending request.

HIT CTRL-C to abort

..........

No MBI confirmation received from dSC



    CARD_SLOT_NUMBER: 0

        CPU_INSTANCE: 1

MBI Validation starts ...

Enabling Cluster Port 1 and disabling Port 0

BCM5482 cluster port-0 reset done !!

Port 1. SFP Not Ready (0:0). Init failed


dtsec_init_hw: configuring DTSEC (port 8) for: 1GB, Full Duplex

Interface link changed state to UP.

Interface link state up.


MBI validation sending request.

HIT CTRL-C to abort

..........

No MBI confirmation received from dSC


AUTOBOOT: Boot string =
disk0:asr9k-os-mbi-4.3.1/0x100000/mbiasr9k-rp.vm,1;disk0:asr9k-os-mbi-4.3.4/0x100000/mbiasr9k-rp.vm,2;

AUTOBOOT: autobootstate=0, autobootcount=0, cmd=boot
disk0:asr9k-os-mbi-4.3.1/0x100000/mbiasr9k-rp.vm


 Boot Status 16

program load complete, entry point: 0x100000, size: 0x2ac20

Set baud rate to: 9600


MBI size from header = 18526972,Bootflash resident MBI filesize = 18526972

.......................................................................

program load complete, entry point: 0x202518, size: 0x11aa3fc


 Boot Status 17

Config = SMP, Running = SMP

Board type: 0x00100401

Card Capability = 0x00000000

###############################################################################################

BSP: Board type : ASR9K-RSP-I

tracelogger: starting tracing in background ring mode

tracelogger running with args: -startring -F 1 -F 2

              Restricted Rights Legend


Use, duplication, or disclosure by the Government is

subject to restrictions as set forth in subparagraph

(c) of the Commercial Computer Software - Restricted

Rights clause at FAR sec. 52.227-19 and subparagraph

(c) (1) (ii) of the Rights in Technical Data and Computer

Software clause at DFARS sec. 252.227-7013.


           cisco Systems, Inc.

           170 West Tasman Drive

           San Jose, California 95134-1706




Cisco IOS XR Software for the Cisco XR ASR9K, Version 4.3.1

Copyright (c) 2013 by Cisco Systems, Inc.

Feb 15 01:58:06.854: Install Setup: Booting with software activated by
previous install operation

Feb 15 01:58:46.224: Install Setup: This node was booted with an incorrect
MBI version (/bootflash/disk0/asr9k-os-mbi-4.3.1/0x100000/mbiasr9k-rp.vm)
and will now reset to boot with the correct MBI
(/bootflash/disk0/asr9k-os-mbi-4.3.4/0x100000/mbiasr9k-rp.vm)

Spawning instdir_show_ltrace -r  failed. : No such file or directory

Spawning instdir_show_ltrace -Z -r failed. : No such file or directory

Spawning inst_rds_show_ltrace -r  failed. : No such file or directory

[0x11e279e1b] Record Reboot History, reboot cause = 0x4000048, descr =
Cause: dSC booted with incorrect MBI
  Process: instsetup
      Traceback: 4ba5c248 4ba5crebooting

½µÁ¥±•‘Q¡ÕÁݵ•‰µǺÉÅéÍ၉偑…ͽµ…ÍÕ5)5)5ÿStarting Initialization of
FMAN0ÍÙ¡ÉÁÅÍÁÉÁýéÅÙÁáÅ奁mMIå-I=55=9u±5)5

Loading ucode for FMAN0, size: 6992, ver: 101.08.00

Starting Initialization of FMAN1

Loading ucode for FMAN1, size: 6992, ver: 101.08.00

Serdes Protocol: 0x10


CPU Reset Reason = 0x0001

Initializing GIGE SW...

PPC P40X0 (partnum 0x8023), Revision 02.00, (Core Version 02.00)


  Sys Clock:  100 Mhz

 Core Clock: 1500 Mhz

 Plat Clock:  800 Mhz

  LBC Clock:   25 Mhz

  MEM Clock: 1300 Mhz




System Bootstrap, Version 1.36(20130207:160819) [ASR9K ROMMON],

Copyright (c) 1994-2013 by Cisco Systems, Inc.


Compiled Thu 07-Feb-13 21:38 by dasomasu


Board Type:     0x100401

CPU Board => Rev: 0x3

=========

  FPGA ver: 01.0e

      CBC: 16.72



DTI programmed with latest image


TIMEX programmed with latest image

MLAN init done: ready to connect to the network

BCM5482PhyInit () : Port 0 --> SFP Not present

BCM5482PhyInit () : Port 1 --> SFP Not present


set_chassis_type: chassis_type=0xef0400 found=TRUE

ASR9001E (P40X0 PPC) RSP platform with 8192 Mb of main memory


program load complete, entry point: 0x100000, size: 0x2ac20

Set baud rate to: 9600

                      program load complete, entry point: 0x100000, size:
0x2ac20

Set baud rate to: 9600

                      MBI Candidate =
disk0:asr9k-os-mbi-4.3.4/0x100000/mbiasr9k-rp.vm


    CARD_SLOT_NUMBER: 0

        CPU_INSTANCE: 1

MBI Validation starts ...


Disabling both Mgt LAN ports

Enabling Cluster Port 0 and disabling Port 1

BCM5482 cluster port-1 reset done !!

Port 0. SFP Not Ready (0:0). Init failed


dtsec_init_hw: configuring DTSEC (port 8) for: 1GB, Full Duplex

Interface link changed state to UP.

Interface link state up.


MBI validation sending request.

HIT CTRL-C to abort

..........

No MBI confirmation received from dSC



    CARD_SLOT_NUMBER: 0

        CPU_INSTANCE: 1

MBI Validation starts ...

Enabling Cluster Port 1 and disabling Port 0

BCM5482 cluster port-0 reset done !!

Port 1. SFP Not Ready (0:0). Init failed


dtsec_init_hw: configuring DTSEC (port 8) for: 1GB, Full Duplex

Interface link changed state to UP.

Interface link state up.


MBI validation sending request.

HIT CTRL-C to abort

..........

No MBI confirmation received from dSC


AUTOBOOT: Boot string = disk0:asr9k-os-mbi-4.3.4/0x100000/mbiasr9k-rp.vm,1;

AUTOBOOT: autobootstate=0, autobootcount=0, cmd=boot
disk0:asr9k-os-mbi-4.3.4/0x100000/mbiasr9k-rp.vm


 Boot Status 16

program load complete, entry point: 0x100000, size: 0x2ac20

Set baud rate to: 9600


MBI size from header = 18581552,Bootflash resident MBI filesize = 18581552

.......................................................................

program load complete, entry point: 0x202518, size: 0x11b7930


 Boot Status 17

Config = SMP, Running = SMP

Board type: 0x00100401

Card Capability = 0x00000000

################################################################################################

BSP: Board type : ASR9K-RSP-I

tracelogger: starting tracing in background ring mode

tracelogger running with args: -startring -F 1 -F 2

              Restricted Rights Legend


Use, duplication, or disclosure by the Government is

subject to restrictions as set forth in subparagraph

(c) of the Commercial Computer Software - Restricted

Rights clause at FAR sec. 52.227-19 and subparagraph

(c) (1) (ii) of the Rights in Technical Data and Computer

Software clause at DFARS sec. 252.227-7013.


           cisco Systems, Inc.

           170 West Tasman Drive

           San Jose, California 95134-1706




Cisco IOS XR Software for the Cisco XR ASR9K, Version 4.3.4

Copyright (c) 2013 by Cisco Systems, Inc.

Feb 15 02:00:53.585: Install Setup: Booting with software activated by
previous install operation

Feb 15 02:02:01.997: Install Setup: Failed to update the package file
system: (2) No such file or directory

Feb 15 02:02:01.997: Install Setup: Install Setup (pid 77874) has failed to
prepare this node successfully and will now exit: (2) No such file or
directory

Feb 15 02:02:35.258: Install Setup: Booting with software activated by
previous install operation

Feb 15 02:03:40.335: Install Setup: Failed to update the package file
system: (2) No such file or directory

Feb 15 02:03:40.335: Install Setup: Install Setup (pid 360480) has failed
to prepare this node successfully and will now exit: (2) No such file or
directory

Feb 15 02:04:13.506: Install Setup: Booting with software activated by
previous install operation

Failed to rename debug file, 18, src: /nvram:/sysmgr.log.timeout.Z, target:
/nvram:/prev.sysmgr.log.timeout.Z

Feb 15 02:05:14.402 : SYSMGR_LITE: Saving init logs in
/nvram:/sysmgr.log.timeout.Z ...

Feb 15 02:05:18.775: Install Setup: Failed to update the package file
system: (2) No such file or directory

Feb 15 02:05:18.776: Install Setup: Install Setup (pid 606240) has failed
to prepare this node successfully and will now exit: (2) No such file or
directory

Feb 15 02:05:52.038: Install Setup: Booting with software activated by
previous install operation

Feb 15 02:06:57.341: Install Setup: Failed to update the package file
system: (2) No such file or directory

Feb 15 02:06:57.341: Install Setup: Install Setup (pid 852000) has failed
to prepare this node successfully and will now exit: (2) No such file or
directory

Feb 15 02:07:30.511: Install Setup: Booting with software activated by
previous install operation

Feb 15 02:08:35.713: Install Setup: Failed to update the package file
system: (2) No such file or directory

Feb 15 02:08:35.713: Install Setup: Install Setup (pid 1097760) has failed
to prepare this node successfully and will now exit: (2) No such file or
directory

Failed to rename debug file, 18, src: /nvram:/sysmgr.log.timeout.Z, target:
/nvram:/prev.sysmgr.log.timeout.Z

Feb 15 02:08:38.883 : SYSMGR_LITE: Saving init logs in
/nvram:/sysmgr.log.timeout.Z ...

Feb 15 02:08:39.113 : SYSMGR_LITE: INIT: respawn 'instsetup' disabled,
exit_code 256, INIT_MAX_SPAWN reached

Writing crashinfo

Active processes:

        pkg/bin/devb-umass Thread ID 4 on cpu 0


Active processes:

        asr9k-os-4.3.4/0x100000/bin/init Thread ID 1 on cpu 1


Active processes:

        pkg/bin/pkgfs Thread ID 4 on cpu 2


Active processes:

        proc/boot/procnto-booke-smp-instr Thread ID 3 on cpu 3


[0x5f28ddc95] Record Reboot History, reboot cause = 0x2c000007, descr =
Cause: INIT: respawn 'instsetup' disabled, exit_code 256, INIT_MAX_SPAWN
reached Process: init
            Traceback: 4b8c0248 4[0x5f36bc01e] Record crashinfo

[0x5f38b01ed] Record Syslog

Starting Initialization of FMAN0

Starting Initialization of FMAN1


MAC link is up.



Mgt LAN 0 interface is selected

MLAN init done: ready to connect to the network

2014-02-15 02:08:39.245

NOTE: This is NOT a Kernel Crash. This crash was triggered

      by the process 'init', by calling reboot API.


Crash Reason: Cause: INIT: respawn 'instsetup' disabled, exit_code 256,
INIT_MAX_SPAWN reached Process: init
                            Traceback: 4b8c0248 4b8c06b8 4b8c0a1c 40008968
4b812400 0 (Cause Code: 0x2c000007)


Exception at 0x4b8c0764 signal 5 c=1 f=3


Active process(s):

        pkg/bin/devb-umass Thread ID 4 on cpu 0

        asr9k-os-4.3.4/0x100000/bin/init Thread ID 1 on cpu 1

        pkg/bin/pkgfs Thread ID 4 on cpu 2

        proc/boot/procnto-booke-smp-instr Thread ID 3 on cpu 3


       REGISTER INFO

        r0        r1        r2        r3

  R0   4b8c0760  3ff7ef00  5000f310  00000003

        r4        r5        r6        r7

  R4   28000007  500195a0  3ff7eed8  00000000

        r8        r9       r10       r11

  R8   50c25a00  00000000  0e7be2c0  ec00656c

       r12       r13       r14       r15

  R12  4b8f3c54  5000f310  00000000  00000000

       r16       r17       r18       r19

  R16  00000000  00000000  00000000  00000000

       r20       r21       r22       r23

  R20  00000000  00000000  00000000  00000000

       r24       r25       r26       r27

  R24  00000000  00000000  00000000  00000000

       r28       r29       r30       r31

  R28  500195a0  00000000  ec006980  28000007

       cnt        lr       msr        pc

  R32  4b9e10d8  4b8c0760  0002db32  4b8c0764

       cnd       xer

  R36  44004084  20000000


               SUPERVISOR REGISTERS


          DBCR0          DBCR1          DBCR2

              0              0              0

           DBSR           DEAR            ESR           IVPR

              0       3ff7ef04        2000000              0

          IVOR0          IVOR1          IVOR2          IVOR3

              0           17d0            b10            a20

          IVOR4          IVOR5          IVOR6          IVOR7

           11b0            840            930            c00

          IVOR8          IVOR9         IVOR10         IVOR11

            770             90           12d0           13f0

         IVOR12         IVOR13         IVOR14         IVOR15

           1510            ef0           1050            620

            PID            PIR            TCR            TSR

              7             20              0              0

          SPRG4          SPRG5          SPRG6          SPRG7

        ffea000       17f49d10              0       24004088

           MAS0           MAS1           MAS2           MAS3

       103f0000           1100       fffc0004           e003

           MAS4          xMAS5           MAS6         IVOR35

            104              0          70001            230

           HID0          BUCSR

       80000080              1

           MAS7

              0


 STACK TRACE

#0 0x4b8c0760

[0x5fe82ed83] Initializing bootflash file system

!!!

Writing crashinfo done!


Examine crashinfo file for reboot reason


Writing ppc kernel core file

[0x600aa8350] Kernel core dump start...

fill phdr vaddr=0x17bc9000, offset=0x2f5e834, size=0x437000

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Core dump success. Total_size 54089780

[0x63d1ce917] Successfully dumped Kernel core

[0x63d45e158] Record PCDS information


Writing PCDS done

Dump Directory

KD: RSP0.140215-020839.crashinfo.by.init, start = 1c01000, size = 13746,
crc = 0

KD: RSP0.140215-020839.kernel_core.by.init.Z, start = 1c15000, size =
347fac, crc = 19ad84d7

KD: RSP0.140215-020839.pcds, start = 1f5d000, size = ff000, crc = 70ecbf9


Writing kernel core file done!

rebooting


More information about the cisco-nsp mailing list