[c-nsp] WS-X6704-10GE to WS-X6708-10GE replacement

Mon May 23 09:24:58 EDT 2011

23.05.2011 15:47, Sergey Nikitin пишет:
> Hi,
>
> Was it WS-X6708-10G-3C or WS-X6708-10G-3CXL ?

It is WS-X6708-10G-3CXL. RSP is also 3CXL.

>
> Artyom Viklenko wrote:
>> Hi, list!
>>
>> We have CISCO 7604 router with the folowing:
>>
>> Mod Ports Card Type Model Serial No.
>> --- ---- -------------------------------------- ------------------
>> -----------
>> 1 2 Route Switch Processor 720 (Active) RSP720-3CXL-GE
>> 2 4 CEF720 4 port 10-Gigabit Ethernet WS-X6704-10GE
>> 3 48 CEF720 48 port 1000mb SFP WS-X6748-SFP
>> 4 48 CEF720 48 port 10/100/1000mb Ethernet WS-X6748-GE-TX
>>
>> Mod Hw Fw Sw Status
>> --- ------ ------------ ------------ -------
>> 1 5.2 12.2(33r)SRB 12.2(33)SRD5 Ok
>> 2 2.7 12.2(14r)S5 12.2(33)SRD5 Ok
>> 3 1.11 12.2(14r)S5 12.2(33)SRD5 Ok
>> 4 2.8 12.2(14r)S5 12.2(33)SRD5 Ok
>>
>> Mod Sub-Module Model Hw Status
>> ---- --------------------------- ------------------ ------- -------
>> 1 Policy Feature Card 3 7600-PFC3CXL 1.0 Ok
>> 1 C7600 MSFC4 Daughterboard 7600-MSFC4 1.1 Ok
>> 2 Centralized Forwarding Card WS-F6700-CFC 4.0 Ok
>> 3 Centralized Forwarding Card WS-F6700-CFC 4.0 Ok
>> 4 Centralized Forwarding Card WS-F6700-CFC 4.0 Ok
>>
>>
>> Recently we try to replace 6704 line card with 6708:
>>
>> Mod Ports Card Type Model
>> --- ----- -------------------------------------- ------------------
>> 2 8 CEF720 8 port 10GE with DFC WS-X6708-10GE
>>
>> Mod Hw Fw Sw Status
>> --- ------ ------------ ------------ -------
>> 2 1.4 12.2(18r)S1 12.2(33)SRD5 Ok
>>
>>
>> First of all, the folowing command was entered:
>> "no power enable mod 2"
>>
>> 10G interfaces goes down, status led on line card turns off.
>> After removing 6704 card and inserting 6708 router become unavail.
>> According to crashdump last evens was:
>>
>> May 20 15:45:42.446 EEST: %C7600_PWR-SP-4-DISABLED: power to module in
>> slot 2 set off (admin request)
>> May 20 15:45:42.490 EEST: %LINK-SP-3-UPDOWN: Interface
>> TenGigabitEthernet2/1, changed state to down
>> May 20 15:45:42.490 EEST: %LINK-SP-3-UPDOWN: Interface
>> TenGigabitEthernet2/2, changed state to down
>> May 20 15:45:42.490 EEST: %LINK-SP-3-UPDOWN: Interface
>> TenGigabitEthernet2/3, changed state to down
>> May 20 15:45:42.490 EEST: %LINK-SP-3-UPDOWN: Interface
>> TenGigabitEthernet2/4, changed state to down
>> May 20 15:45:42.494 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface TenGigabitEthernet2/1, changed state to down
>> May 20 15:45:42.494 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface TenGigabitEthernet2/2, changed state to down
>> May 20 15:45:42.494 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface TenGigabitEthernet2/3, changed state to down
>> May 20 15:45:42.494 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface TenGigabitEthernet2/4, changed state to down
>> May 20 15:46:18.414 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface GigabitEthernet3/3, changed state to down
>> May 20 15:46:18.418 EEST: %LINK-SP-3-UPDOWN: Interface
>> GigabitEthernet3/3, changed state to down
>> May 20 15:46:19.610 EEST: %LINK-SP-3-UPDOWN: Interface
>> GigabitEthernet3/3, changed state to up
>> May 20 15:46:20.058 EEST: %OIR-SP-6-REMCARD: Card removed from slot 2,
>> interfaces disabled
>> May 20 15:46:22.602 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface GigabitEthernet3/3, changed state to up
>> May 20 15:46:24.078 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface GigabitEthernet3/3, changed state to down
>> May 20 15:46:24.086 EEST: %LINK-SP-3-UPDOWN: Interface
>> GigabitEthernet3/3, changed state to down
>> May 20 15:46:27.930 EEST: %LINK-SP-3-UPDOWN: Interface
>> GigabitEthernet3/3, changed state to up
>> May 20 15:46:30.922 EEST: %LINEPROTO-SP-5-UPDOWN: Line protocol on
>> Interface GigabitEthernet3/3, changed state to up
>> May 20 15:47:14.491 EEST: %C7600_PWR-SP-4-DISABLED: power to module in
>> slot 2 set off (admin request)
>> May 20 15:47:24.211 EEST: %EARL-SP-2-PATCH_INVOCATION_LIMIT: 10
>> Recovery patch invocations in the last 30 secs have been attempted.
>> Max limit reached
>>
>> %Software-forced reload
>>
>>
>> But after reboot we found extremly large rtt to this router 6-9 secons
>> with typical 8 mS and near impossible ssh connection - too high CPU load.
>>
>> In general, for example after IOS upgrade this router backs online
>> withing 4 minutes. We wait 10 - no luck. We try to power cycle it.
>>
>> After more than typical 4 mins. we start to receive syslog messages from
>> it (no console output, unfortunatelly). According to these messages,
>> different ports on two 48-port line cards (SFP and Copper) fails
>> Loopback tests, and was err-disabled after they goes online.
>>
>> For example:
>>
>> *May 20 15:54:02.544 EEST: %DIAG-SP-3-MINOR: Module 4: Online
>> Diagnostics detected a Minor Error. Please use 'show diagnostic result
>> <target>' to see test results.
>> *May 20 15:54:02.544 EEST: %CONST_DIAG-SP-3-BOOTUP_TEST_FAIL: Module
>> 4: TestLoopback failed on port(s)
>> 2,4-6,8-9,12-13,15,19,23,30,32,35,37-38,41,43,46,48
>> *May 20 15:54:02.544 EEST: %CONST_DIAG-SP-3-BOOTUP_TEST_FAIL: Module
>> 4: TestL3VlanMet failed
>>
>> *May 20 15:54:03.223 EEST: %LINK-3-UPDOWN: Interface
>> GigabitEthernet4/1, changed state to down
>> *May 20 15:54:03.627 EEST: %LINK-3-UPDOWN: Interface
>> GigabitEthernet4/2, changed state to down
>> *May 20 15:54:03.543 EEST: %PM-SP-4-ERR_DISABLE: diagnostics error
>> detected on Gi4/2, putting Gi4/2 in err-disable state
>>
>> *May 20 15:54:04.543 EEST: %PM-SP-4-ERR_DISABLE: diagnostics error
>> detected on Gi4/4, putting Gi4/4 in err-disable state
>> *May 20 15:54:04.743 EEST: %PM-SP-4-ERR_DISABLE: diagnostics error
>> detected on Gi4/6, putting Gi4/6 in err-disable state
>>
>> And after another reboot
>>
>> May 20 15:57:52.972 EEST: %DIAG-SP-3-MINOR: Module 3: Online
>> Diagnostics detected a Minor Error. Please use 'show diagnostic result
>> <target>' to see test results.
>> May 20 15:57:52.972 EEST: %CONST_DIAG-SP-3-BOOTUP_TEST_FAIL: Module 3:
>> TestLoopback failed on port(s) 1-7,9-14,16-19,21,23-43,45-48
>> May 20 15:57:52.972 EEST: %CONST_DIAG-SP-3-BOOTUP_TEST_FAIL: Module 3:
>> TestL3VlanMet failed
>> .May 20 15:57:54.416 EEST: %LINK-3-UPDOWN: Interface
>> GigabitEthernet3/1, changed state to down
>> May 20 15:57:54.311 EEST: %PM_SCP-SP-3-TRANSCEIVER_UNSUPPORTED:
>> Unsupported transceiver in LAN port 3/5
>> May 20 15:57:54.399 EEST: %PM_SCP-SP-3-TRANSCEIVER_UNSUPPORTED:
>> Unsupported transceiver in LAN port 3/9
>> .May 20 15:57:55.024 EEST: %LINK-3-UPDOWN: Interface
>> GigabitEthernet3/4, changed state to down
>> .May 20 15:57:55.092 EEST: %LINK-3-UPDOWN: Interface
>> GigabitEthernet3/2, changed state to down
>> .May 20 15:57:55.292 EEST: %LINK-3-UPDOWN: Interface
>> GigabitEthernet3/3, changed state to down
>> May 20 15:57:54.407 EEST: %PM-SP-4-ERR_DISABLE: diagnostics error
>> detected on Gi3/1, putting Gi3/1 in err-disable state
>> May 20 15:57:54.607 EEST: %PM-SP-4-ERR_DISABLE: diagnostics error
>> detected on Gi3/2, putting Gi3/2 in err-disable state
>> May 20 15:57:54.811 EEST: %PM-SP-4-ERR_DISABLE: diagnostics error
>> detected on Gi3/3, putting Gi3/3 in err-disable state
>> May 20 15:57:55.011 EEST: %PM-SP-4-ERR_DISABLE: diagnostics error
>> detected on Gi3/4, putting Gi3/4 in err-disable state
>>
>>
>> Finally, we return 6704 line card back and rotuer rebooted and
>> works fine as usual.
>>
>> 6708 line cad today was installed in another 6704 router with the
>> same RSP - all seems ok with it.
>>
>> IOS on both routers c7600rsp72043-advipservicesk9-mz.122-33.SRD5.bin.
>>
>> According to Cisco, 6708 line card can be installed in ANY slot of 7604
>> chassis, ISO SRD5 supports it as well. Similar 6708 line cars now
>> works in another router but 7606-S chassis.
>>
>> Powe supply in problem router is 2700W. And now utilised only half from
>> awailable power and differens between 6704 and 6708 only 133W.
>>
>> Does anybody have some glue what is wrong?
>>
>> Is it possible that such behavior due to different ROMMON versions
>> on line cards in bundle or something wrong with chassis?
>>
>> Thans in advance!
>>
>>

-- 
            Sincerely yours,
                             Artyom Viklenko.
-------------------------------------------------------
artem at aws-net.org.ua | http://www.aws-net.org.ua/~artem
artem at viklenko.net   | JID: artem at jabber.aws-net.org.ua
FreeBSD: The Power to Serve   -  http://www.freebsd.org