[rbak-nsp] %QOS-0-RCM: qos rcm error: Could not locate card in slot error code 3

Wojciech Wrona w0jtas at w0jtas.com
Sun Jun 11 06:22:48 EDT 2023


I forgot to mention.

First log ("stat_ppa_counter_data_negative_check_brief") shows up exacly
once each 24 hours. And each time there is exacly 3 sets of them from
level 0 to level 8. 3 Times. It is always 02:01:22 in the night. Like this:

Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4311252311524731538 level 0
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340387221104006879 level 0
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340292918903723564 level 1
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410286204095482 level 1
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410365345381730 level 2
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370278680716 level 2
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340404450610568875 level 3
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410364129334448 level 3
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 4
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 4
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 5
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 5
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 6
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 6
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 7
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 7
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4307535391633633082 level 8
Jun 8 02:01:22: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340384246412886445 level 8


Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4311252311524700484 level 0
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340387221104006728 level 0
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340292918903415482 level 1
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410286204095186 level 1
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410365345381730 level 2
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370278680716 level 2
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340404450610567711 level 3
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410364129334434 level 3
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 4
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 4
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 5
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 5
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 6
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 6
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 7
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 7
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4307535391633633082 level 8
Jun 8 02:01:23: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340384246412886445 level 8


Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4311252311510397212 level 0
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340387221103985165 level 0
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340292918328394569 level 1
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410286203711232 level 1
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410365345381730 level 2
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370278680716 level 2
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340404450610106114 level 3
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410364129330725 level 3
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 4
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 4
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 5
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 5
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 6
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 6
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4340410370284600432 level 7
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340410370284600432 level 7
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_bytes
-4307535391633633082 level 8
Jun 8 02:01:30: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
[stat_ppa_counter_data_negative_check_brief] tx_packets
-4340384246412886445 level 8


Second log ("policy type 200 failed to process parameter 6"): is rare
and random. Sometime it is a lot of it, a sometime couple days without
even one.

Best regards,

-- 
Wojciech Wrona

W dniu 11.06.2023 o 11:20, Wojciech Wrona pisze:
> Nice to hear someone have seen it. Is there any way to pinpoint which
> card is creating this trouble? I have to mention that this is the first
> time we're seeing this log. So i suppose it can be a hardware thing. We
> have a lot of spare ones so it won't be a problem but i don't like doing
> a blind test on production traffic.
>
> BTW. Perhaps You also seen those: we're seeing 2 more strange logs, but
> those 2 are since years, and since we didn't see any real issue behind
> this we just ignored them. We have note in our internal docs that those
> appeared just after upgrade from SEOS-12.1.1.11p7 to SEOS-12.1.1.12-p15.
>
> Jun 11 02:01:24: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
> [stat_ppa_counter_data_negative_check_brief] tx_bytes
> -4311197817822996298 level 0
> Jun 11 02:01:24: [255/22:13:58/1/1/12]: %STAT-3-ERR_GEN:
> [stat_ppa_counter_data_negative_check_brief] tx_packets
> -4340387178800811508 level 0
>
> Jun 11 03:13:50: %PPAQOS-3-QOS_ERROR:
> 783d250a/0090530813/975500000:01/EPPA/EU00:For cct
> 255/22:13:58/6/2/38926 policy type 200 failed to process parameter 6,
> error code 1 - 001a5eee 003a30cc 001a512e 0016f84e 0003f30e 0020f94c
> 0021348c 0003dbae 0039ebcc 0039eb80 00000000
> Jun 11 03:13:50: %PPAQOS-3-QOS_ERROR:
> 0a11acd5/0090516483/765900000:02/EPPA/EU00:For cct
> 255/22:13:58/6/2/38926 policy type 200 failed to process parameter 6,
> error code 1 - 001a5eee 003a30cc 001a512e 0016f84e 0003f30e 0020f94c
> 0021348c 0003dbae 0039ebcc 0039eb80 00000000
>
> We've even considered coming back to SEOS-12.1.1.11p7 because it was
> very stable a no strange things was found in logs, but BGP fix which was
> introduced in this version was more important.
>
> Best regards,
>



More information about the redback-nsp mailing list