[f-nsp] BI-RX16 Power problem

[Dave Peters - Terabit Systems]

Hi all--

This is more like a disaster. Had a power failure on a BI-RX16-AC running 2.900c. One power tripped the breaker, and after another trip and a reboot, the whole thing wouldn't come up, and all the EEPROMs seem to have "failed." Can one rogue power fry an entire 16-slot RX chassis? Anyone seen this before? There's no way to replace the EEPROM chips, right? I doubt this is recoverable, but if anyone's got a tip, I'd love to hear it.

Here's a sample from the boot process:

SNM4/FE2 initialization successful.
SNM4/FE3 initialization successful.
AC Power Supply 1  is Installed (OK)
Power Supply 2  is Not Installed (FAILED)
Warn:rw_read_power_supply_reg: valere_i2c_read() (ret = 32) && cherokee_i2c_read() (ret = -2) failled
Warn:rw_read_power_supply_reg: rw_unselect_mux() failed for mux 0 (ret = -2)
Error:rw_check_a_power_status: can't read power supply 2 model_number register
AC Power Supply 3  is Installed (OK)
Error:rw_select_mux_channel: channel: written = 5, read = 0
Warn:rw_read_power_supply_reg: rw_select_mux_channel() failed for mux 0 channel 5 (ret = -1)
Error:rw_check_a_power_status: can't read power supply 3 model_number register
AC Power Supply 4  is Installed (OK)
Power Supply 5  is Not Installed (FAILED)
Power Supply 6  is Not Installed (FAILED)
Power Supply 7  is Not Installed (FAILED)
Power Supply 8  is Not Installed (FAILED)
Error:rw_select_mux_channel: channel: written = 0, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 0 (ret = -1)
Warn:get_lp_pwr_usage: read LP EEPROM failed for slot 1
Slot 1 will not be powered on.
Error:rw_select_mux_channel: channel: written = 0, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 0 (ret = -1)
Warn:get_lp_pwr_usage: read LP EEPROM failed for slot 3
Slot 3 will not be powered on.
Error:rw_select_mux_channel: channel: written = 1, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 1 (ret = -1)
Warn:get_lp_pwr_usage: read LP EEPROM failed for slot 6
Slot 6 will not be powered on.
Error:rw_select_mux_channel: channel: written = 1, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 1 (ret = -1)
Warn:get_lp_pwr_usage: read LP EEPROM failed for slot 8
Slot 8 will not be powered on.
Error:rw_select_mux_channel: channel: written = 3, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 3 (ret = -1)
Warn:get_lp_pwr_usage: read LP EEPROM failed for slot 10
Slot 10 will not be powered on.
Error:rw_select_mux_channel: channel: written = 2, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 2 (ret = -1)
Warn:get_lp_pwr_usage: read LP EEPROM failed for slot 13
Slot 13 will not be powered on.
Error:rw_select_mux_channel: channel: written = 2, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 2 (ret = -1)
Warn:get_lp_pwr_usage: read LP EEPROM failed for slot 15
Slot 15 will not be powered on.
Error:rw_select_mux_channel: channel: written = 0, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 0 (ret = -1)
WARN: Can't get manufacture information for switch fabric
Error:rw_select_mux_channel: channel: written = 1, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 1 (ret = -1)
WARN: Can't get manufacture information for switch fabric
Error:rw_select_mux_channel: channel: written = 2, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 2 (ret = -1)
WARN: Can't get manufacture information for switch fabric
Error:rw_select_mux_channel: channel: written = 3, read = 0
Warn:rw_read_at24c02a_eeprom: rw_select_mux_channel() failed for mux 0 channel 3 (ret = -1)
WARN: Can't get manufacture information for switch fabric
Error:rw_select_mux_channel: channel: written = 6, read = 0
Warn:rw_read_24aa64_eeprom: rw_select_mux_channel() failed for mux 0 channel 6 (ret = -1)
Error:rw_select_mux_channel: channel: written = 6, read = 0
Warn:rw_write_24aa64_eeprom: rw_select_mux_channel() failed for mux 0 channel 6 (ret = -1)
BOOTP: init relay agent, port closed 0
PIM4: Initialized for 2345 interfaces
PIM6: Initialized for 2345 interfaces
Load config data from flash memory...
Error:rw_get_power_on_mask: Can't get power usage for slot 3, fail to bring it up
Error:rw_get_power_on_mask: Can't get power usage for slot 6, fail to bring it up
Error:rw_get_power_on_mask: Can't get power usage for slot 8, fail to bring it up
Error:rw_get_power_on_mask: Can't get power usage for slot 10, fail to bring it up
Error:rw_get_power_on_mask: Can't get power usage for slot 13, fail to bring it up
Error:rw_get_power_on_mask: Can't get power usage for slot 15, fail to bring it up
INFO: Enough power available now to power on slot 1
Error:rw_select_mux_channel: channel: written = 6, read = 0
Warn:rw_read_24aa64_eeprom: rw_select_mux_channel() failed for mux 0 channel 6 (ret = -1)
ACL configured, you must not change SSH port number

INFO: Enough power available now to power on slot 3
switch-phx-11>INFO: Enough power available now to power on slot 6
All tasks have completed their initializations
Error:rw_select_mux_channel: channel: written = 7, read = 35
Warn:rw_read_thermal_sensor_reg: rw_select_mux_channel() failed for mux 0 channel 7 (ret = -1)
Error:rw_read_temperature_LM95221: rw_read_thermal_sensor_reg() failed (ret = -1)
WARN: Can't read active mgmt's temperature!
Error:rw_select_mux_channel: channel: written = 0, read = 35
Warn:rw_read_thermal_sensor_reg: rw_select_mux_channel() failed for mux 0 channel 0 (ret = -1)
Error:rw_read_temperature_LM75: rw_read_thermal_sensor_reg() failed for temperature register (ret = -1)
WARN: Can't read SNM1 temperature!
Start code flash synchronization to standby MP.
Code flash synchronization to standby MP is done.
Error:rw_select_mux_channel: channel: written = 1, read = 35
Warn:rw_read_thermal_sensor_reg: rw_select_mux_channel() failed for mux 0 channel 1 (ret = -1)
Error:rw_read_temperature_LM75: rw_read_thermal_sensor_reg() failed for temperature register (ret = -1)
WARN: Can't read SNM2 temperature!
Error:rw_select_mux_channel: channel: written = 2, read = 35
Warn:rw_read_thermal_sensor_reg: rw_select_mux_channel() failed for mux 0 channel 2 (ret = -1)
Error:rw_read_temperature_LM75: rw_read_thermal_sensor_reg() failed for temperature register (ret = -1)
WARN: Can't read SNM3 temperature!