Symptom

During fpd upgrade , we see the i2c reading for the oper mode pf the PM failed. That lead to XR considering them as failed.

Conditions

ASR9906#upgrade hw-module location pm-all fpd all 0/RSP1/ADMIN0:Mar 15 15:13:31.871 UTC: envmon[5049]: %INFRA-FPD_Driver-6-UPGRADE_RESULT : Upgrade completes 85 percent for fpd 0/PT0-PM0-DT-Sec5vMCU@location 0/PT0. 0/RSP1/ADMIN0:Mar 15 15:13:41.872 UTC: envmon[5049]: %INFRA-FPD_Driver-6-UPGRADE_RESULT : Upgrade completes 87 percent for fpd 0/PT0-PM0-DT-Sec5vMCU@location 0/PT0. 0/RSP1/ADMIN0:Mar 15 15:13:51.873 UTC: envmon[5049]: %INFRA-FPD_Driver-6-UPGRADE_RESULT : Upgrade completes 89 percent for fpd 0/PT0-PM0-DT-Sec5vMCU@location 0/PT0. 0/RSP1/ADMIN0:Mar 15 15:14:00.595 UTC: envmon[5049]: %PKT_INFRA-FM-3-FAULT_MAJOR : ALARM_MAJOR :Power Module Output Disabled (PM_OUTPUT_EN_PIN_HI) :DECLARE :0/PT0-PM1: Power tray 0 power module 1 is under HW_OUTPUT_DISABLED condition. 0/RSP1/ADMIN0:Mar 15 15:14:00.596 UTC: envmon[5049]: %PKT_INFRA-FM-3-FAULT_MAJOR : ALARM_MAJOR :Power Module Output Disabled (PM_OUTPUT_EN_PIN_HI) :DECLARE :0/PT0-PM2: Power tray 0 power module 2 is under HW_OUTPUT_DISABLED condition. 0/RSP1/ADMIN0:Mar 15 15:14:00.596 UTC: envmon[5049]: %PKT_INFRA-FM-3-FAULT_MAJOR : ALARM_MAJOR :Power Module Output Disabled (PM_OUTPUT_EN_PIN_HI) :DECLARE :0/PT0-PM3: Power tray 0 power module 3 is under HW_OUTPUT_DISABLED condition. 0/RSP1/ADMIN0:Mar 15 15:14:00.597 UTC: envmon[5049]: %PKT_INFRA-FM-3-FAULT_MAJOR : ALARM_MAJOR :Power Module redundancy lost :DECLARE :0: 0/RSP1/ADMIN0:Mar 15 15:14:00.598 UTC: envmon[5049]: %PKT_INFRA-FM-4-FAULT_MINOR : ALARM_MINOR :Power reservation exceeds available power :DECLARE :0: 0/RSP1/ADMIN0:Mar 15 15:14:00.598 UTC: envmon[5049]: %PKT_INFRA-FM-2-FAULT_CRITICAL : ALARM_CRITICAL :Low input voltage chassis shutdown :DECLARE :0: CHASSIS SHUTDOWN due to all power modules in failed or input voltage < 40V condition. 0/RSP0/ADMIN0:Mar 15 15:14:00.622 UTC: shelf_mgr[5215]: %INFRA-SHELF_MGR-3-FAULT_ACTION_RACK_FORCED_SHUTDOWN : Forced shutdown requested for rack 0 0/RSP1/ADMIN0:Mar 15 15:14:00.672 UTC: esdma[6717]: %INFRA-ESDMA-6-ESD_CONN_LOST : ESDMA lost connection with esd at 0/RP1/RP-SW1 0/2/ADMIN0:Mar 15 15:14:00.685 UTC: cm[4074]: %ROUTING-TOPO-5-PROCESS_UPDATE : Got process update: Card shutdown. 0/0/ADMIN0:Mar 15 15:14:00.689 UTC: cm[4076]: %ROUTING-TOPO-5-PROCESS_UPDATE : Got process update: Card shutdown. 0/1/ADMIN0:Mar 15 15:14:00.748 UTC: cm[4077]: %ROUTING-TOPO-5-PROCESS_UPDATE : Got process update: Card shutdown. 0/RSP1/ADMIN0:Mar 15 15:14:00.746 UTC: cm[5044]: %ROUTING-TOPO-5-PROCESS_UPDATE : Got process update: Card shutdown. 0/RSP1/ADMIN0:Mar 15 15:14:01.295 UTC: esdma[6717]: %INFRA-ESDMA-6-ESD_CONN_FOUND : ESDMA found connection with esd at 0/RP1/RP-SW1 0/0/ADMIN0:Mar 15 15:14:01.653 UTC: aaad[4070]: %MGBL-AAAD-7-DEBUG : Disaster-recovery account not configured. Using first user as disaster-recovery account 0/1/ADMIN0:Mar 15 15:14:01.666 UTC: aaad[4071]: %MGBL-AAAD-7-DEBUG : Disaster-recovery account not configured. Using first user as disaster-recovery account

Workaround

n/a

Further Problem Description