OPERATIONAL DEFECT DATABASE
...
...
Fabric card's power up fails after reload and card remains in FAILED state.
Fabric card reload , Chassis Power cycle, SU.
Reprogram the Power sequencer through backdoor utility "/opt/cisco/calvados/sbin/ccc_pwr_seq_upgrade", and reload the Fabric card. Below are the detail steps to reprogram the Power sequencers 1) Check which RP is master and the physical slot id of the failing FC using command âshow controller ccc inventory summaryâ sysadmin-vm:0_RP0# show controller ccc inventory summary Fri Apr 12 08:14:02.943 UTC CCC Inventory Summary : BP HW Location Card Type ID Serial Number Ver Card State -------------------------------------------------------------------------------- 0/0 NCS4K-4H-OPW-QC2 1 CAT2105B2N8 0.1 CARD_READY 0/FC0 NCS4016-FC2-M 5 CAT1938B1HK 0.1 CARD_READY 0/FC1 NCS4016-FC2-M 6 CAT2040B09K 1.0 CARD_READY 0/4 NCS4K-2H10T-OP-KS 7 CAT2011B070 1.0 CARD_READY 0/RP0 NCS4K-RP (slave) 11 CAT2103B0P9 0.1 CARD_READY 0/8 NCS4K-2H10T-OP-KS 12 CAT2011B04T 1.0 CARD_READY 0/FC2 NCS4016-FC2-M 16 CAT2102B2G8 1.0 CARD_READY 0/FC3 NCS4016-FC2-M 17 CAT2105B1R6 1.0 CARD_READY 0/12 NCS4K-4H-OPW-QC2 18 CAT2014B02P 0.1 CARD_READY 0/RP1 NCS4K-RP (master) 22 CAT2017B1MM 0.1 CARD_READY <<âmaster sysadmin-vm:0_RP0# 2) Attach to master RP and run the command â run chvrf 0 bash â sysadmin-vm:0_RP0# attach location 0/RP1 Fri Apr 12 08:14:44.291 UTC [sysadmin-vm:0_RP1:~]$ exec /sbin/chvrf 2 /bin/bash [sysadmin-vm:0_RP1:~]$ run chvrf 0 bash bash-3.2# 3) run the power sequencer utility help menu to understand the options bash-3.2# /opt/cisco/calvados/sbin/ccc_pwr_seq_upgrade -h Power sequencer remote card programming tool (v1.0.0) USAGE: /opt/cisco/calvados/sbin/ccc_pwr_seq_upgrade [-h] -s -D [-q] [{-f | -c | -v} ] -h: print this help -s: remote card backplane slotid -D: Supported LTC device id(ltc2978=0, ltc2980=1, ltc3882=2) -f: force upgrade even if there is no SBE failure condition -q: only query power sequencer info, do not perform upgrade -c: create SBE failure on a specific device instance (only for testing) -v: verify the contents for a specific device instance 4) Run the utility to list down all the power sequencer LTC3882 instances. bash-3.2# /opt/cisco/calvados/sbin/ccc_pwr_seq_upgrade -s 5 -D 2 -q LTC3882 power sequencer info for NCS4016-FC2-M in 0/FC0: I2C CML Inst Device Name Addr Version Status Fault ==== ================================ ==== ======= ====== ===== 0 +3.3V DATAPATH 0x82 0x9 0x0 NO 1 1.0V FE0_VDD_CORE 0x84 0x7 0x0 NO 2 1.0V FE1_VDD_CORE 0x86 0x7 0x0 NO 3 1.0V FE2_VDD_CORE 0x88 0x7 0x0 NO 5) Program each instance using option â -f â followed by instance number bash-3.2# /opt/cisco/calvados/sbin/ccc_pwr_seq_upgrade -s 5 -D 2 -f 3 ************************************************************************* WARNING: Force upgrade feature should be done only when the card is not operational. Use "hw-module location shutdown" command to power-off the card and make sure the card is powered-off before using this feature. ************************************************************************* Continue with the force upgrade operation? [y/n] y clear stdin : 10 ************************************************** *********** Successfully programmed Elapsed time: 30 secs bash-3.2# exit exit sysadmin-vm:0_RP0# sysadmin-vm:0_RP0# 6) Reload the card after programming is successful for all the instances.
Fabric card goes to FAILED state due to Power sequencer corruption. Through backdoor utilty we can reconfigure the Power sequencer and bring up the card to operational.
Click on a version to see all relevant bugs
Cisco Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.
