Symptoms

ePOST errors are seen during the boot process pointing to IMPI and BMC issue. 2023-03-10T10:02:52.724067-05:00 isilon-1 port08 2023-Mar-10 09:02:52.701 RXDATA: ************************************************************ 2023-03-10T10:02:52.724968-05:00 isilon-1 port08 2023-Mar-10 09:02:52.702 RXDATA: * Extended POST Messages 2023-03-10T10:02:52.733503-05:00 isilon-1 port08 2023-Mar-10 09:02:52.710 RXDATA: ************************************************************ 2023-03-10T10:02:52.735390-05:00 isilon-1 port08 2023-Mar-10 09:02:52.712 RXDATA: WARNING:Failed to set fault/status code value:0x01000000 (offset:0x02A8) 2023-03-10T10:02:52.744810-05:00 isilon-1 port08 2023-Mar-10 09:02:52.722 RXDATA: INFORMATION:POST Start 2023-03-10T10:02:52.745778-05:00 isilon-1 port08 2023-Mar-10 09:02:52.723 RXDATA: WARNING:INIT: IPMI Error Reading Chassis Resume PROM (0x03E0) 2023-03-10T10:02:52.746700-05:00 isilon-1 port08 2023-Mar-10 09:02:52.724 RXDATA: WARNING:INIT: IPMI Error Reading SP Resume PROM (0x03E0) 2023-03-10T10:02:52.756213-05:00 isilon-1 port08 2023-Mar-10 09:02:52.733 RXDATA: WARNING:Failed to read Boot Options structure from Virtual EEPROM (0x03E0) 2023-03-10T10:02:52.767540-05:00 isilon-1 port08 2023-Mar-10 09:02:52.744 RXDATA: WARNING:FRU capability Register in SP resume is not set correctly, VRD components are not recognized 2023-03-10T10:02:52.778927-05:00 isilon-1 port08 2023-Mar-10 09:02:52.756 RXDATA: WARNING:Error reading SLIC status sensor or sensor scanning could be disabled for HBA0 card (0x03E0) 2023-03-10T10:02:52.779879-05:00 isilon-1 port08 2023-Mar-10 09:02:52.757 RXDATA: WARNING:Error reading SLIC status sensor or sensor scanning could be disabled for HBA1 card (0x03E0) 2023-03-10T10:02:52.790272-05:00 isilon-1 port08 2023-Mar-10 09:02:52.767 RXDATA: WARNING:Error reading SLIC status sensor or sensor scanning could be disabled for Disk Interface Card (0x03E0) 2023-03-10T10:02:52.801880-05:00 isilon-1 port08 2023-Mar-10 09:02:52.779 RXDATA: WARNING:Unable to read VEEPROM Shared Data Region (0x03E0) 2023-03-10T10:02:52.802975-05:00 isilon-1 port08 2023-Mar-10 09:02:52.780 RXDATA: WARNING:Failed to read Boot Options structure from Virtual EEPROM (0x03E0) 2023-03-10T10:02:53.234050-05:00 isilon-1 port08 2023-Mar-10 09:02:53.211 RXDATA: .... Storage System Failure - Contact your Service Representative ... 2023-03-10T10:02:53.246489-05:00 isilon-1 port08 2023-Mar-10 09:02:53.223 RXDATA: WARNING: Failed to set fault/status code value:0x0100001C (offset:0x02A8) 2023-03-10T10:02:53.247503-05:00 isilon-1 port08 2023-Mar-10 09:02:53.224 RXDATA: ErrorCode: 0x00000174 2023-03-10T10:02:53.247995-05:00 isilon-1 port08 2023-Mar-10 09:02:53.225 RXDATA: ErrorDesc: 2023-03-10T10:02:53.248534-05:00 isilon-1 port08 2023-Mar-10 09:02:53.225 RXDATA: FRU: Enclosure | Motherboard 2023-03-10T10:02:53.249004-05:00 isilon-1 port08 2023-Mar-10 09:02:53.226 RXDATA: Device: Enclosure Monitor 2023-03-10T10:02:53.259064-05:00 isilon-1 port08 2023-Mar-10 09:02:53.236 RXDATA: Description: A/B slot indicator Error! 2023-03-10T10:02:53.259567-05:00 isilon-1 port08 2023-Mar-10 09:02:53.237 RXDATA: Rev: 10.34 2023-03-10T10:02:53.260070-05:00 isilon-1 port08 2023-Mar-10 09:02:53.237 RXDATA: SPA: FALSE 2023-03-10T10:02:53.260567-05:00 isilon-1 port08 2023-Mar-10 09:02:53.238 RXDATA: SPB: FALSE 2023-03-10T10:02:53.261102-05:00 isilon-1 port08 2023-Mar-10 09:02:53.238 RXDATA: Survey* 2023-03-10T10:02:53.261614-05:00 isilon-1 port08 2023-Mar-10 09:02:53.239 RXDATA: P/N: 2023-03-10T10:02:53.262120-05:00 isilon-1 port08 2023-Mar-10 09:02:53.239 RXDATA: S/N: 2023-03-10T10:02:53.262629-05:00 isilon-1 port08 2023-Mar-10 09:02:53.240 RXDATA: EndError: 2023-03-10T10:02:53.263133-05:00 isilon-1 port08 2023-Mar-10 09:02:53.240 RXDATA: ErrorTime: 03/10/2023 15:02:22 2023-03-10T10:02:53.269167-05:00 isilon-1 port08 2023-Mar-10 09:02:53.246 RXDATA: ErrorCode: 0x000003E0 2023-03-10T10:02:53.269674-05:00 isilon-1 port08 2023-Mar-10 09:02:53.247 RXDATA: ErrorDesc: 2023-03-10T10:02:53.270192-05:00 isilon-1 port08 2023-Mar-10 09:02:53.247 RXDATA: FRU: Enclosure | Motherboard 2023-03-10T10:02:53.270677-05:00 isilon-1 port08 2023-Mar-10 09:02:53.248 RXDATA: Device: BMC 2023-03-10T10:02:53.281590-05:00 isilon-1 port08 2023-Mar-10 09:02:53.258 RXDATA: Description: IPMI Transport Protocol Not Found Error! 2023-03-10T10:02:53.282096-05:00 isilon-1 port08 2023-Mar-10 09:02:53.259 RXDATA: Rev: 10.34 2023-03-10T10:02:53.282600-05:00 isilon-1 port08 2023-Mar-10 09:02:53.260 RXDATA: Send_IPMI_CMD() 2023-03-10T10:02:53.283112-05:00 isilon-1 port08 2023-Mar-10 09:02:53.260 RXDATA: Failed to get BMC self test results 2023-03-10T10:02:53.283612-05:00 isilon-1 port08 2023-Mar-10 09:02:53.261 RXDATA: Self Test Results* 2023-03-10T10:02:53.284112-05:00 isilon-1 port08 2023-Mar-10 09:02:53.261 RXDATA: P/N: 2023-03-10T10:02:53.284616-05:00 isilon-1 port08 2023-Mar-10 09:02:53.262 RXDATA: S/N: 2023-03-10T10:02:53.285123-05:00 isilon-1 port08 2023-Mar-10 09:02:53.262 RXDATA: EndError: After the above errors, the node will attempt to boot and fail with the following message - Failed to copy PSI config files: Chassis is missing a PSI receipt. Installation config method is PSF: Pulling PSI config files from backup Secondary backup method None is unknown Unable to pull files from None backup Installation config method is PSF: Unable to pull secondary backup files Installation config method is PSF: Copying PSI config files PSF file path /mfg/psi/psf.json does not exist in primary backup Failed to copy PSI config files: Chassis is missing a PSI receipt. A receipt must be provided before the boot will be allowed to continue. To prevent a DL situation, contact Dell EMC Customer Support immediately: United States: 1 800 782 4362 (1 800 SVC 4EMC) Canada: 1 800 543 4782 (1 800 543 4SVC) Worldwide Country Code: 1 508 497 7901 Command Options: 1) Enter recovery shell 2) Continue booting 3) Reboot

Cause

BMC unresponsive during boot

Resolution

Will need to power drain the node and then retry-last-action for the firmware upgrade. Please perform the power drain using the documented process from the below article: https://www.dell.com/support/kbdoc/en-us/000020498/how-to-power-cycle-an-isilon-node Once the node is up you will need to retry-last-action to continue the upgrade # isi upgrade retry-last-action --nodes=all

Support Cases