Launching soon: The world's first vendor agnostic bug scrubLearn more & join waitlist
OPERATIONAL DEFECT DATABASE
...
...
Document Version Release Date Details 5 5/22/2020 Resolution details updated for the HPE Superdome Flex Server. 4 2/19/2020 New values added to the "SN1100Q, SN1600Q, 5830C" row from the Resolution table. 3 2/12/2020 Resolution updated with additional Superdome Flex specific information. 2 01/22/2020 Updated to include Superdome Flex and specific instructions 1 01/10/2020 Original document release Important : The firmware fix provided in the Resolution Section below is required to prevent a firmware issue with certain identified HPE Fibre Channel HBAs. Under certain circumstances, the host operating system may halt resulting in the potential filesystem data integrity issue. This issue may occur when the adapter's management processor stops responding. HPE strongly recommends immediate application of this firmware fix. Failure to apply the firmware fix may result in a serious impact to filesystem data integrity, please take immediate action if any of these affected HBAs are present in your configuration. An extremely rare but critical issue has been identified by HPE where firmware on certain HPE Fibre Channel (FC) Host Bus Adapters (HBAs) create an exposure to a file-system data integrity issue. When the issue occurs, a large number of error messages are presented on-screen and recorded in error logs followed by the host Operating System (OS) stopping unexpectedly. A subsequent system reboot may exhibit a file-system data integrity issue has occurred. The affected FC HBAs are listed in the Scope section below. In VMWare environments, the following error messages from the QLogic driver will be seen multiple times immediately before the Purple Screen of Death (PSoD): qlnativefc: vmhba#: 83XX: F/W Error Reported: Check if reset required qlnativefc: vmhba#: Heartbeat Failure encountered, chip reset required WARNING: qlnativefc: vmhba#: Invalid ISP SCSI completion handle(281) req=1 qlnativefc: vmhba2(12:0.0): Error entry - invalid entry type 0xa handle 0x211cd000 The PSoD backtrace has varied across instances, however, one of the following three messages are usually present in the backtrace: PanicvPanicIntvmkernel#nover+0x545 PANIC bora/vmkernel/main/dlmalloc.c:4736 -Corruption in dlmalloc DLM_mallocvmkernel#nover+0x4c6 #GP Exception 13 in world #####:SCSI periodi DLM_freevmkernel#nover+0x323 #GP Exception 13 in world #####:Unmap Helper In Linux, the following error messages from the adapter driver will be seen if using driver qla2xxx 10.01.00.52 (or later): "MPI Heartbeat stop. Chip reset needed. MB0[%xh] MB1[%xh] MB2[%xh] MB3[%xh]\n" "MPI Heartbeat stop. FW dump needed\n" If ql2xextended_error_logging is enabled, then users may also see the message "Invalid status handle (0x%x).\n" In Windows, the following errors will be displayed in the system log when this occurs: Eventlog: Log Name: System Source: ql2300 Date: 12/5/2019 10:26:26 AM Event ID: 11 Binary Data In words 0000: 0018000F 00000001 00000000 C004000B 0010: 82000000 00000000 00000000 00000000 Driver String QLIsrEventHandler: Nic Fw State Change (8200) MB1 0100 Fn 1 extraf3 9000 Additionally, the following messages may be seen: STORMINI: QL27:FFFF91039F000010 QLProcRspQueueMq: INVALID handle, Tag 2cc Type 3 STORMINI: QL27:FFFF91039F07A010 QLProcRspQueueMq: INVALID handle, Tag 7e Type 3
The following HPE Fibre Channel Host Bus Adapters require the firmware fix: HPE StoreFabric SN1100Q 16Gb Dual Port Fibre Channel Host Bus Adapter HPE StoreFabric SN1100Q 16Gb Single Port Fibre Channel Host Bus Adapter HPE StoreFabric SN1600Q 32Gb Dual Port Fibre Channel Host Bus Adapter HPE StoreFabric SN1600Q 32Gb Single Port Fibre Channel Host Bus Adapter HPE SN1610Q 32Gb Fibre Channel Host Bus Adapter HPE Synergy 5830C 32Gb Fibre Channel Host Bus Adapter
Multi Boot Image (MBI) packages, with updated subcomponents, are available on the HPE Support Center to eliminate exposure to this issue. HPE requires users updating their adapters to the respective firmware version as per the table below immediately: HBA Model Original MBI Original SPP Release New MBI New Firmware Component Version Date Posted SN1100Q, SN1600Q 1.73.07 2019.12.00 1.73.08 2019.12.02 12/25/19 SN1610Q 02.02.15 2019.12.00 02.02.18 2019.12.02 12/25/19 SN1100Q, SN1600Q,5830C 1.71.03 1.72.02 2019.03.01 2019.03.02 1.72.03 2019.03.04 12/25/19 SN1100Q, SN1600Q 1.70.85 2018.09.01, 2018.06.01 1.71.85 2018.06.02 12/26/19 SN1100Q, SN1600Q 1.70.66 2018.02.01 1.71.66 2018.02.02 12/26/19 SN1100Q, SN1600Q 1.70.51 2017.09.01 1.71.51 2017.09.02 12/27/19 SN1100Q, SN1600Q 1.70.47 or prior 2017.06.01 1.71.47 2017.06.02 12/27/19 1. Determine the MBI version currently installed: a. On ProLiant and Synergy, use HPE Integrated Lights-Out (iLO) to determine the installed version. The firmware version will be seen under the HPE iLO Firmware & OS Software page and in the HPE iLO System Information page under the Device Inventory tab.(See the sample images from HPE iLO at the end of this section) b. On Superdome Flex servers, if the server firmware version is 3.20.186 (or later), display the IO firmware versions by running the following RMC command: cli>show chassis info chassis=<GEOID> . Look for the firmware version in the entry for SN100Q or SN1600Q in the output. If the server firmware version is older, it is highly recommended to update it. Otherwise, use OS level commands to display the IO firmware versions: On Linux, use cat /sys/class/scsi_host/host*/fw_version On other Operating Systems, the firmware version may be displayed in /var/log/message for qla2xxx related entries. 2. On ProLiant and Synergy, use the table above to determine the "New Multi Boot Image (MBI)" needed. On HPE Superdome Flex servers, the IO firmware version affected by the issue is 8.08.220 (package 1.72.02, Superdome Flex IO service pack 2019.09 and 2019.07). If that version is installed, update to 8.08.230 (Package 1.73.08, bundle version 2019.12.02) found as part of Superdome Flex IO Service Pack version 2020.05(a) . 3.Use the new firmware component version in table to determine which firmware component to download on HPESC. 4.Click the following link: Hewlett Packard Enterprise Support Center 5.Enter a product name (e.g., " StoreFabric SN1100Q ") in the text search field and wait for a list of Suggested Products to display. From the Suggested Products list displayed, identify the desired product and select it. 6. The page should refresh to display the "DRIVERS AND SOFTWARE" tab and the components that support the selected product. From the "DRIVERS AND SOFTWARE" expandable filter menus on the left side of the page: 7. Select the Software Type - Firmware 8. Select the Software Sub Type - Storage Fibre Channel and Fibre Channel Over Ethernet 9. For further filtering if needed - Select the specific Operating System from the Operating Environment. 10. Locate and select ** CRITICAL ** HPE Firmware Flash for QLogic Fibre Channel Host Bus Adapters version 2019.12.02 (or later ). Note: To ensure that you have selected the latest version of the firmware/driver, click the Revision History tab to check if a new version of the firmware/driver is available. For more important information, review the Release Notes tab. 11. Click the Download button 12. To confirm the Firmware Version field is updated to the MBI version in the table above: a. On ProLiant and Synergy, use the HPE iLO Utility. b. On Superdome Flex servers running Linux, run the following command again: cat/sys/class/scsi_host*/fw_version On other operating systems, get the version from the latest qla2xxx entries in /var/log/message 13. After the firmware upgrade, the adapter driver messages shown above may still display over the life of the product. However, the driver and firmware will recover automatically without PSoD or system halts and data integrity issues should not occur as a result of this issue. Note: The Multi Boot Image (MBI) package may also be referred to as "Package" or "Boot Image" within HPE documentation. HPE iLO Device Inventory Page HPE iLO Firmware & OS Software Page: RECEIVE PROACTIVE UPDATES : Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively via e-mail through HPE Subscriber's Choice. Sign up for Subscriber's Choice at the following URL: Proactive Updates Subscription Form. NAVIGATION TIP : For hints on navigating HPE.com to locate the latest drivers, patches, and other support software downloads for HPE systems and Options, refer to the Navigation Tips document . SEARCH TIP : For hints on locating similar documents on HPE.com, refer to the Search Tips Document .