Loading...
Loading...
IMPORTANT: The drive firmware releases provided in the Resolution are recommended to prevent the issue described below from occurring. HPE recommends performing this upgrade at the customer's earliest possible convenience. Neglecting to perform the recommended resolution could result in the potential for subsequent errors to occur and create server instability.Certain Solid State Drive (SSD) models listed in the Scope section below may experience a firmware issue in which the drive may return unexpected/erroneous data when drive statistics are queried. When this occurs, the system may encounter any of the two following reported conditions, leaving the server in an unstable state. Note that this issue could potentially occur any time drive statistics are queried.Condition 1:Read Capacity (16): In a VMware vSAN environment this may cause the affected storage volume to be taken offline. The vmkernel logs report the smartpqi driver experienced an "out of memory" condition. VMware analysis of the vmkernel log reports invalid blocksize returned by a read capacity (16) command to the SSD drive:2019-12-02T03:40:15.525Z cpu49:2100554 opID=2d78d91e)WARNING: Partition: 1149: Out of memory for "mpx.vmhba0:C0:T65:L0"2019-12-02T03:40:15.525Z cpu49:2100554 opID=2d78d91e)WARNING: Partition: 1261: Partition table read from device mpx.vmhba0:C0:T65:L0 failed: Out of memory2019-12-02T03:40:15.525Z cpu49:2100554 opID=2d78d91e)WARNING: ScsiDeviceIO: 10109: Mode Sense cmd reported block size 512, does not match the current logical block size 3976864136(with physical block size 281280512) for device.Condition 2:Drive temperature information (OS agnostic): Drive may report a high temperature alert. If this temperature is over the critical temperature threshold, the server will shut down. For this issue, there will be no other temperature alerts for the server and temperatures in the server will look normal other than one drive being reported as overheating.This may be confirmed in the following logs:The Integrated Management Log (IML) reports the overheat via generic drive temp sensor, "Temperature Sensor 12":01/05/2020 06:07:43,183: System Overheating (Temperature Sensor 12, Location System, Temperature 76) ACTION:Check fans, processor heat sink and air baffles installation.01/05/2020 06:07:43,184: Automatic Operating System Shutdown Initiated Due to Overheat Condition ACTION:Check simultaneously logged messages for cause of shutdown and address those issues accordingly.Controller serial/slot log: This data shows the limit temperature is not static for different entries. For these drives the limit is 60C, set in the firmware, and does not actually change internal to the drive even though it is reported as such:[2020-01-05 06:03:21] D001 (SN=S44RNY0M601742 ) (temp=50C, limit=53C, max=57C): Temperature once reached 57C[2020-01-05 06:07:21] D001 (SN=S44RNY0M601742 ) (temp=76C, limit=50C, max=124C): Over heatedIMPORTANT NOTESThese events are rare/transient in nature and only affect the data returned at the time of the associated query.Internal drive metadata is NOT affected and outside of these transient events, the reported drive statistics will not be affected.There is no drive failure and drives should not be replaced.This only affects data returned to internal drive statistic/metadata requests. User data is NOT affected by this issue.
This issue affects any of the following HPE Solid State Drive models and the respective Option Kits and firmware versions:Table 1HPE Model NumberOption KitOption DescriptionFirmware Version ImpactedVK000240GWSRQP09685-B21HPE 240GB SATA RI SFF RW DS SSDAny version prior to HPG3VK000240GWSRQP04556-B21HPE 240GB SATA RI SFF SC DS SSDAny version prior to HPG3VK000480GWSRRP09687-B21HPE 480GB SATA RI LFF SCC DS SSDAny version prior to HPG3VK000480GWSRRP04560-B21HPE 480GB SATA RI SFF SC DS SSDAny version prior to HPG3VK000960GWSRTP09689-B21HPE 960GB SATA RI LFF SCC DS SSDAny version prior to HPG3VK000960GWSRTP09691-B21HPE 960GB SATA RI LFF LPC DS SSDAny version prior to HPG3VK000960GWSRTP04564-B21HPE 960GB SATA RI SFF SC DS SSDAny version prior to HPG3VK001920GWSRUP09693-B21HPE 1.92TB SATA RI LFF SCC DS SSDAny version prior to HPG3VK001920GWSRUP09695-B21HPE 1.92TB SATA RI SFF RW DS SSDAny version prior to HPG3VK001920GWSRUP04566-B21HPE 1.92TB SATA RI SFF SC DS SSDAny version prior to HPG3VK003840GWSRVP09697-B21HPE 3.84TB SATA RI SFF RW DS SSDAny version prior to HPG3VK003840GWSRVP04570-B21HPE 3.84TB SATA RI SFF SC DS SSDAny version prior to HPG3Table 2HPE Model NumberOption KitOption DescriptionFirmware Version ImpactedMK000480GWSSCP09712-B21HPE 480GB SATA MU SFF SC DS SSDAny version prior to HPG2MK000480GWSSCP09714-B21HPE 480GB SATA MU SFF RW DS SSDAny version prior to HPG2MK000960GWSSDP09716-B21HPE 960GB SATA MU SFF SC DS SSDAny version prior to HPG2MK000960GWSSDP09718-B21HPE 960GB SATA MU LFF SCC DS SSDAny version prior to HPG2MK000960GWSSDP09720-B21HPE 960GB SATA MU SFF RW DS SSDAny version prior to HPG2MK001920GWSSEP09722-B21HPE 1.92TB SATA MU SFF SC DS SSDAny version prior to HPG2MK001920GWSSEP09724-B21HPE 1.92TB SATA MU SFF SC DS SSDAny version prior to HPG2MK001920GWSSEP09726-B21HPE 1.92TB SATA MU LFF LPC DS SSDAny version prior to HPG2MK001920GWSSEP09728-B21HPE 1.92TB SATA MU SFF RW DS SSDAny version prior to HPG2MK003840GWSSFP21517-B21HPE 3.84TB SATA MU SFF SC SSDAny version prior to HPG2VK000240GWSRQP18420-B21HPE 240GB SATA RI SFF SC MV SSDAny version prior to HPG2VK000480GWSRRP18422-B21HPE 480GB SATA RI SFF SC MV SSDAny version prior to HPG2VK000960GWSRTP18424-B21HPE 960GB SATA RI SFF SC MV SSDAny version prior to HPG2VK001920GWSRUP18426-B21HPE 1.92TB SATA RI SFF SC MV SSDAny version prior to HPG2VK003840GWSRVP18428-B21HPE 3.84TB SATA RI SFF SC MV SSDAny version prior to HPG2MK000480GWSSCP18432-B21HPE 480GB SATA MU SFF SC MV SSDAny version prior to HPG2MK000960GWSSDP18434-B21HPE 960GB SATA MU SFF SC MV SSDAny version prior to HPG2MK001920GWSSEP18436-B21HPE 1.92TB SATA MU SFF SC MV SSDAny version prior to HPG2
HPE has released drive firmware versions HPG2 and HPG3 to address this issue. Upgrade the firmware in the HPE Solid State Drive models according to theHPE Model Number and Option Kitinstalled as per the tables above.Drive firmware HPG3for VK000240GWSRQ, VK000480GWSRR, VK000960GWSRT, VK001920GWSRU and VK003840GWSRV drives (Table 1):Windows:https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_34f0cbd50f1c4c85a8dc96994cLinux:https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_87656b2dede1409d841a5f6803VMware:https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_4dd924be589d454db44f73e6d7Drive firmware HPG2for MK000480GWSSC, MK000960GWSSD, MK001920GWSSE, MK003840GWSSF, VK000240GWSRQ, VK000960GWSRT, VK001920GWSRU, VK003840GWSRV, MK000480GWSSC, MK000960GWSSD and MK001920GWSSE drives (Table 2):Windows:https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_10a6d8fd2d054d07b7631be824Linux:https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_dd9a5ebd5436454c8d18f1c56dVMware:https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_907cb657605141fba938906fedHPG2 / HPG3 Firmware Release NotesWhen SSD statistics are queried, erroneous drive temperatures may be reported. When this occurs, the system may encounter any of the two following conditions, leaving the server in an unstable state:Server shutdownIn VMware vSAN environment, storage volume taken offline.RECEIVE PROACTIVE UPDATES: Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively via e-mail through HPE Subscriber's Choice. Sign up for Subscriber's Choice at the following URL:Proactive Updates Subscription Form.NAVIGATION TIP: For hints on navigating HPE.com to locate the latest drivers, patches, and other support software downloads for HPE systems and Options, refer to theNavigation Tips document.SEARCH TIP: For hints on locating similar documents on HPE.com, refer to theSearch Tips Document.
Operating Systems Affected:Not Applicable
Click on a version to see all relevant bugs
Hewlett Packard Enterprise Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.