Launching soon: The world's first vendor agnostic bug scrubLearn more & join waitlist
OPERATIONAL DEFECT DATABASE
...
...
IMPORTANT : The drive firmware releases provided in the Resolution are recommended to prevent the issue described below from occurring. HPE recommends performing this upgrade at the customer's earliest possible convenience. Neglecting to perform the recommended resolution could result in the potential for subsequent errors to occur and create server instability. Certain Solid State Drive (SSD) models listed in the Scope section below may experience a firmware issue in which the drive may return unexpected/erroneous data when drive statistics are queried. When this occurs, the system may encounter any of the two following reported conditions, leaving the server in an unstable state. Note that this issue could potentially occur any time drive statistics are queried. Condition 1: Read Capacity (16): In a VMware vSAN environment this may cause the affected storage volume to be taken offline. The vmkernel logs report the smartpqi driver experienced an "out of memory" condition. VMware analysis of the vmkernel log reports invalid blocksize returned by a read capacity (16) command to the SSD drive: 2019-12-02T03:40:15.525Z cpu49:2100554 opID=2d78d91e)WARNING: Partition: 1149: Out of memory for "mpx.vmhba0:C0:T65:L0"2019-12-02T03:40:15.525Z cpu49:2100554 opID=2d78d91e)WARNING: Partition: 1261: Partition table read from device mpx.vmhba0:C0:T65:L0 failed: Out of memory 2019-12-02T03:40:15.525Z cpu49:2100554 opID=2d78d91e)WARNING: ScsiDeviceIO: 10109: Mode Sense cmd reported block size 512, does not match the current logical block size 3976864136(with physical block size 281280512) for device. Condition 2: Drive temperature information (OS agnostic): Drive may report a high temperature alert. If this temperature is over the critical temperature threshold, the server will shut down. For this issue, there will be no other temperature alerts for the server and temperatures in the server will look normal other than one drive being reported as overheating. This may be confirmed in the following logs: The Integrated Management Log (IML) reports the overheat via generic drive temp sensor, "Temperature Sensor 12": 01/05/2020 06:07:43,183: System Overheating (Temperature Sensor 12, Location System, Temperature 76) ACTION:Check fans, processor heat sink and air baffles installation. 01/05/2020 06:07:43,184: Automatic Operating System Shutdown Initiated Due to Overheat Condition ACTION:Check simultaneously logged messages for cause of shutdown and address those issues accordingly. Controller serial/slot log: This data shows the limit temperature is not static for different entries. For these drives the limit is 60C, set in the firmware, and does not actually change internal to the drive even though it is reported as such: [2020-01-05 06:03:21] D001 (SN=S44RNY0M601742 ) (temp=50C, limit=53C, max=57C): Temperature once reached 57C [2020-01-05 06:07:21] D001 (SN=S44RNY0M601742 ) (temp=76C, limit=50C, max=124C): Over heated IMPORTANT NOTES These events are rare/transient in nature and only affect the data returned at the time of the associated query. Internal drive metadata is NOT affected and outside of these transient events, the reported drive statistics will not be affected. There is no drive failure and drives should not be replaced. This only affects data returned to internal drive statistic/metadata requests. User data is NOT affected by this issue.
This issue affects any of the following HPE Solid State Drive models and the respective Option Kits and firmware versions: Table 1 HPE Model Number Option Kit Option Description Firmware Version Impacted VK000240GWSRQ P09685-B21 HPE 240GB SATA RI SFF RW DS SSD Any version prior to HPG3 VK000240GWSRQ P04556-B21 HPE 240GB SATA RI SFF SC DS SSD Any version prior to HPG3 VK000480GWSRR P09687-B21 HPE 480GB SATA RI LFF SCC DS SSD Any version prior to HPG3 VK000480GWSRR P04560-B21 HPE 480GB SATA RI SFF SC DS SSD Any version prior to HPG3 VK000960GWSRT P09689-B21 HPE 960GB SATA RI LFF SCC DS SSD Any version prior to HPG3 VK000960GWSRT P09691-B21 HPE 960GB SATA RI LFF LPC DS SSD Any version prior to HPG3 VK000960GWSRT P04564-B21 HPE 960GB SATA RI SFF SC DS SSD Any version prior to HPG3 VK001920GWSRU P09693-B21 HPE 1.92TB SATA RI LFF SCC DS SSD Any version prior to HPG3 VK001920GWSRU P09695-B21 HPE 1.92TB SATA RI SFF RW DS SSD Any version prior to HPG3 VK001920GWSRU P04566-B21 HPE 1.92TB SATA RI SFF SC DS SSD Any version prior to HPG3 VK003840GWSRV P09697-B21 HPE 3.84TB SATA RI SFF RW DS SSD Any version prior to HPG3 VK003840GWSRV P04570-B21 HPE 3.84TB SATA RI SFF SC DS SSD Any version prior to HPG3 Table 2 HPE Model Number Option Kit Option Description Firmware Version Impacted MK000480GWSSC P09712-B21 HPE 480GB SATA MU SFF SC DS SSD Any version prior to HPG2 MK000480GWSSC P09714-B21 HPE 480GB SATA MU SFF RW DS SSD Any version prior to HPG2 MK000960GWSSD P09716-B21 HPE 960GB SATA MU SFF SC DS SSD Any version prior to HPG2 MK000960GWSSD P09718-B21 HPE 960GB SATA MU LFF SCC DS SSD Any version prior to HPG2 MK000960GWSSD P09720-B21 HPE 960GB SATA MU SFF RW DS SSD Any version prior to HPG2 MK001920GWSSE P09722-B21 HPE 1.92TB SATA MU SFF SC DS SSD Any version prior to HPG2 MK001920GWSSE P09724-B21 HPE 1.92TB SATA MU SFF SC DS SSD Any version prior to HPG2 MK001920GWSSE P09726-B21 HPE 1.92TB SATA MU LFF LPC DS SSD Any version prior to HPG2 MK001920GWSSE P09728-B21 HPE 1.92TB SATA MU SFF RW DS SSD Any version prior to HPG2 MK003840GWSSF P21517-B21 HPE 3.84TB SATA MU SFF SC SSD Any version prior to HPG2 VK000240GWSRQ P18420-B21 HPE 240GB SATA RI SFF SC MV SSD Any version prior to HPG2 VK000480GWSRR P18422-B21 HPE 480GB SATA RI SFF SC MV SSD Any version prior to HPG2 VK000960GWSRT P18424-B21 HPE 960GB SATA RI SFF SC MV SSD Any version prior to HPG2 VK001920GWSRU P18426-B21 HPE 1.92TB SATA RI SFF SC MV SSD Any version prior to HPG2 VK003840GWSRV P18428-B21 HPE 3.84TB SATA RI SFF SC MV SSD Any version prior to HPG2 MK000480GWSSC P18432-B21 HPE 480GB SATA MU SFF SC MV SSD Any version prior to HPG2 MK000960GWSSD P18434-B21 HPE 960GB SATA MU SFF SC MV SSD Any version prior to HPG2 MK001920GWSSE P18436-B21 HPE 1.92TB SATA MU SFF SC MV SSD Any version prior to HPG2
HPE has released drive firmware versions HPG2 and HPG3 to address this issue. Upgrade the firmware in the HPE Solid State Drive models according to the HPE Model Number and Option Kit installed as per the tables above. Drive firmware HPG3 for VK000240GWSRQ, VK000480GWSRR, VK000960GWSRT, VK001920GWSRU and VK003840GWSRV drives (Table 1): Windows: https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_34f0cbd50f1c4c85a8dc96994c Linux: https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_87656b2dede1409d841a5f6803 VMware: https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_4dd924be589d454db44f73e6d7 Drive firmware HPG2 for MK000480GWSSC, MK000960GWSSD, MK001920GWSSE, MK003840GWSSF, VK000240GWSRQ, VK000960GWSRT, VK001920GWSRU, VK003840GWSRV, MK000480GWSSC, MK000960GWSSD and MK001920GWSSE drives (Table 2): Windows: https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_10a6d8fd2d054d07b7631be824 Linux: https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_dd9a5ebd5436454c8d18f1c56d VMware: https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_907cb657605141fba938906fed HPG2 / HPG3 Firmware Release Notes When SSD statistics are queried, erroneous drive temperatures may be reported. When this occurs, the system may encounter any of the two following conditions, leaving the server in an unstable state: Server shutdown In VMware vSAN environment, storage volume taken offline. RECEIVE PROACTIVE UPDATES : Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively via e-mail through HPE Subscriber's Choice. Sign up for Subscriber's Choice at the following URL: Proactive Updates Subscription Form. NAVIGATION TIP : For hints on navigating HPE.com to locate the latest drivers, patches, and other support software downloads for HPE systems and Options, refer to the Navigation Tips document . SEARCH TIP : For hints on locating similar documents on HPE.com, refer to the Search Tips Document .