Info
Document Version
Release Date
Details
2
September 13, 2023
Added the NVIDIA HGX A100 40GB/80GB SXM GPUs Air and Liquid Cooled.
1
February 15, 2022
Original Document Release.
On any of the HPE servers mentioned in the Scope section below configured with an NVIDIA A40 or A10 PCIE Accelerator card or NVIDIA HGX A100 40GB/80GB SXM GPUs Air and Liquid Cooled as a "passthrough" PCIe device to Virtual Machines (VM) on VMware ESXi Hypervisor, the VM will fail to power on or will stop responding during the boot process with an error message of
"Insufficient resources, one or more devices (pcipassthru0) required by vm".
Scope
Any of the following servers running VMware ESXi 7.0 Update 2:
HPE Apollo 6500 Gen10 Plus System.
HPE ProLiant DL380 Gen10 server.
HPE ProLiant DL380 Gen10 Plus server.
HPE ProLiant DL385 Gen10 Plus server.
HPE ProLiant DL385 Gen10 server.
HPE ProLiant XL645d Gen10 Plus Configure-to-order Server.
HPE ProLiant XL675d Gen10 Plus Configure-to-order Server.
Resolution
This issue can be avoided by disabling the PCIe device hot-plug in the VMware ESXi host installed on the server:
1.On the bare metal ESXi host, enter the command:
"esxcli system settings kernel set -s enablePCIEHotplug -v FALSE"
2.Reboot the ESXi host.
3.Verify that PCIe device hot-plug is disabled by entering the command:
"esxcli system settings kernel list -o enablePCIEHotplug"
4.The entry, "FALSE," should be displayed under the Runtime column.
5.After changing this setting, the VMs will functions properly when running the GPUs in VMware pass-through mode.
RECEIVE PROACTIVE UPDATES
: Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively in your e-mail through HPE Support Alerts. Sign up for Support Alerts at the following URL:
HPE Email Preference Center.
NAVIGATION TIP:
For hints on navigating HPE.com to locate the latest drivers, patches and other support software downloads, refer to the
Navigation Tips document.
SEARCH TIP:
For hints on locating similar documents on HPE.com, refer to the
Search Tips document.
