Symptoms
There are two different symptoms for the failure issue related to establishing NVMe/TCP connections:
ESXi hosts are trying to establish new NVMe/TCP connections with the PowerStore for creating VMFS volumes. The creation of new volumes might fail.
OR
ESXi hosts are trying to establish additional paths to already created VMFS volumes. Additional path creations might fail.
The above failures are expected to be seen under large-scale scenarios when there are several NVMe/TCP active connections. This has been observed when there are 64 active connections already established between ESXI hosts and PowerStore.The issue is specific to PowerStore v2.1.
Cause
PowerStore introduced a resource optimization feature which causes the current issue. The behavior exhibited by the ESXI host is not according to the NVMe spec. (VMware KB DCPN 00098276).
Resolution
Upgrade PowerStore version from v2.1 to a newer release, for example, 3.0 and above. PowerStore optimization takes into account the ESXi behavior.
