Symptoms

VxVerify runs several tests on each node by uploading a 'minion' heath-check program, which detects issues that may cause upgrades to fail. One VxVerify host health-check is 'df_zero', which reviews the drive mount point information, to check for external storage with zero capacity, which can block upgrade. Test ResultResult code Result InterpretationPass0No zero capacity Virtual Machine File System (VMFS) volumes foundWarning1The test has no warning results.Failure2One or more zero capacity VMFS volumes foundCritical 3 This test has no critical result. Each test that passes is not listed in the summary report, for ease of reading.An example of the health-check output, when a zero capacity volume is found: #========================#======#=========#====================================================================#==============# | Hostname / Category |Status Dell_KB | Warnings or Failures, unless tests Passed ; Product S.N. | #========================#======#=========#====================================================================#==============# | Node1 | Failure 205828 | df_zero: df found zero capacity VMFS volumes for: SC5020_... .|

Cause

Zero capacity VMFS volumes could appear as follows in the output of a 'df' command on a node: Filesystem Bytes Used Available Use% Mounted on VMFS-6 207769042944 44024463360 163744579584 21% /vmfs/volumes/FNPS9T90000000-01-01-service-datastore1 VMFS-6 0 0 0 0% /vmfs/volumes/SC5020_6TB_01xXx VMFS-6 0 0 0 0% /vmfs/volumes/SC5020_6TB_01xXy VMFS-L 23353884672 2443182080 20910702592 10% /vmfs/volumes/OSDATA-602beef1-c7808a2e-1771-e4434b4b9990 vfat 4293591040 208535552 4085055488 5% /vmfs/volumes/BOOTBANK1 vfat 4293591040 232914944 4060676096 5% /vmfs/volumes/BOOTBANK2 vsan 122904090116096 16026256008436 106877834107660 13% /vmfs/volumes/VxRail-Virtual-SAN-Datastore-xxxxxxx-xxxxxx-4a12-838b-0591df7ababc Zero capacity mount points can be due to storage being disconnected, but not detached (unmounted).These zero capacity partitions are marked as an issue by Lifecycle Manager (LCM) and would block the upgrade, until they are detached in the vCenter UI. 

Resolution

The zero capacity mount point names are listed in the output of this healthcheck, and this can be confirmed by running the following on a node: esxcli storage filesystem list Detach the zero size volumes in the vCenter UI and rerun this command, to ensure that no zero size volumes remain.If the storage has already been removed, follow VMware KB 1003988 to rescan the storage on each ESXi node. 

Support Cases