Symptoms

For a vSAN 2node or stretched cluster, if vLCM is enabled, the vLCM handles witness node upgrade during cluster upgrade.But when using vLCM to upgrade the cluster to VxRail 8.0.200 release, witness node upgrade is skipped.

Cause

Due to a vCenter issue, the automatic upgrade witness fails. So VxRail 8.0.200 release skipped witness upgrade. The steps on this article must be followed to manually upgrade witness node and disk format after the cluster is upgraded to 8.0.200. This issue only impacts upgrading to 8.0.200 release with vLCM method for a vSAN 2node or stretched cluster. If you use VxRail LCM method to upgrade the cluster and choose the option to automatically upgrade witness, this issue will not appear.

Resolution

After the cluster is upgraded to 8.0.200 release, follow the below steps to manually upgrade the witness node and its' disk format if there is a disk format version change. Upgrade witness node Download the ESXi image from vSAN and upload to the witness host. Go to Inventory -> VxRail-Virtual-SAN-Datastore_* -> upgradeBundles-* -> ESXi8.0.2_22380479-72deb405.zip Download the ESXi image .zip file, and upload it to witness host. Run the following command on the witness node to get the current ESXi version (Optional step): esxcli software baseimage get|grep Version Run the following command on the witness node to get the baseimage version of the uploaded ESXi image. esxcli software sources baseimage list -d is the path where you put the ESXi image .zip file on the witness node. For example: result" src="https://dellservices.file.force.com/servlet/rtaImage?eid=ka06P000000yUGG&feoid=00N2R000006y2Ks&refid=0EM6P00000048UD"> Run the following command on the witness node to create software spec for the wanted baseimage. Modify the version value "8.0.2-0.0.22380479" according to the baseimage version that you get from STEP 3. echo "{\"base_image\": {\"version\": \"8.0.2-0.0.22380479\"}}" > software-spec.json software-spec.json result" src="https://dellservices.file.force.com/servlet/rtaImage?eid=ka06P000000yUGG&feoid=00N2R000006y2Ks&refid=0EM6P00000048UI"> Run the following command on the witness node to perform an ESXi upgrade dry run. (Optional step) >esxcli software apply -d -s --dry-run --no-hardware-warning -s --dry-run --no-hardware-warning result" src="https://dellservices.file.force.com/servlet/rtaImage?eid=ka06P000000yUGG&feoid=00N2R000006y2Ks&refid=0EM6P00000048VG"> Put the witness node to Maintenance mode using vCenter UI. Run the following command on the witness node to perform ESXi upgrade. esxcli software apply -d -s --no-hardware-warning After the upgrade command completes, run "reboot" command. -s --no-hardware-warning result" src="https://dellservices.file.force.com/servlet/rtaImage?eid=ka06P000000yUGG&feoid=00N2R000006y2Ks&refid=0EM6P00000048VL"> After witness node reboot completes, exit it from Maintenance mode using vCenter UI. Run the following command on the witness node to confirm the ESXi version has been upgraded to the targe version. esxcli software baseimage get|grep Version Upgrade disk format If the witness node disk format is older than other ESXi nodes, vCenter UI displays a warning. You can upgrade the disk format version using vCenter UI. Click VxRail Cluster > Configure > Disk Management > UPGRADE. Configure > Disk Management > UPGRADE" src="https://dellservices.file.force.com/servlet/rtaImage?eid=ka06P000000yUGG&feoid=00N2R000006y2Ks&refid=0EM6P00000048V6"> After the disk format upgrade completes, the warning will be gone.

Support Cases