OPERATIONAL DEFECT DATABASE
...
...
From VxRail lcm-web.log: 2025-08-31T10:27:25.367Z <4304e36e4934ff08fc8120c70e58301b> lcm [WARN] <183> VirtualApplianceUpgradeService.java runUpgrade() (1158): LCM Exception occurred during upgrade for virtual appliance 0 - {} com.vce.lcm.exception.LCMException: Failed to upgrade the VMware vCenter Server: Failed to export data from source VM VCENTER01. at com.vce.lcm.api.LCMServiceImpl.handleUpgradeException(LCMServiceImpl.java:2129) at com.vce.lcm.api.LCMServiceImpl.performUpgrade(LCMServiceImpl.java:509) at com.emc.mystic.manager.upgrade.service.VirtualApplianceUpgradeService.runUpgrade(VirtualApplianceUpgradeService.java:1134) at com.emc.mystic.manager.upgrade.service.PureUpgradeRestServiceImpl.lambda$retryVirtualApplianceUpgrade$0(PureUpgradeRestServiceImpl.java:129) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: com.vce.lcm.exception.LCMInternalException: Failed to upgrade the VMware vCenter Server: Failed to export data from source VM VCENTER01. at com.vce.lcm.core.upgrade.ComponentUpgradeService.performComponentUpgrade(ComponentUpgradeService.java:339) at com.vce.lcm.api.LCMServiceImpl.performComponentUpgrade(LCMServiceImpl.java:2439) at com.vce.lcm.api.LCMServiceImpl.performCompositeUpgrade(LCMServiceImpl.java:1845) at com.vce.lcm.api.LCMServiceImpl.performUpgrade(LCMServiceImpl.java:507) ... 7 common frames omittedFrom log on New developed VC /var/log/vmware/upgrade/export.json The Upgrade failed when "Exporting VMware Analytics Service data..." with TIME_OUT Error. { "progress": 37, "progress_message": { "id": "ur.upgrade.script.export.progress.text", "translatable": "Exporting %(0)s data...", "args": [ "VMware Analytics Service" ], "localized": "Exporting VMware Analytics Service data..." }, "status": "error", "info": [], "warning": [], "question": null, "error": { "detail": [ { "id": "ur.upgrade.execution.timedout.text", "translatable": "Upgrade phase timed out. The time planned for the upgrade phase was %(0)s minutes. The upgrade phase has already been running for %(1)s minutes.", "args": [ 60, 60 ], "localized": "Upgrade phase timed out. The time planned for the upgrade phase was 60 minutes. The upgrade phase has already been running for 60 minutes." } ], "componentKey": "upgrade_framework", "problemId": null, "resolution": { "id": "ur.upgrade.execution.timedout.resolution", "translatable": "To extend the default timeout, set environment variable %(0)s for export upgrade phase, %(1)s for import upgrade phase, and %(2)s for import historical data phase. The timeout is in minutes.", "args": [ "UPGRADE_EXPORT_TIMEOUT", "UPGRADE_IMPORT_TIMEOUT", "UPGRADE_POST_IMPORT_TIMEOUT" ], "localized": "To extend the default timeout, set environment variable UPGRADE_EXPORT_TIMEOUT for export upgrade phase, UPGRADE_IMPORT_TIMEOUT for import upgrade phase, and UPGRADE_POST_IMPORT_TIMEOUT for import historical data phase. The timeout is in minutes." } },
This issue occurs because the push telemetry process sends an excessive number of requests with unique IDs, resulting in the creation of a large number of files in the "/var/log/vmware/analytics/prod" directory.In some cases, this has led to the accumulation of 185,000 to 375,000 files.
Refer to KB https://knowledge.broadcom.com/external/article/322053/vcenter-server-upgrade-from-70-to-80-fai.html Connect to the source vCenter server via SSHRun the following command to check the number of files created on the vCenter server due to push telemetry process: ls /var/log/vmware/analytics/prod | wc -lDownload the cleaning_vddk_script.sh script from the attachments section of the KB.Upload the script to vCenter and assign "execute" permissions with this command: chmod +x cleaning_vddk_script.shRun the script: ./cleaning_vddk_script.shRestart Upgrade from VxRail Plugin
Click on a version to see all relevant bugs
Dell Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.
