Loading...
Loading...
From the user interface (UI), Lifecycle Management (LCM) failed at 99%, task Update VC cert : From the lcm-web.log : 2021-12-06 07:14:23,000 INFO [LCM] [upgrade-task-0] c.v.l.c.c.f.UpdateVcFqdnTask [UpdateVcFqdnTask.java:48] begin to update VC FQDN. 2021-12-06 07:14:23,023 INFO [LCM] [upgrade-task-0] c.v.l.c.c.f.UpdateVcFqdnTask [UpdateVcFqdnTask.java:54] VC address from DO: <VCSA-FQDN>, VC address from VC mob: <VCSA-FQDN> 2021-12-06 07:14:23,023 INFO [LCM] [upgrade-task-0] c.v.l.c.c.f.UpdateVcFqdnTask [UpdateVcFqdnTask.java:56] Update vc address with FQDN: <VCSA-FQDN> 2021-12-06 07:14:23,028 INFO [LCM] [lcm-core-0] c.v.l.t.SimpleUpgradeTaskExecutor [SimpleUpgradeTaskExecutor.java:48] Start to execute task : VcCertTask 2021-12-06 07:14:23,303 INFO [LCM] [upgrade-task-0] c.d.v.l.d.p.r.d.NanoServiceDO [NanoServiceDO.java:63] Call nano-service to update VC cert in VXM. ==> unix.http://127.0.0.1/rest/vxm/internal/operation/v1/vxm/download-vc-certs/execute, req body: {"vc_info":{"host":"<VCSA-FQDN>","username":"Administrator@vsphere.local","password":"******","port":443},"auto_accept_vc_cert":true} 2021-12-06 07:14:24,906 ERROR [LCM] [upgrade-task-0] c.v.c.c.VcCertService [VcCertService.java:36] Error happened when update VC cert in vxm.500 INTERNAL SERVER ERROR: [{"result": {"error": {"code": "E3100_Security_CERT_01", "params": ["<VCSA-FQDN>"], "message": "Failed to download vc certs"}}}2021-12-06 07:14:26,019 ERROR [LCM] [upgrade-task-0] c.d.v.l.d.p.u.HttpUtilsForDO [HttpUtilsForDO.java:99] Got http response but with error 2021-12-06 07:14:26,019 ERROR [LCM] [upgrade-task-0] c.d.v.l.d.p.u.HttpUtilsForDO [HttpUtilsForDO.java:100] The do error body is {"errors":[{"message":"Failed to connect to vCenter None","locations":[{"line":1,"column":22}],"path":["cluster"]}],"data":{"cluster":null}} 2021-12-06 07:14:26,019 ERROR [LCM] [upgrade-task-0] c.d.v.l.d.p.r.d.ClusterDO [ClusterDO.java:86] The http request is ok but has raised errors. Please check message in log 2021-12-06 07:14:26,019 ERROR [LCM] [upgrade-task-0] c.d.v.l.d.p.r.d.ClusterDO [ClusterDO.java:91] Haven't got cluster from Cluster DO. 2021-12-06 07:14:26,020 ERROR [LCM] [lcm-core-0] c.v.l.t.SimpleUpgradeTaskExecutor [SimpleUpgradeTaskExecutor.java:71] Failed to execute task ResetLCMParamsTask. java.util.concurrent.ExecutionException: com.dellemc.vxrail.lcm.data.provider.in.DataReadException: Haven't got cluster from Cluster DO. at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:205) at com.vce.lcm.task.SimpleUpgradeTaskExecutor.execute(SimpleUpgradeTaskExecutor.java:61) at com.vce.lcm.task.SimpleUpgradeTaskExecutor.execute(SimpleUpgradeTaskExecutor.java:113) at com.vce.lcm.task.SimpleUpgradeTaskExecutor.execute(SimpleUpgradeTaskExecutor.java:119) at com.vce.lcm.core.composite.finalize.CompositeUpgradeFinalizeService.finalize(CompositeUpgradeFinalizeService.java:53) at com.vce.lcm.api.LCMServiceImpl.performCompositeUpgrade(LCMServiceImpl.java:1466) at com.vce.lcm.api.LCMServiceImpl.performUpgrade(LCMServiceImpl.java:438) From the short.term.log : 2021-12-06-07:14:24 microservice.vxm-agent "2021-12-06 07:14:24,861 [INFO] <Thread-1046:139849358792448> vxm_operate.py download_vc_cert() (653): Get download.zip from https://<VC-FQDN>/certs/download.zip"2021-12-06-07:14:24 microservice.nano-service "2021-12-06 07:14:24,903 [ERROR] <Dummy-4:139947673123656> utils.py wrapper() (101): log_call 8, static.handle_vxm_agent_response raise exception: OperationException: {""message"": ""ConnectionError(MaxRetryError(\""HTTPSConnectionPool(host='<VCSA FQDN>', port=443): Max retries exceeded with url: /certs/download.zip (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f3136c1bf60>: Failed to establish a new connection: [Errno -2] Name or service not known',))\"",),)"", ""bundle"": """", ""prefix"": ""common.exceptions.OperationException"", ""key"": """", ""field"": """", ""error_code"": ""0"", ""exit_code"": ""-1"", ""params"": []}"
Starting from version 7.0.240, a new task, "updateVcFqdnTask" , was introduced in finalize stage. The VMware vCenter Server Appliance (VCSA) IP is replaced by the VCSA FQDN in config-service, query the result as below: curl --unix-socket /var/lib/vxrail/nginx/socket/nginx.sock http://127.0.0.1/rest/vxm/internal/configservice/v1/configuration/keys/vcenter_host The VCSA FQDN is obtained from VCSA mob. In this case, the customer changed the VCSA FQDN, but the VirtualCenter.FQDN was not updated (either it is still an IP or the incorrect VCSA FQDN). The incorrect value in VirtualCenter.FQDN leads to the failure of the following task: Cert downloading: Name or service not known" when "Get download.zip from https://<VC-FQDN>/certs/download.zip
Update VirtualCenter.FQDN to the correct VCSA FQDN value in the vCenter server Advanced Settings and retry the upgrade (The figure below is from a lab device).
Click on a version to see all relevant bugs
Dell Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.