Symptoms

VxRail VD-4000 environment when deployed as 3+ node standard cluster (not vSAN 2-node ROBO)Upgrade to versions 7.0.483 or 7.0.484 failError occurs in the "Credentials and Settings" of the UI pageError message: The server has experienced an unexpected internal error. Try again later lcm-web.log: 2024-05-13T18:24:55.161Z <00000000000000000000000000000000> surrogate [INFO] <174> HostDO.java getWitnessSledMoId() (993): [witness_sled] get embedded witness node chassis info via HostDO service 2024-05-13T18:24:55.161Z <00000000000000000000000000000000> surrogate [INFO] <174> HostDO.java getHostDoResponse() (451): cache key: {witnessHosts {moid name hardware{baseline {chassisId}}}} 2024-05-13T18:24:55.161Z <00000000000000000000000000000000> surrogate [ERROR] <174> RestErrorHandler.java handleExceptionInternal() (188): Handling exception for request ServletWebRequest: uri=/surrogate/mystic/private/lcm/upgrade-spec;client=172.28.xxx.xxx com.dellemc.vxrail.lcm.data.provider.in.DataReadException: [witness_sled] haven't found witness node at com.dellemc.vxrail.lcm.data.provider.repositories.domain.HostDO.getWitnessSledMoId(HostDO.java:997) at com.dellemc.vxrail.lcm.data.provider.repositories.domain.HostDO$$FastClassBySpringCGLIB$$cda00081.invoke(<generated>) at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.dellemc.vxrail.lcm.data.provider.repositories.log.DOLogAspect.aroundDOAdvice(DOLogAspect.java:34) at jdk.internal.reflect.GeneratedMethodAccessor419.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707) at com.dellemc.vxrail.lcm.data.provider.repositories.domain.HostDO$$EnhancerBySpringCGLIB$$69a5b409.getWitnessSledMoId(<generated>) at com.emc.mystic.manager.upgrade.service.UpgradeSpecInfoServiceImpl.createWitnessVMUpgradeSpecInfos(UpgradeSpecInfoServiceImpl.java:801) at com.emc.mystic.manager.upgrade.service.UpgradeSpecInfoServiceImpl.createUpgradeSpecInfos(UpgradeSpecInfoServiceImpl.java:287) at com.emc.mystic.manager.upgrade.controller.LcmUpgradeControllerImpl.getUpgradeSpec(LcmUpgradeControllerImpl.java:578) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)

Cause

This issue occurs when the upgrade looks for witness sled information in a standard deployment which should not occur.

Resolution

Contact Dell Support and mention this article number in the ticket.

Support Cases