Launching soon: The world's first vendor agnostic bug scrubLearn more & join waitlist
OPERATIONAL DEFECT DATABASE
...
...
Navigating to Administration > History > Recent Tasks results in an Internal Server Error message.In /storage/vcops/log/web.log you see error similar to: 2018-05-09 13:30:10,871 ERROR [ajp-nio-127.0.0.1-8009-exec-10] com.vmware.vcops.bridge.client.DataRetrieverClient.execute - com.vmware.vcops.platform.gemfire.GemfireFunction$MethodInvocationException: GlobalDataPersistenceException: Unable to perform get request Msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive) Error code: DB_EXCEPTION Kv Exception msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive)org.apache.geode.cache.execute.FunctionException: com.vmware.vcops.platform.gemfire.GemfireFunction$MethodInvocationException: GlobalDataPersistenceException: Unable to perform get request Msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive) Error code: DB_EXCEPTION Kv Exception msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive) at com.vmware.vcops.platform.gemfire.GemfireFunctionExecutor$GemfireFunctionResultReceiver.getResult(GemfireFunctionExecutor.java:739) at org.apache.geode.internal.cache.execute.util.SynchronizedResultCollector.getResult(SynchronizedResultCollector.java:39) at com.vmware.vcops.platform.gemfire.GemfireFunctionExecutor.onServers(GemfireFunctionExecutor.java:78) ... and 113 moreCaused by: com.vmware.vcops.platform.gemfire.GemfireFunction$MethodInvocationException: GlobalDataPersistenceException: Unable to perform get request Msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive) Error code: DB_EXCEPTION Kv Exception msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive) at com.vmware.vcops.platform.gemfire.GemfireFunction.invokeHandlerMethod(GemfireFunction.java:129) at com.vmware.vcops.platform.gemfire.GemfireFunction.execute(GemfireFunction.java:59) at com.vmware.vcops.platform.gemfire.GemfireFunctionHandler$FunctionHandler.execute(GemfireFunctionHandler.java:438) ... 12 moreCaused by: com.vmware.statsplatform.persistence.exception.GlobalDataPersistenceException: Unable to perform get request Msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive) Error code: DB_EXCEPTION Kv Exception msg: Unable to getSafe for future: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency QUORUM (2 required but only 0 alive) at com.vmware.statsplatform.persistence.global.KvStoreOldToNewWrapper.queryStartsWith(KvStoreOldToNewWrapper.java:670) at com.vmware.vcops.controller.retriever.ActionStatusRetriever.retrieve(ActionStatusRetriever.java:67) at com.vmware.vcops.controller.retriever.ActionService.getActionStatuses(ActionService.java:158) ... 25 more2018-05-09 13:30:10,896 ERROR [ajp-nio-127.0.0.1-8009-exec-10] com.vmware.vcops.ui.util.MainPortalListener.log - (Component: TODOUrl: /ui/remediationActions.actionParams: mainAction=getActionStatuses;start=0;limit=50)
Missing content or objects reference in a recent task will result in an Internal Server Error.
All Recent Tasks information will be lost after truncating the remediationactions table.
To resolve the issue, truncate the remediationactions table from the Cassandra (cqlsh) database. Log into the Primary node as root via SSH or Console.Run this command to launch the cqlsh utility: vRealize Operations Manager 6.1 - 6.5$ALIVE_BASE/cassandra/apache-cassandra-2.1.8/bin/cqlsh --ssl --cqlshrc $ALIVE_BASE/user/conf/cassandra/cqlshrcvRealize Operations Manager 6.6$VMWARE_PYTHON_BIN $ALIVE_BASE/cassandra/apache-cassandra-2.1.8/bin/cqlsh --ssl --cqlshrc $ALIVE_BASE/user/conf/cassandra/cqlshrcvRealize Operations Manager 6.7$VMWARE_PYTHON_BIN $ALIVE_BASE/cassandra/apache-cassandra-3.9/bin/cqlsh --ssl --cqlshrc $ALIVE_BASE/user/conf/cassandra/cqlshrc Set the consistency to all nodes: consistency all; Truncate the remediationactions table: truncate globalpersistence.remediationactions; In the vRealize Operations Manager UI, reload the Administration > History > Recent Tasks page.