Symptoms

The following errors appear in the Avamar UI: <MRMON010> Controller ID: 0 Controller cache discarded due to memory/battery problems Event ID:10

Cause

This occurs if there is sudden power loss, or unresponsive system, when the battery backup unit (BBU) is not fully charged, and Write Back mode is forcefully enabled. The extended power loss to the system results in the BBU being thoroughly discharged before power recovery. 

Resolution

1. Log in to the Avamar Utility Node as admin. 2. Elevate to root privilege. 3. Load the root keys per article Avamar: How to Log in to an Avamar Server and Load Various Keys. Note: The rest of this article assumes that the admin keys are loaded. 4. Using the information from the UI event or the dial-home Service Request: a. Determine the node that produced the error message. b. Connect to the node as root using the command below: ssn 0.# --user=root (Where 0.# is the physical node number) 5. On the affected node: a. Review the /var/log/messages file to confirm the error and to verify what occurred before the error message. b. Review the environment for any issues, such as power outages. c. Check the current status of the battery: CmdTool2 -AdpBbuCmd -GetBbuStatus -a0 See APPENDIX A for a complete sample output. d. Review the battery state. If the battery is in a failed state, contact Dell Technologies Technical Support to replace the node using the Disk Transplant procedure. If the battery is not in a failed state, force a learn cycle on the battery to ensure that it is functioning correctly: CmdTool2 -AdpBbuCmd -BbuLearn -a0 If the problem persists, contact Dell Technologies Technical Support for further assistance.

Support Cases