Loading...
Loading...
PowerStore appliances connected to SupportAssist may experience an issue where the SupportAssist database (db) grows too large. This may result in space issues on one of the internal partitions (/cyc_node), which can interfere with the ability to perform upgrades or lead to a node reboot. This issue may occur on clusters that have an unusually large number of alerts, which causes the db to become too large. Attempts to upgrade the PowerStoreOS fail with an error suggesting that there is not enough space on /cyc_node to proceed with the upgrade.
SupportAssist creates a database entry for every file that is uploaded to SupportAssist, and does not have a mechanism for aging those entries out. If the system generates many alerts, the database can grow quickly. Example command outputs: [SVC:service@*******-* ~]$ df -hT /cyc_node Filesystem Type Size Used Avail Use% Mounted on /dev/md106 ext4 738M 497M 189M 73% /cyc_node And [SVC:service@*******-* ~]$ ls -lh /cyc_node/service/eve/hostmnt_config/opt/ese/var/run/ese/ese.db -rw-r--r-- 1 1100 1001 200M Sep 21 21:04 /cyc_node/service/eve/hostmnt_config/opt/ese/var/run/ese/ese.db Common scenarios linked to this alert are as follows and are addressable with the svc_partition_cleanup service script: Article # 000198173 PowerStore: System Health Checks Detects Lack of Space in cyc_node Article # 000202707 PowerStore: Pre-Upgrade Health Check fails due to lack of space in /cyc_cfs Article # 000193605 PowerStore: Data Collection Fails, and the PowerStore Manager User Interface Reports Abnormal Information Article # 000324110 PowerStore Alerts: Root partition usage of node X has exceeded 91 percent on mount /. Article # 000202949 PowerStore: Dell SupportAssist database may fill up and lead /cyc_node/ (an internal partition) to be full, causing either NDU failure or Node reboot Article # 000223342 PowerStore: Intermittent alert codes 0x00400601 and 0x00400602 for mount /cyc_node Article # 000328471 PowerStore: Root Partition usage increasing rapidly
The vast majority of causes leading to partition full conditions have been resolved in PowerStoreOS LTS-v4.1.x . After resolving the current condition, update the PowerStore Appliance to PowerStoreOS LTS-v4.1.x or higher . WORKAROUND: NOTE: This is only a temporary, plan to upgrade to PowerStoreOS 3.2.1.0 and above, as soon as possible. Cycle the SupportAssist feature to clear out extraneous files on the /cyc_node mount. From the PowerStore UI, go to Settings > Support Connectivity > Connection Type Take note of the configuration displayed as the details must be reentered in a later step Click to Disabled Click Apply at the bottom of the page Once the job appears to have finished, refresh the UI page to verify the feature is disabled If it does show disabled after a refresh of the UI page, continue to step 2 If it remains enabled after two attempts, contact Dell Technical Support or your Authorized Service Representative, and reference this article ID Wait 15 minutes Enable SupportAssist with the original configuration details captured earlier Once the job appears to have finished, refresh the UI page to verify the feature is enabled If the issues persist utilize the svc_partion_cleanup service script to investigate and clean up the root partitions . General Installation Instructions : KB# 000371058 PowerStore: How To Install svc_injectable service scripts 000371058 PowerStore: How To Install svc_injectable service scripts (Log in as a registered Dell Support user may be required to view this article.) svc_partition_cleanup Procedure : KB# 000214954 PowerStore: How to run the injectable service script svc_partition_cleanup to clean up the partitions /cyc_node, /cyc_var and /cyc_cfs (Log in as a registered Dell Support user may be required to view this article.) If the issues persist or return, contact Technical Support for assistance. Reference KB# 000202949 for expedited service.
Click on a version to see all relevant bugs
Dell Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.