Loading...
Loading...
Continue Platform Element Warning logs seen every 10 minutes not pointing to any process. %PLATFORM-4-ELEMENT_WARNING: R0/0: smand: RP/0: Used Memory value 91% exceeds warning level 88%. Top memory allocators are:(none) %PLATFORM-4-ELEMENT_WARNING: R0/0: smand: RP/0: Used Memory value 91% exceeds warning level 88%. Top memory allocators are:(none) It can be also: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand: RP/0: Used Memory value 95% exceeds critical level 93% %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand: RP/0: Used Memory value 95% exceeds critical level 93% Depending on the grade of memory utilization. show platform software status control-processor brief >>>> will indicate the memory status in warning. Memory (kB) Slot Status Total Used (Pct) Free (Pct) Committed (Pct) RP0 Warning 3555960 3145720 (88%) 410240 (12%) 3802732 (107%) show platform software process list R0 sort memory >>>> Will give us the offender process. Name Pid PPid Group Id Status Priority Size ------------------------------------------------------------------------------ ndbmand 5475 5179 5475 S 20 1590060 Additonal command to identify the issue could be: show process memory platform sorted System memory: 3555960K total, 3210136K used, 345824K free, Lowest: 40536K Pid Text Data Stack Dynamic RSS Name ---------------------------------------------------------------------- 844 332 1284404 136 204 1284404 ndbmand <<<<<<<<<<< Holding +1.2GB at the moment. 8120 142097 642012 136 292 642012 linux_iosd-imag If memory leak is not treated, it can cause the device to reboot due to lack of resources.
It potentially affects all IOS-XE platforms. GNXI and NETCONF configured in the device. gnxi gnxi port 50000 gnxi server netconf-yang netconf-yang feature candidate-datastore
Removing telemetry configuration will fix the memory warning status and ndbmand process will immediately lower its memory utilization. (config)#no gnxi (config)#no gnxi port 50000 (config)#no gnxi server (config)#no netconf-yang (config)#netconf-yang feature candidate-datastore (config)#end %PSD_MOD-5-DMI_NOTIFY_NETCONF_STOP:;; R0/0: psd: PSD/DMI: netconf-yang server has been notified to stop After deleting, memory status became healthy. #show platform software status control-processor brief Load Average Slot Status 1-Min 5-Min 15-Min RP0 Healthy 2.11 1.46 0.99 Memory (kB) Slot Status Total Used (Pct) Free (Pct) Committed (Pct) RP0 Healthy 3555960 1282592 (36%) 2273368 (64%) 1774220 (50%) CPU Utilization Slot CPU User System Nice Idle IRQ SIRQ IOwait RP0 0 11.11 13.31 0.00 75.17 0.00 0.40 0.00 1 21.50 6.30 0.00 70.90 0.00 1.10 0.20 Ndmand process size reduced significantly. #show platform software process list R0 sort memory Name Pid PPid Group Id Status Priority Size ------------------------------------------------------------------------------ linux_iosd-imag 8120 7772 8120 S 20 399580 cylon_mgr 12977 11426 12977 S 20 119504 pubd 5798 5488 5798 S 20 94388 confd 8546 6017 6017 R 20 84948 ndbmand 6349 6041 6349 S 20 73148
Memory leak could be seen in the long run. Additional WA: test platform software process exit ndbman R0 stateless If suspecting this issue is affecting your device consider to collect show tech and tracelog files to open a TAC case before rebooting/remove configuration from the affected device for proper diagnosis.
Click on a version to see all relevant bugs
Cisco Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.