...
The memory allocation is failing for ?aclqos? time to time when customer is trying to do some config changes. 2021 Sep 15 20:46:33 XXXX %VSHD-5-VSHD_SYSLOG_CMD_EXEC: User:YYYY executed the command:run bash 2021 Sep 15 20:46:33 XXXX %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by YYYY on nginx 2021 Sep 15 20:46:36 XXXX %ETHPORT-5-IF_UP: Interface loopback107 is up 2021 Sep 15 20:46:36 XXXX %ETHPORT-5-IF_DOWN_ADMIN_DOWN: Interface loopback107 is down (Administratively down) 2021 Sep 15 20:46:36 XXXX %ETHPORT-5-IF_UP: Interface loopback107 is up 2021 Sep 15 20:46:53 XXXX %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by YYYY on nginx Then we started to see Kernel Malloc failed: 2021 Sep 15 20:47:03 XXXX %ACLQOS-SLOT1-2-ACLQOS_FAILED: ACLQOS failure: Error sending client status for verify session ret_val 0x8048000c 2021 Sep 15 20:47:03 XXXX Sep 15 20:47:03 %KERN-2-SYSTEM_MSG: [39867437.898852] psskmalloc: aclqos:1291 error! malloc for km_p failed for size 0x49260 - kernel 2021 Sep 15 20:47:03 XXXX Sep 15 20:47:03 %KERN-2-SYSTEM_MSG: [39867438.085114] psskmalloc: aclqos:1291 error! malloc for km_p failed for size 0x49260 - kernel 'show processes memory` PID MemAlloc MemLimit MemUsed StackBase/Ptr Process ----- -------- ---------- ---------- ----------------- ---------------- 1291 233074688 0 766373888 ffb86680/ffb85670 aclqos <<<<<<<<<<< Memory limit showing 0 , Memory used is high. 32130 47681536 775582297 431452160 ffc29180/ffc2767c aclqos
Configuration change via command line, script, track, other.
1. Free up the memory using the command sequence provided, or ++ Get access to bash shell ++ Go to folder proc/sys/vm ++ Monitor memory available from cache ++ Change value with "echo 3 > drop_caches" ++ Monitor memory again with command cat/proc/meminfo |egrep -I -e "MemFree|MemAvail" Example: ======= bash-4.3# cd /proc/sys/vm bash-4.3# cat /proc/meminfo | egrep -i -e 'memfree|memavail' MemFree: 16154452 kB MemAvailable: 17060220 kB bash-4.3# echo 3 > drop_caches bash-4.3# cat /proc/meminfo | egrep -i -e 'memfree|memavail' MemFree: 16640264 kB MemAvailable: 17063700 kB 2. Reload the switch. switch# reload This command will reboot the system. (y/n)? [n] y
If the memory allocation errors have been persistent or enough in a short duration that causes other processes to hang, the switch can require a reload.