Symptom
The device might face a memory leak condition caused by the "Skinny Msg Server" process, the output of 'show memory process' might look like this:
#show process memory sorted
Processor Pool Total: 307942304 Used: 252439876 Free: 55502428
I/O Pool Total: 54525952 Used: 28599008 Free: 25926944
PID TTY Allocated Freed Holding Getbufs Retbufs Process
30 0 2706350940 3244035316 81122088 2622661980 2231886220 Skinny Msg Serve <<< Top offending process
0 0 239502012 151546076 80401500 0 0 *Init*
0 0 0 0 51094324 0 0 *MallocLite*
There is also a chance that the device crashes due to a low memory condition, in that case the crash might allocate logs similar to:
%DIALPEER_DB-3-ADDPEER_MEM_THRESHOLD: Addition of dial-peers limited by available memory
Conditions
2951 router running Skinny Msg Server process
Workaround
A momentary workaround will be to reload the device to free the memory.