Symptom
Nexus 7k experiences a crash on "ipfib" process of linecard. No core file is written.
%SYSMGR-SLOT2-3-BASIC_TRACE: core_copy: PID XXX with message Core not generated by system for ipfib(0). WCOREDUMP(9) returned zero .
%SYSMGR-SLOT2-2-SERVICE_CRASHED: Service "ipfib" (PID XXX) hasn't caught signal 9 (no core).
However, "show process log" once attached into the linecard console produces a valid process log for "ipfib". It appears "ipfib" has come close to its RLIMIT_AS value, hinting at a memory scalability issue.
Attaching into the linecard console, it looks like under "ipfib" (forwarding process), "libavl.so" could be holding increasing memory over time. Eg:
module-2# show system internal process memory | inc PID|ipfib | ex egrep
PID TTY STAT TIME MAJFLT TRS RSS VSZ %MEM COMMAND
XXX ? Ss 2-15:00:00 0 0 400000 580000 20.0 /isan/bin/ipfib
module-2# show forwarding internal mem-stats detail | inc libavl.so
4 [r-xp]/lc/isan/lib/libavl.so.0.0.0 6900000 6900000 110000000 110000000
In the above example, "libavl.so" is using 110MB as seen in the last column,
Conditions
IPv4 Host route churn/L3 interface flaps