Symptom
Memory leak in IOSXE 16.9.x software version, with 'keyman' process being the cause of it. Here are some places where evidence of it may be seen:
switch1#show process memory platform sorted
System memory: 7711568K total, 7548804K used, 162764K free,
Lowest: 162764K
Pid Text Data Stack Dynamic RSS Total Name
--------------------------------------------------------------------------------
14441 143965 635592 136 300 635592 4632088 linux_iosd-imag
10895 106 3988736 136 3978588 3988736 4133588 keyman <<<< RSS counter increasing over time
switch1#show platform software status control-processor brief
Load Average
Slot Status 1-Min 5-Min 15-Min
1-RP0 Healthy 0.31 0.47 0.55
2-RP0 Healthy 0.38 0.36 0.37
3-RP0 Healthy 0.11 0.17 0.15
Memory (kB)
Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
1-RP0 Warning 3977748 3749888 (94%) 227860 ( 6%) 4676672 (118%) <<<
2-RP0 Healthy 3977748 1783944 (45%) 2193804 (55%) 2719304 (68%)
3-RP0 Healthy 3977748 1123252 (28%) 2854496 (72%) 1507588 (38%)
Conditions
The controller was running with 1906 APs connected, after adding to DNAC AP start flapping.
Because of it, Keyman process started leaking and increasing its memory usage.
Workaround
No workarounds seen at the moment.