Symptom
We observe a crash in 'mobilityd' process. Rather than a sudden crash, it may be preceded by the deregistration of all APs.
At the moment of the crash we may see logs similar to the following:
Feb 04 19:43:57.006: %PMAN-3-RPSWITCH: R0/0: RP switch initiated. Critical process mobilityd has failed (rc 0)
Feb 04 19:43:57.760: %PMAN-5-EXITACTION: F0/0: pvp: Process manager is exiting:
Feb 04 19:43:57.851: %PMANTACTION: C0/0: pvp: Process manager is exiting:
Feb 04 19:43:59.923: %PMAN-3-PROCHOLDDOWN: R0/0: The process mobilityd has been helddown (rc 139)
Feb 04 19:44:00.418: %PMAN-5-EXITvp: Process manager is exiting: process exit with reload fru code
And a system report may have been generated and present in bootflash:core/
Feb 04 19:44:13.102: %PMAN-3-PROCESS_NOTIFICATION: R0/0: pvp: System report core/controller_1_RP_0-system-report_20210204-194408-UTC.tar.gz (size: 18785 KB) generated and System report info at core/controller_1_RP_0-system-report_20210204-194408-UTC-info.txt
Conditions
Mobility tunnel up between two WLCs and MFP enabled. So far, observed in:
- IRCM scenario, mobility tunnel between 9800 and 8540.
- Mobility tunnel between 9800 WLCs.
Workaround
Disable MFP in at least one of the controllers.
Controller(config)#no wireless wps mfp
Further Problem Description
The crash happens internaly during MFP key update process.