Symptom

ESPs crash continuously after upgrading to 17.3.3 and generate a lot of syslogs: %CPPOSLIB-3-ERROR_NOTIFY: F0: cpp_ha: cpp_ha encountered an error -Traceback= 1#2aa66748f21e0ad7d2dde81b39702a4e errmsg:7F5EAB767000+D20 cpp_common_os:7F5EB058A000+DCEC cpp_common_os:7F5EB058A000+19E8E cpp_drv_cmn:7F5EADE0B000+42EAF :5628FC9C6000+15D89 :5628FC9C6000+279AD evlib:7F5EA9701000+9145 evlib:7F5EA9701000+9A9C cpp_common_os:7F5EB058A000+13BD2 :5628FC9C6000+15074 c:7F5E9F069000+240FD :5628FC9C6000+1012A %CPPDRV-3-LOCKDOWN_INITIATED: F0: cpp_ha: QFP0.0 CPP Driver LOCKDOWN being triggered due to fatal error. %CPPHA-3-FAILURE: F0: cpp_ha: CPP 0 failure Stuck Thread(s) detected %CPPHA-3-FAULT: F0: cpp_ha: CPP:0.0 desc:Stuck CPP Thread det:HA class:OTHER sev:FATAL id:0 cppstate:STOPPED res:UNKNOWN flags:0x2 cdmflags:0x0 %CPPHA-3-FAULTCRASH: F0: cpp_ha: CPP 0.0 unresolved fault detected, initiating crash dump. %CPPDRV-3-LOCKDOWN: F0: cpp_ha: QFP0.0 CPP Driver LOCKDOWN encountered due to previous fatal error (SW: Userspace fault). %IOSXE-3-PLATFORM: F0: cpp_cdm: CPP crashed, collecting state. %CPPDRV-3-LOCKDOWN: F0: fman_fp_image: QFP0.0 CPP Driver LOCKDOWN encountered due to previous fatal error (SW: Userspace fault). %CMRP-6-FP_HA_STATUS: R1/0: cmand: F1 redundancy state is Active %CPPDRV-3-LOCKDOWN: F0: cpp_cp: QFP0.0 CPP Driver LOCKDOWN encountered due to previous fatal error (SW: Userspace fault). %IOSXE-3-PLATFORM: F0: cpp_cdm: CPP crashed, generating core file. %CPPOSLIB-3-ERROR_NOTIFY: F1: cpp_ha: cpp_ha encountered an error -Traceback= 1#2aa66748f21e0ad7d2dde81b39702a4e errmsg:7F56FA3C9000+D20 cpp_common_os:7F56FF1EC000+DCEC cpp_common_os:7F56FF1EC000+19E8E cpp_drv_cmn:7F56FCA6D000+42EAF :55ADB8003000+15D89 :55ADB8003000+279AD evlib:7F56F8363000+9145 evlib:7F56F8363000+9A9C cpp_common_os:7F56FF1EC000+13BD2 :55ADB8003000+15074 c:7F56EDCCB000+240FD :55ADB8003000+1012A %CPPDRV-3-LOCKDOWN_INITIATED: F1: cpp_ha: QFP0.0 CPP Driver LOCKDOWN being triggered due to fatal error. %CPPHA-3-FAILURE: F1: cpp_ha: CPP 0 failure Stuck Thread(s) detected %CPPHA-3-FAULT: F1: cpp_ha: CPP:0.0 desc:Stuck CPP Thread det:HA class:OTHER sev:FATAL id:0 cppstate:STOPPED res:UNKNOWN flags:0x2 cdmflags:0x0 %CPPHA-3-FAULTCRASH: F1: cpp_ha: CPP 0.0 unresolved fault detected, initiating crash dump. %CPPDRV-3-LOCKDOWN: F1: cpp_ha: QFP0.0 CPP Driver LOCKDOWN encountered due to previous fatal error (SW: Userspace fault). %IOSXE-3-PLATFORM: F1: cpp_cdm: CPP crashed, collecting state. %CPPDRV-3-LOCKDOWN: F1: cpp_cp: QFP0.0 CPP Driver LOCKDOWN encountered due to previous fatal error (SW: Userspace fault). %IOSXE-3-PLATFORM: F1: cpp_cdm: CPP crashed, generating core file. %IOSXE_OIR-6-OFFLINECARD: Card (fp) offline in slot F0 %IOSXE_OIR-6-OFFLINECARD: Card (fp) offline in slot F1 %CPPOSLIB-3-ERROR_NOTIFY: F1: cpp_cp: cpp_cp encountered an error -Traceback= 1#edd9136b8fa888f638fdb0b75f841dcc errmsg:7F3254260000+D20 cpp_common_os:7F32566D3000+DCEC cpp_common_os:7F32566D3000+19E8E cpp_sbs:7F3265950000+D754 cpp_sbs:7F3265950000+95DC cpp_sbs:7F3265950000+99EE cpp_sbs:7F3265950000+991E cpp_gic_ea_lib:7F3270A6C000+16599 cpp_gic_smc_lib:7F3270CB3000+4718 cpp_common_os:7F32566D3000+11AF1 cpp_common_os:7F32566D3000+121BE evlib:7F3254050000+8D8E evlib:7F3254050000+9A9C cpp_common_os:7F32566D3000+13BD2 %CPPDRV-3-LOCKDOWN: F1: fman_fp_image: QFP0.0 CPP Driver LOCKDOWN encountered due to previous fatal error (SW: Userspace fault). %CPPOSLIB-3-ERROR_NOTIFY: F1: fman_fp_image: fman_fp encountered an error -Traceback= 1#e1d3e6f05fc8f992ba5ca146a7cca316 errmsg:7F9E3CC48000+D20 cpp_common_os:7F9E68CF9000+DCEC cpp_common_os:7F9E68CF9000+19E8E cpp_sbs:7F9E6828D000+D754 cpp_sbs:7F9E6828D000+95DC cpp_sbs:7F9E6828D000+99EE cpp_sbs:7F9E6828D000+991E cpp_cef_mpls_common:7F9E6A7DE000+43E5D :55BC7A59C000+90DD72 evlib:7F9E1B393000+9145 evlib:7F9E1B393000+9A9C :55BC7A59C000+3A6E8F :55BC7A59C000+66054A :55BC7A59C000+97E5B3 :55BC7A59C000+97DA21 :55BC7A59C000+97D8A8 : %IOSXE-1-PLATFORM: F0: kernel: QFP0.0: Fatal Fault: SW reported: Userspace fault %CPPOSLIB-3-ERROR_NOTIFY: F0: cpp_ha: cpp_ha encountered an error -Traceback= 1#2aa66748f21e0ad7d2dde81b39702a4e errmsg:7F5EAB767000+D20 cpp_common_os:7F5EB058A000+DCEC :5628FC9C6000+11CEF :5628FC9C6000+2CBBD :5628FC9C6000+2A6C4 :5628FC9C6000+1B251 :5628FC9C6000+13906 :5628FC9C6000+197EB :5628FC9C6000+16C9C :5628FC9C6000+1A877 cpp_common_os:7F5EB058A000+123ED evlib:7F5EA9701000+8D8E evlib:7F5EA9701000+9A9C cpp_common_os:7F5EB058A000+13BD2 :5628FC9C6000+15074 c:7F5E9F069000+240FD :5628FC9C6000+1012A %CPPHA-3-FAULT: F0: cpp_ha: CPP:0.0 desc:CPP Client process failed: FMAN-FP det:HA class:CLIENT_SW sev:FATAL id:1 cppstate:RUNNING res:UNKNOWN flags:0x0 cdmflags:0x0 %PMAN-3-PROCHOLDDOWN: F0: root: The process fman_fp_image has been helddown (rc 134) %PMAN-0-PROCFAILCRIT: F0: pvp: A critical process fman_fp_image has failed (rc 134)

Conditions

Running 17.3.3 Flexible Netflow configured

Workaround

Disable Flexible Netflow Router(config-if)# no ip flow monitor

Further Problem Description