Launching soon: The world's first vendor agnostic bug scrubLearn more & join waitlist
OPERATIONAL DEFECT DATABASE
...
...
cu facing defect
- Several processes continue to fail and generating core files as a result of heartbeat failure. - mtm, port_client, sensor will crash `show logging log` or `show logging nvram` %SYSMGR-SLOT1-2-SERVICE_CRASHED: Service "sensor" (PID 15853) hasn't caught signal 6 (core will be saved). %SYSMGR-SLOT1-3-HEARTBEAT_FAILURE: Service "mtm" sent SIGABRT for not setting heartbeat for last 5 periods. Last heartbeat 222.36 secs ago. %SYSMGR-SLOT1-3-HEARTBEAT_FAILURE: Service "port_client" sent SIGABRT for not setting heartbeat for last 10 periods. Last heartbeat 110.77 secs ago. %SYSMGR-SLOT1-2-SERVICE_CRASHED: Service "mtm" (PID 16114) hasn't caught signal 6 (core will be saved). %SYSMGR-SLOT1-2-HAP_FAILURE_SUP_RESET: Service "mtm" in vdc 1 has had a hap failure `show cores` VDC Module Instance Process-name PID Date(Year-Month-Day Time) --- ------ -------- --------------- -------- ------------------------- 1 1 1 port_client 16105 2023-10-24 03:32:00 1 1 1 sensor 15842 2023-10-24 03:33:10 1 1 1 mtm 16109 2023-10-24 03:34:00 1 1 1 mtm 16107 2023-10-26 20:53:35 1 1 1 port_client 16108 2023-10-29 16:18:27 1 1 1 port_client 14003 2023-10-29 16:37:47 1 1 1 sensor 15853 2023-10-29 16:39:21 1 1 1 mtm 16114 2023-10-29 16:39:47 - The impacted module will reboot and it may possibly enter a powered-dn status. `show system reset-reason module 1` Error code : 1075708042 Reset reason : mtm hap reset => [Failures < MAX] : powercycle Service name : System manager Time stamp : At 444154 usecs after Tue Oct 24 03:34:10 2023
- Affected linecard is N9K-X9716D-GX
none available
- Trigger comes from inside macsec chip seen in idle state, will see similar logs as below: 2023-12-16T23:27:55.147982000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5973)] [0x2] cause[0xa0020c] enable[0xa00210] wrtc[0x1] 2023-12-16T23:27:55.147970000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (6002)] CCTRL_LC2_PORTLIB_MI_MACSEC_PHY_INT ISR val 2023-12-16T23:27:55.147969000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5984)] [0x1] grp_num[0xfffe] grp_port[0xb] set_mask[0x0] 2023-12-16T23:27:55.147968000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5973)] [0x1] cause[0xb0020c] enable[0xb00210] wrtc[0x1] 2023-12-16T23:27:55.147961000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (6002)] CCTRL_LC2_PORTLIB_MI_MACSEC_PHY_INT ISR val 2023-12-16T23:27:55.147961000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5984)] [0x0] grp_num[0xfffe] grp_port[0xf] set_mask[0x0] 2023-12-16T23:27:55.147960000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5973)] [0x0] cause[0xf0020c] enable[0xf00210] wrtc[0x1] 2023-12-16T23:27:55.147959000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5966)] PHY ISR intr_info->num_intr = 3 2023-12-16T23:27:55.146085000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (6002)] CCTRL_LC2_PORTLIB_MI_MACSEC_PHY_INT ISR val 2023-12-16T23:27:55.146084000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5984)] [0x2] grp_num[0xfffe] grp_port[0xa] set_mask[0x0] 2023-12-16T23:27:55.146084000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5973)] [0x2] cause[0xa0020c] enable[0xa00210] wrtc[0x1] 2023-12-16T23:27:55.146071000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (6002)] CCTRL_LC2_PORTLIB_MI_MACSEC_PHY_INT ISR val 2023-12-16T23:27:55.146071000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5984)] [0x1] grp_num[0xfffe] grp_port[0xb] set_mask[0x0] 2023-12-16T23:27:55.146070000+01:00 [M 1] [tahusd] E_STRING [15865] [tahusd_mts_cctrl_isr_evt_handler (5973)] [0x1] cause[0xb0020c] enable[0xb00210] wrtc[0x1]