Symptom
- Cisco Nexus 93180LC-EX crashes due to tahusd process during disruptive upgrade from Cisco NX-OS Release 7.0(3)I7(1) to Cisco NX-OS Release 7.0(3)I7(6).- Switch is stuck in a boot loop after upgrading to Cisco NX-OS Release 7.0(3)I7(6).
N93180LC# show logging log
2019 Sep 18 15:43:03.829 N93180LC %$ VDC-1 %$ %SYSMGR-SLOT1-2-SERVICE_CRASHED: Service "tahusd" (PID 29867) hasn't caught signal 6 (core will be saved).
2019 Sep 18 15:43:07.853 N93180LC %$ VDC-1 %$ %SYSMGR-SLOT1-2-HAP_FAILURE_SUP_RESET: Service "tahusd" in vdc 1 has had a hap failure
2019 Sep 18 15:43:07.858 N93180LC %$ VDC-1 %$ %SYSMGR-SLOT1-2-LAST_CORE_BASIC_TRACE: fsm_action_become_offline: PID 17381 with message Could not turn off console logging on vdc 1 error: mts req-response with syslogd in vdc 1 failed (0xFFFFFFFF) .
2019 Sep 18 15:43:34 N93180LC%$ VDC-1 %$ %KERN-2-SYSTEM_MSG: [ 153.064469] usd process 29867, uuid 1356 (0x54c) failed to send heartbeat - kernel
- If this error is seen please do not reload the switch as the core log will be removed (please copy the core for TAC analysis before reloading/powering the switch):
N93180LC# show cores
VDC Module Instance Process-name PID Date(Year-Month-Day Time)
--- ------ -------- --------------- -------- -------------------------
1 1 1 tahusd 29849 2019-09-18 15:41:44
N93180LC# copy core://1/29849/1 bootflash:
Conditions
This issue is only on the N9K-C93180LC-EX switch with hardware profile portmode 6x100G+24x40G configuration
Workaround
Disable bootup diagnostic tests globally before the upgrade and re-enable it after upgrade. That should allow you to move forward with the upgrade.
The command to disable bootup tests from config mode is :
switch(config)# diagnostic bootup level bypass
Then re-enable complete diagnostics after upgrade :
Disable bootup diagnostic tests globally before the upgrade and re-enable it after upgrade. That should be good workaround to move forward with the upgrade.
The command to disable bootup tests from config mode is :
switch(config)# diagnostic bootup level complete
Further Problem Description
