BugZero | Cisco BugID CSCvw12640 - Headless SDR and default-sdr core seen after reloa...

Cisco - Defect ID: CSCvw12640

Headless SDR and default-sdr core seen after reload trigger

Cisco - Defect ID: CSCvw12640

Headless SDR and default-sdr core seen after reload trigger

Last updated on February 27th, 2024

BugZero Risk Score
7.8 High

Overall: 7.8

Severity: 8.2

Lifecycle: 9.1

Popularity: 4.6

What is the BugZero Risk Score?

Cisco Integration

Learn more about where this data comes from

Cisco Integration

Learn more

Bug Scrub Advisor

Streamline upgrades with automated vendor bug scrubs

Bug Scrub Advisor

Learn more

BugZero Enterprise

Wish you caught this bug sooner? Get proactive today.

BugZero Enterprise

Learn more

Bug Details

Views: 49

Description

Symptom

On a s/w SDR reload, the old active node takes too long to go down, resulting in HEADLESS_SDR warning logs and core dumps.

Conditions

Exact scenario may vary, but a software reload with >100 interfaces in Linux - which includes those in the default vrf unless TPA is disabled for the default VRF - is likely to hit this issue.

Workaround

If TPA is not required (e.g. if ZTP or gRPC telemetry are not used), TPA can be disabled for the default VRF using "tpa vrf default disable". If TPA is required, and a software reload is needed, the kim process should be manually shutdown ("process shutdown kim") before the reload happens to avoid this issue being hit.

Further Problem Description

The issue is caused by the TPA Linux kernel module taking a long time to clean up while the VM/container is being shut down. For small numbers of interfaces the delay isn't significant, but if there are more than 100-ish interfaces, then the router may hit this issue. For accurate diagnosis, the kernel logs should be checked (e.g. kern.log from 'show tech os admin') for large numbers of logs such as: Oct 26 20:16:08 host kernel: [ 2832.169911] lcndklm_vrf: inf: Deleting netdevice: ifh Tg0_0_0_0/0x120 vrf default/0x60000000 (via lci)

Change history

2024-02-27 Added: 6.8.1, 6.8.2, 6.9.1, 6.9.2, 7.10.1, 7.2.2, 7.3.1, 7.3.15, 7.3.16, 7.3.2, 7.3.25, 7.3.26, 7.3.27, 7.3.3, 7.3.4, 7.3.5, 7.4.1, 7.4.15, 7.4.16, 7.4.2, 7.5.1, 7.5.12, 7.5.2, 7.5.3, 7.5.4, 7.5.5, 7.6.1, 7.6.15, 7.6.2, 7.6.3, 7.7.1, 7.7.2, 7.7.21, 7.8.1, 7.8.2, 7.8.22, 7.9.1, 7.9.2, 7.9.21

Links

Original Vendor Announcement

Relevant Products

Click on a version to see all relevant bugs

Affected versions:No known affected versions

Fixed versions: 6.8.1, 6.8.2, 6.9.1, 6.9.2, 7.10.1, 7.2.2, 7.3.1, 7.3.15, 7.3.16, 7.3.2, 7.3.25, 7.3.26, 7.3.27, 7.3.3, 7.3.4, 7.3.5, 7.4.1, 7.4.15, 7.4.16, 7.4.2, 7.5.1, 7.5.12, 7.5.2, 7.5.3, 7.5.4, 7.5.5, 7.6.1, 7.6.15, 7.6.2, 7.6.3, 7.7.1, 7.7.2, 7.7.21, 7.8.1, 7.8.2, 7.8.22, 7.9.1, 7.9.2, 7.9.21

Relevant Products

Click on a version to see all relevant bugs

Affected versions:No known affected versions

Top Cisco Defects

9.7Defect ID: CSCwq79831
Cisco Secure Firewall Adaptive Security Appliance Software and Secure Firewall Threat Defense Software VPN Web Server Remote Code Execution Vulnerability
9.7Defect ID: CSCvv15096
9200L: SYS-3-CPUHOG: Task is running for (2843)msecs, more than (2000)msecs process = SAUtilReport.
9.7Defect ID: CSCwd45843
Auth Step latency for policy evaluation due to Garbage Collection activity.
9.7Defect ID: CSCvm90995
ASR1000-RP2: Rommon fails to boot Cisco IOS software of 1GB size
9.7Defect ID: CSCwa70008
Expired certs cause Security Intelligence updates to fail

Ready to prevent the next vendor outage?

Get a demo

Cisco - Defect ID: CSCvw12640

Headless SDR and default-sdr core seen after reload trigger

Cisco - Defect ID: CSCvw12640

Headless SDR and default-sdr core seen after reload trigger

Last updated on February 27th, 2024

BugZero Risk Score7.8 High

Bug Details

Symptom

Conditions

Workaround

Further Problem Description

Links

Top Cisco Defects

Ready to prevent the next vendor outage?

BugZero Risk Score
7.8 High