Loading...
Loading...
During BCDLS initialization, when trying to establish the connection between BCDL server and BCDL producer, msg_chan_connect() may be failed. However, the BCDL server doesn't handle the possible failure properly. There was no BCDL trace/log to indicate the failure, and there is no error handling process either. This connection failure could cause the BCDL producer failed to send the information to the BCDL consumer. It causes inconsistency between the control plane and the data plane, and could causes traffic impact. For example, in SR 698859690, LSD didn't download ipv4 RWs to FIB due to this issue; as a result, there were unresolved routes in FIB. The system doesn't recover on its own.
The LWM API used to establish the connection between BCDL server and BCDL producer could return an error during BCDL initialization process.
There is no WA of this problem but below are recovery actions. Option #1: Use "process shutdown bcdls location XXX" to restart the BCDL server process (bcdls) Option #2: Use "process restart XXX location XXX" to restart the BCDL producer process (e.g. mpls_lsd, rib_mgr, etc.).
Below show command on the active RP can be used to monitor the connections between bcdlv2 servers and producers: RP/0/0/CPU0:ios#show bcdlv2 producer-view basic | inc bcdls_id Tue Aug 19 20:45:22.085 PDT bcdls bcdls_ipv4_rib, bcdls_id 2 bcdls bcdls_ipv4_lsd, bcdls_id 4 bcdls bcdls_ipv6_rib, bcdls_id 3 bcdls bcdls_ipv6_lsd, bcdls_id 5 bcdls bcdls_l2rib, bcdls_id 11 If any of the above 5 producers are missing, use the recovery methods described in the Workarounds section. To find the bcdlv2 server process: show processes bcdls | utility egrep -B5 e.g., the bcdlv2 server process for ipv6_rib: RP/0/0/CPU0:ios#show processes bcdls | utility egrep ipv6_rib -B5 Wed Aug 20 06:48:39.124 PDT Job Id: 144 --> process shut this JID to let the producer re-spawn the bcdlv2 server PID: 4015 Process name: bcdls Executable path: /pkg/bin/bcdls Instance #: 5 Args: name bcdls_ipv6_rib id 3 num_producer_tables 32768 max_num_consumers 257 ctrl_shm_name /dev/bcdl2/bcdls_ipv6_rib_ctrl_shm cbp_name /dev/bcdl2/bcdls_ipv6_rib_ctrl_cbp rcc 1 RP/0/0/CPU0:ios#
Cisco Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.