...
On a multisite setup reload of VPC BGW peer can cause up to 20s of packet loss.
Traffic encapsulated from remote BGW with shared VIP of VPC BGW and RMAC of reloaded VPC peer will be dropped when it arrives to the Active VPC peer as the RMAC of the reloaded peer will get deleted in HW. Remote BGW sends encapsulated traffic to VPC BGW shared VIP with RMAC of local VPC peer that will be reloaded. This will cause up to 20s of traffic loss starting at the deletion of the RMAC on surviving VPC peer and until the RMAC is updated on the remote BGW. Remote_BGW# sh nve peers Interface Peer-IP State LearnType Uptime Router-Mac --------- -------------------------------------- ----- --------- -------- ----------------- nve1 10.1.1.100 Up CP 1w1d 0000.0000.aaaa <<<<<<< You can verify mac address of local VPC peer VPC_BGW_02# show nve interface nve 1 detail Interface: nve1, State: Up, encapsulation: VXLAN VPC Capability: VPC-VIP-Only [notified] Local Router MAC: 0000.0000.aaaa <<<<<<< Host Learning Mode: Control-Plane Source-Interface: loopback1 (primary: 10.1.1.1, secondary: 10.1.1.100) Source Interface State: Up Virtual RMAC Advertisement: No NVE Flags: Interface Handle: 0x49000001 Source Interface hold-down-time: 180 Source Interface hold-up-time: 30 Remaining hold-down time: 0 seconds Virtual Router MAC: 0200.0a00.aaaa Virtual Router MAC Re-origination: 0200.0a00.aaaa Interface state: nve-intf-add-complete Fabric convergence time: 225 seconds Fabric convergence time left: 0 seconds Multisite delay-restore time: 300 seconds Multisite delay-restore time left: 0 seconds Multisite dci-advertise-pip configured: False Multisite bgw-if: loopback123 (ip: 10.123.123.33, admin: Up, oper: Up) Multisite bgw-if oper down reason:
Some setups improve when advertse-pip advertise virtual-rmac is configured.
This does not affect -EX -FX N9ks. Enhancement was made for RMAC to stay in hardware to avoid traffic blackhole, GX devices are however deleting the mac still.
Cisco Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.