...
A Cisco Nexus 9000 Switch running NX-OS mode may report multiple link flaps on the ports connected to an HPE Synergy 10Gb Pass-Thru Module. Multiple link flaps may lead the switch port to enter into a "linkFlapErrDisabled" state, impacting Synergy compute modules' connectivity to data center networks. The following is a sample error message seen on the Cisco Nexus 9000 switch logs: 2019 May 20 05:15:47 switch %ETHPORT-5-IF_DOWN_ERROR_DISABLED:Interface Ethernet1/47 is down (Error disabled. Reason:Too many link flaps) Some of the common events that may cause the issue are the following: Reboot of the HPE Synergy compute module. Cable/transceiver connect/re-connect between Nexus 9000 and Synergy PTM. Execute ‘shut ; no shut’ command on Cisco Nexus 9000 switch. This occurs because the Cisco Nexus 9000 switch is very sensitive to L1 signals generated when the Synergy 10Gb Pass-Thru Module firmware is responding to the link status change. The switch port enters a loop of checking for signal detect, link up & resetting Tx. This causes continuous link toggle on PTM line-side (uplink port), with corresponding set of actions on the PTM host facing port (downlink port).
Any HPE Synergy configuration with the following products and firmware revisions: HPE Synergy 10Gb Pass-Thru Module with firmware revision 1.15. Cisco Nexus 9000 Switches with NX-OS versions: 7.0(3)I7(5a), 7.0(3)I6(2), 7.0(3)I7(6) and 9.2(3). Notes: This issue is seen with the latest Cisco software releases for the Nexus 9000 NX-OS mode. This is not experienced on Nexus 9000 ACI-Mode nor on the software released with other Cisco switches in this line. This issue is seen across HPE Network Adapters and transceivers/cables supported/compatible with "HPE Synergy 10Gb Pass-ThruModule". Refer to the Quick Spec for a list of compatible/supported options.
This issue has been resolved in firmware version 1.17 for the HPE Synergy 10Gb Pass-Thru Module, which has been successfully tested with Cisco Nexus 9000 and other supported switches. Supported HPE Synergy Recipes: HPE Synergy Custom SPP 2019.03.20190826 -Aug 2019 HPE Synergy Custom SPP 2019.03.20190825 -Aug 2019 To obtain the latest firmware release available for the for the HPE Synergy 10Gb Pass-Thru Module, visit the HPE Synergy Software Releases site. As a workaround if the issue is encountered before the firmware update is performed, Cisco suggests to set the Cisco Nexus 9000 Switch port interface DFE tuning delay value to 2000ms (default=100ms): switch(config-if)#dfe-tuning-delay 2000 switch(config-if)# Important: This prevents the "linkFlapErrDisabled" issue, but may significantly impact the server port link uptime (2+ seconds), hence HPE strongly recommends to apply the firmware update. RECEIVE PROACTIVE UPDATES : Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively via e-mail through HPE Subscriber's Choice. Sign up for Subscriber's Choice at the following URL: Proactive Updates Subscription Form. NAVIGATION TIP : For hints on navigating HPE.com to locate the latest drivers, patches, and other support software downloads for HPE systems and Options, refer to the Navigation Tips document . SEARCH TIP : For hints on locating similar documents on HPE.com, refer to the Search Tips Document .