Loading...
Loading...
HPE NVIDIA ConnectX-6-based network adapters (and newer generations) experience a network Preboot execution environment (PXE) Boot Failure when the Maximum Transmission Unit (MTU) is set to a non-default value, due to IP Fragmentation.This issue is observed with the network adapter firmware version xx.42.1010 (or later). When the IP packet fragmentation occurs with non-default Maximum Transmission Unit (MTU), the original packet is divided into two fragments. One fragment retains the protocol headers, including the User Datagram Protocol (UDP) and Trivial File Transfer Protocol (TFTP) headers, while the other only contains the payload data.With firmware version xx.42.1010, a new feature "PXE boot filter" has been added to apply filters to drop all packets except for "User Datagram Protocol (UDP)/ Transmission Control Protocol (TCP)/Internet Control Message Protocol (ICMP)" packets that are needed for boot. The fragment containing only the payload data is discarded by the PXE Filter because it lacks the necessary destination User Datagram Protocol (UDP) port information in its header.Note:The list of affected HPE NVIDIA-based network adapters includes Connectx-6, ConnectX-6 LX, ConnectX6-Dx ,Connectx-7 and DPU ( Data processing unit).
Any HPE platform configured with any of the following HPE NVIDIA ConnectX-6-based network adapters (and newer generations):HPE Data Processing Unit InfiniBand NDR200/Ethernet 200Gb 2-port QSFP112 FHHL B3220 Adapter (P66386-H21/ P66103-B21)HPE Data Processing Unit InfiniBand NDR/Ethernet 400Gb 1-port QSFP112 HHHL B3140H Adapter (P66583-B21/ P66387-H21)HPE InfiniBand NDR/Ethernet 400Gb 1-port OSFP PCIe5x16 MCX75310AAS-NEAT Adapter (P45641-B23/ P45641-H23)HPE InfiniBand NDR200/Ethernet 200Gb 1-port OSFP PCIe5 x16 MCX75310AAS-HEAT Adapter (P45642-B22/ P45642-H22)HPE InfiniBand NDR200/Ethernet 200GbE 2-port QSFP112 PCIe5 x16 MCX755106AC-HEAT Adapter (P65333-B21/ P65333-H21)HPE InfiniBand NDR 1-port OSFP PCIe5 x16 MCX75310AAS-NEAT Adapter (P45641-B21/ P45641-H21)HPE InfiniBand NDR200 1-port OSFP PCIe5 x16 MCX75310AAS-HEAT Adapter (P45642-B21/ P45642-H21)HPE InfiniBand HDR/Ethernet 200Gb 2-port QSFP56 PCIe4 x16 OCP3 MCX653436A-HDAI Adapter (P31348-B21 / P31348-H21)HPE InfiniBand HDR/Ethernet 200Gb 1-port QSFP56 PCIe4 x16 OCP3 MCX653435A-HDAI Adapter (P31323-B21 / P31323-H21)HPE InfiniBand HDR/Ethernet 200Gb 2-port QSFP56 PCIe4 x16 MCX653106A-HDAT Adapter (P31324-B21 / P31324-H21)HPE Apollo 9000 InfiniBand HDR 200Gb 2-port 940z FIO Mezzanine Adapter (R1E59A)HPE InfiniBand HDR/Ethernet 200Gb 1-port QSFP56 PCIe4 x16 MCX653105A-HDAT Adapter (P23664-B21 / P23664-H21)HPE InfiniBand HDR/Ethernet 200Gb 1-port QSFP56 PCIe3 x16 MCX653105A-HDAT Adapter (P06154-B21 / P06154-H21)HPE InfiniBand HDR100/Ethernet 100Gb 2-port QSFP56 PCIe4 x16 MCX653106A-ECAT Adapter (P23666-B21 / P23666-H21)HPE InfiniBand HDR100/Ethernet 100Gb 1-port QSFP56 PCIe4 x16 MCX653105A-ECAT Adapter (P23665-B21 / P23665-H21)HPE InfiniBand HDR100/Ethernet 100Gb 2-port QSFP56 PCIe3 x16 MCX653106A-ECAT Adapter (P06251-B21 / P06251-H21)HPE InfiniBand HDR100/Ethernet 100Gb 1-port 940QSFP56 x16 Adapter (P06250-B21/ P06250-H21)Mellanox MCX631102AS-ADAT Ethernet 10/25Gb 2-port SFP28 Adapter for HPE (P42044-B21)Mellanox MCX631432AS-ADAI Ethernet 10/25Gb 2-port SFP28 OCP3 Adapter for HPE (P42041-B21)HPE Ethernet 100Gb 2-Port QSFP56 MCX623106AS-CDAT Adapter (P25960-B21)Mellanox MCX623105AS-VDAT Ethernet 200Gb 1-port QSFP56 Adapter for HPE (P10180-B21)Firmware versions affected:xx.42.1000 (or later).BFB versions affected for Bluefield3 DPU network adapters:BlueField Firmware Bundle (BFB) version 2.8.0 (or later).Note:The list of affected HPE NVIDIA-based network adapters includes Connectx-6, ConnectX-6 LX, ConnectX6-Dx ,Connectx-7 and DPU ( Data processing unit).
The issue will be resolved with a future firmware / BlueField Firmware Bundle (BFB) release.As a workaround to avoid this issue, implementing either of the following procedures:Procedure 1:Disable the "PXE Boot Filters" under Device Level Configuration on the PXE Client. The setting applies filters to drop all packets except for "User Datagram Protocol (UDP)/ Transmission Control Protocol (TCP)/Internet Control Message Protocol (ICMP)" packets that are needed for boot.When the PXE Boot filter is disabled, it allows all packets without restrictions. This can help the PXE process successfully complete even if the network configuration has been altered (like changing the MTU).Perform the following the steps to disable PXE Boot Filter Option on the PXE Client:Press F9 during Power-On-Self-Test (POST) to enter System Configuration.Select the desired HPE Network adapter in the System Configuration Page.Go to Device Level Configuration, and change "Disabled" to "PXE Boot Filters".Reboot the server.ORProcedure 2:Decreasing the Trivial File Transfer Protocol (TFTP) block size on the PXE Server. The TFTP block size is used to determine the size of the data chunks or "blocks" that are transferred during a TFTPfile transfer.When the Maximum Transmission Unit (MTU) is configured to a non-default value, the TFTP block size must be reduced accordingly to prevent fragmentation. The TFTP block size is calculated as follows:TFTP block size = MTU value - 32Example:This example was captured on a system running RedHat Linux Enterprise 9 Update 5, with an MTU of 1425. The TFTP block size is configured to 1393 that represents "1425 (MTU) - 32 (Header)=1393".·Edit /etc/systemd/system/tftp-server.service service and set these values.# vim /etc/systemd/system/tftp-server.service[Unit]Description=Tftp ServerRequires=tftp.socketDocumentation=man:in.tftpd[Service]ExecStart=/usr/sbin/in.tftpd --blocksize 1393 -c -p -s /var/lib/tftpbootStandardInput=socket[Install]WantedBy=multi-user.targetAlso=tftp-server.socket·Reload the systemd manager configuration and restart the tftp services. #systemctl daemon-reload#systemctl restart tftp-server# systemctl status tftp-server● tftp-server.service - Tftp ServerLoaded: loaded (/etc/systemd/system/tftp-server.service;enabled; vendor preset: disabled)Active: active (running) since Fri 2018-06-22 07:43:14 EDT; 10s agoDocs: man:in.tftpdMain PID: 13215 (in.tftpd)Tasks: 1 (limit: 2472600)Memory: 324.0KCGroup: /system.slice/tftp-server.service└─13215 /usr/sbin/in.tftpd --blocksize 1393-c -p -s /var/lib/tftpbootJun 22 07:43:14 xd225-rhel84-33 systemd[1]: Started Tftp Server.This advisory will be updated when a future firmware / BlueField Firmware Bundle (BFB) release resolves this issue and becomes available.
Operating Systems Affected:Not Applicable
Click on a version to see all relevant bugs
Hewlett Packard Enterprise Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.