Symptoms
In the following examples, nodes 17, 18 and 19 are P100 nodes, the output would look the same for a B100 node.Running IOCA on the cluster or against a logset will display the following message:
Drive Support Package (1.43.2) WARN
WARN: 3 nodes have out of date drive firmware: 17-19
DETAILS: Model Current Desired Count Nodes
DETAILS: KIOXIA KPM6WRUG7T68 BD0D - 60 1-11,13-16
DETAILS: KIOXIA KPM6XRUG960G BA08 BA0D 6 17-19
INFO: For more information refer to KB article 000037967 found at https://www.dell.com/support/kbdoc/000037967.
You may also see that similar messages are reported in isi event output:
17.3 12/23 11:42 W 17 8013 The drive in location Bay 1 has unknown firmware version BA08. Please install the appropriate Drive Support Package and update firmware.
If you attempt to upgrade the drive firmware on the node, it fails and you will see the following message in /var/log/isi_drive_d.log on the node:
2022-12-28T10:31:49.977236-06:00 xxxxxxxxx-17(id17) isi_drive_d[5073]: /b/mnt/src/isilon/bin/isi_drive_d/fw_update.c:fw_update_allowed:330: can't update bay 0, usr_state BOOT_DRIVE
2022-12-28T10:31:49.977240-06:00 xxxxxxxxx-17(id17) isi_drive_d[5073]: /b/mnt/src/isilon/bin/isi_drive_d/fw_update.c:fw_update_allowed:330: can't update bay 1, usr_state BOOT_DRIVE
Cause
The P100 and B100 nodes currently have only two NVMe drives in them, used as the boot devices, that are mirrored. The Drive Support Package upgrade method is designed to perform online drive upgrades. A mirrored drive pair cannot be upgraded online.
Resolution
As of this time, you would want to ignore any messages related to drive firmware upgrade requests for the accelerator nodes. P100 and B100 nodes do not contain drives that retain user data and the boot drives are mainly idle. Options are being reviewed for how to handle this in the future.