Launching soon: The world's first vendor agnostic bug scrubLearn more & join waitlist
OPERATIONAL DEFECT DATABASE
...
...
-USB no longer recognized after upgrade -Unable to format USB in NXoS with formatting errors -Switch is reloaded then goes into loader prompt -Unable to run dir or dir bootflash: "Unrecognized cmd" error -USB is physically plugged into while upgrading image
-USB must be left plugged into to either slot 1 or 2 -Upgrade is done from local bootflash while USB is plugged in
-Transfer the images from TFTP server and upgrade device without USB plugged into USB port -Do not try and format the USB if the switch does not recognize the USB when it is plugged in The issue at hand here is that when you try and format a USB stick that is plugged in when the switch isn't recognizing it with dir usb: the switch will attempt to format it and then once reloaded it will no longer boot to NXOS and bring you to a loader> prompt.
-Issue was reproduced twice in the customer's environment after first RMA device bricked and unable to recover, the second and third device was done with Cisco TAC on the call for live observasation and customer hit the same error. Steps done on the customers environment. 1. 3k shipped with image 5.0(3)U5(1g) 2. Image 6.0(2)U6(9) transfered from USB drive to bootflash of 3k 3. Checksum and show install all impact completes successfully without any errors. 4. USB left plugged into the device although the images have already been copied over to the bootflash and the upgrade is done from the local bootflash. 4. Upgrade completes and device reboots successfully without errors. 5. Able to navigate, make configuration changes, and boot variables show the new image. 6. While in NXoS, if you try to run dir usbX where USB is physically plugged in, the device is no longer recognized but is again recognized if you downgrade. 7. Once the switch is reloaded, the device no longer boots the kick start image and goes into loader prompt. 8. In the loader prompt, unable to run cmd "dir bootflash:///" or not able to boot kickstart locally 9. Able to configure IP address, mask, gw 10. Unable to boot from TFTP or any remote server It was then found that the customer was not following the upgrade guide and must upgrade to a minimum of 6.0(2)U6(2a) before upgrade to a higher version such as the running version 6.0(2)U6(9). The same steps were followed but now included upgrading to 6.0(2)U6(2a) first. The issue happened again on this image before we could get to the customer version 6.0(2)U6(9). Steps done to reproduce in the lab: 1. C3064 setup with matching shipped image 5.0(3)U5(1g). Image was transfered via TFTP to bootflash. 2. Transfered images 6.0(2)U6(2a) & 6.0(2)U6(9) via TFTP to bootflash. 3. Upgraded to 6.0(2)U6(2a) first but same error where USB is no longer recognized. Also verified boot variables. 4. Rebooted and switch came up without any errors. 5. Upgraded to the customer image version 6.0(2)U6(9) & rebooted twice but with same USB not recognized error. 6. Downgraded to 6.0(2)U6(2a), then back to 5.0(3)U5(1g), then upgraded using the same steps again. 7. Downgraded back again to 6.0(2)U6(2a), then back to 5.0(3)U5(1g). 8. This time plugged in a USB to slot 1 usb1. 9. Upgraded 6.0(2)U6(2a) successfully, then reloaded again, switch became corrupt and unrecoverable. -Issue appears to be with the usb plugged into the device when performing an upgrade. 513E.D.05-N3K-3000-1# install all kickstart bootflash:///n3000-uk9-kickstart.6.0.2.U6.2a.bin system bootflash?h:///n3000-uk9.6.0.2.U6.2a.bin n3000-uk9.6.0.2.U6.2a.bin??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J??[J Installer is forced disruptive Verifying image bootflash:/n3000-uk9-kickstart.6.0.2.U6.2a.bin for boot variable "kickstart". [# ] 0%???????????????????????????[####################] 100% -- SUCCESS Verifying image bootflash:/n3000-uk9.6.0.2.U6.2a.bin for boot variable "system". [# ] 0%???????????????????????????[####################] 100% -- SUCCESS Extracting "system" version from image bootflash:/n3000-uk9.6.0.2.U6.2a.bin. [# ] 0%???????????????????????????[####################] 100% -- SUCCESS Extracting "kickstart" version from image bootflash:/n3000-uk9-kickstart.6.0.2.U6.2a.bin. [# ] 0%???????????????????????????[####################] 100% -- SUCCESS Extracting "bios" version from image bootflash:/n3000-uk9.6.0.2.U6.2a.bin. [# ] 0%???????????????????????????[####################] 100% -- SUCCESS Performing module support checks. [####################] 100% -- SUCCESS Notifying services about system upgrade. [####################] 100% -- SUCCESS Compatibility check is done: Module bootable Impact Install-type Reason ------ -------- -------------- ------------ ------ 1 yes disruptive reset ISSU not supported Images will be upgraded according to following table: Module Image Running-Version New-Version Upg-Required ------ ---------- ---------------------- ---------------------- ------------ 1 system 5.0(3)U5(1g) 6.0(2)U6(2a) yes 1 kickstart 5.0(3)U5(1g) 6.0(2)U6(2a) yes 1 bios v2.8.0(12/22/2015) v2.6.0(08/06/2014) no 1 SFP-uC v2.12 v2.12 no 1 power-seq v1.0 v1.0 no ISSU is not supported on this platform!! Switch will be reloaded for disruptive upgrade. Do you want to continue with the installation (y/n)? [n] y Install is in progress, please wait. Performing runtime checks. [####################] 100% -- SUCCESS Setting boot variables. [# ] 0%???????????????????????????[####################] 100% -- SUCCESS Finishing the upgrade, switch will reboot in 10 seconds. 513E.D.05-N3K-3000-1# login as: admin Nexus 3000 Switch Using keyboard-interactive authentication. Password: Cisco Nexus Operating System (NX-OS) Software TAC support: http://www.cisco.com/tac Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved. The copyrights to certain works contained in this software are owned by other third parties and used and distributed under license. Certain components of this software are licensed under the GNU General Public License (GPL) version 2.0 or the GNU Lesser General Public License (LGPL) Version 2.1. A copy of each such license is available at http://www.opensource.org/licenses/gpl-2.0.php and http://www.opensource.org/licenses/lgpl-2.1.php 513E.D.05-N3K-3000-1# sh ver Cisco Nexus Operating System (NX-OS) Software TAC support: http://www.cisco.com/tac Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_series_home.html Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved. The copyrights to certain works contained herein are owned by other third parties and are used and distributed under license. Some parts of this software are covered under the GNU Public License. A copy of the license is available at http://www.gnu.org/licenses/gpl.html. Software BIOS: version 2.8.0 loader: version N/A kickstart: version 6.0(2)U6(2a) system: version 6.0(2)U6(2a) Power Sequencer Firmware: Module 1: version v1.0 SFP uC: version 2.12 BIOS compile time: 12/22/2015 kickstart image file is: bootflash:///n3000-uk9-kickstart.6.0.2.U6.2a.bin kickstart compile time: 2/14/2016 4:00:00 [02/14/2016 12:57:46] system image file is: bootflash:///n3000-uk9.6.0.2.U6.2a.bin system compile time: 2/14/2016 4:00:00 [02/14/2016 13:23:29] Hardware cisco Nexus 3064 Chassis ("48x10GE + 4x40G Supervisor") Intel(R) Celeron(R) CPU P450 with 3665240 kB of memory. Processor Board ID FOC17153YTQ Device name: 513E.D.05-N3K-3000-1 bootflash: 7733248 kB Kernel uptime is 0 day(s), 0 hour(s), 5 minute(s), 52 second(s) Last reset at 223372 usecs after Fri May 7 20:36:49 2010 Reason: Disruptive upgrade System version: 5.0(3)U5(1g) 513E.D.05-N3K-3000-1# dir usb1: usb is either not present or not formatted 513E.D.05-N3K-3000-1# dir usb2:/// usb is either not present or not formatted 13E.D.05-N3K-3000-1# reload non-interruptive power-cycle ?[J 513E.D.05-N3K-3000-1# reload WARNING: This command will reboot the system Do you want to continue? (y/n) [n] y 513E.D.05-N3K-3000-1# sh ver Cisco Nexus Operating System (NX-OS) Software TAC support: http://www.cisco.com/tac Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_series_home.html Copyright (c) 2002-2017, Cisco Systems, Inc. All rights reserved. The copyrights to certain works contained herein are owned by other third parties and are used and distributed under license. Some parts of this software are covered under the GNU Public License. A copy of the license is available at http://www.gnu.org/licenses/gpl.html. Software BIOS: version 2.8.0 loader: version N/A kickstart: version 6.0(2)U6(9) system: version 6.0(2)U6(9) Power Sequencer Firmware: Module 1: version v1.0 SFP uC: version 2.12 BIOS compile time: 12/22/2015 kickstart image file is: bootflash:///n3000-uk9-kickstart.6.0.2.U6.9.bin kickstart compile time: 1/7/2017 1:00:00 [01/07/2017 10:01:22] system image file is: bootflash:///n3000-uk9.6.0.2.U6.9.bin system compile time: 1/7/2017 1:00:00 [01/07/2017 10:36:30] Hardware cisco Nexus 3064 Chassis ("48x10GE + 4x40G Supervisor") Intel(R) Celeron(R) CPU P4505 @ 1.87GHz with 3665240 kB of memory. Processor Board ID FOC17153YTQ Device name: 513E.D.05-N3K-3000-1 bootflash: 7733248 kB Kernel uptime is 0 day(s), 0 hour(s), 8 minute(s), 11 second(s) Last reset at 440887 usecs after Fri May 7 21:12:15 2010 Reason: Reset Requested by CLI command reload System version: 6.0(2)U6(9) Service: plugin Core Plugin, Ethernet Plugin 513E.D.05-N3K-3000-1# dir usb1 No such file or directory 513E.D.05-N3K-3000-1# dir bootflash:/// 4096 Jan 29 20:52:08 2010 .patch/ 4096 Jan 29 21:17:34 2010 .rpmstore/ 3108 Apr 30 20:25:50 2010 20100430_202251_poap_3827_init.log 8832 Apr 30 20:34:15 2010 ds 4096 Jan 30 02:10:15 2010 logflash/ 4096 May 07 21:02:31 2010 lost+found/ 650 May 07 20:06:29 2010 mts.log 25821696 Apr 30 20:38:29 2010 n3000-uk9-kickstart.5.0.3.U5.1g.bin 37734400 Sep 14 10:11:29 2017 n3000-uk9-kickstart.6.0.2.U5.1.bin 37853184 May 01 18:47:07 2010 n3000-uk9-kickstart.6.0.2.U6.2a.bin 37885952 May 01 18:47:21 2010 n3000-uk9-kickstart.6.0.2.U6.9.bin 136734337 Apr 30 20:39:27 2010 n3000-uk9.5.0.3.U5.1g.bin 189984434 Sep 14 10:11:47 2017 n3000-uk9.6.0.2.U5.1.bin 206765681 May 01 18:45:32 2010 n3000-uk9.6.0.2.U6.2a.bin 206093253 May 01 18:46:20 2010 n3000-uk9.6.0.2.U6.9.bin 0 May 01 22:28:23 2010 platform-sdk.cmd 1024 May 01 19:34:35 2010 sprom_cstruct_2_0_0 1024 May 01 19:35:08 2010 sprom_cstruct_3_0_0 4096 Jan 29 15:33:23 2010 vdc_2/ 4096 Jan 29 15:33:23 2010 vdc_3/ 4096 Jan 29 15:33:23 2010 vdc_4/ 4096 Apr 30 20:49:36 2010 virt_strg_pool_bf/ 4096 Jan 29 15:33:27 2010 virtual-instance/ Usage for bootflash://sup-local 975659008 bytes used 877457408 bytes free 1853116416 bytes total Lab C3064 <<<<<<<<<<<<<<< switch(boot)# init system check-filesystem This command is going to erase your startup-config, licenses as well as the contents of your bootflash:. Do you want to continue? (y/n) [n] y DBG: 255 heads, 48 sectors/track Initializing the system mke2fs 1.35 (28-Feb-2004) Testing with pattern 0xaa: done Reading and comparing: done Testing with pattern 0x55: done Reading and comparing: done Testing with pattern 0xff: done Reading and comparing: done Testing with pattern 0x00: done Reading and comparing: done Initializing startup-config and licenses mke2fs 1.35 (28-Feb-2004) mke2fs: No such device or address while trying to determine filesystem size switch(boot)# dir bootflash: Usage for bootflash: filesystem 105041920 bytes used 314388480 bytes free 419430400 bytes total switch(boot)# dir slot0: Usage for slot0: filesystem 105041920 bytes used 314388480 bytes free 419430400 bytes total switch(boot)# format bootflash: check-filesystem This command is going to erase the contents of your bootflash:. Do you want to continue? (y/n) [n] y Formatting bootflash: Formatting started at: Sat May 8 16:33:59 UTC 2010 mke2fs 1.35 (28-Feb-2004) mke2fs: No such device or address while trying to determine filesystem size Formatting finished at: Sat May 8 16:33:59 UTC 2010 mount: /dev/sdb3 is not a valid block device Formatting complete