Symptoms

Several ports on one module DS-X9448-768K9 are stuck in HWfailure state with error-id 0xcce03600 although the module is up & working normal as shown below: show logging log %MODULE-2-MOD_SOMEPORTS_FAILED: Module 3 reported failure on ports fc3/25-32 (Fibre Channel) due to (null) in device DEV_F16_FWD (device error 0xcce03600) Accounting log :type=update:id=vsh.9838:user=svc-isan:cmd=exceptionlog module 3 syserr 0x42ba0025 devid 206 errtype 2 errcode 3437245952 phylayer 1 ports 25-32 harderror 1 desc F16_FWD_IFIB_PIORD_MSB_ECC_ERR (SUCCESS) `show module` Mod Ports Module-Type Model Status --- ----- ----------------------------------- ------------------ ---------- 3 48 2/4/8/10/16 Gbps Advanced FC Module DS-X9448-768K9 ok exception information --- exception instance 2 ---- Module Slot Number: 3 Device Id : 0 Device Name : undef Device Errorcode : 0xc0000300 Device ID : 00 (0x00) Device Instance : 00 (0x00) Dev Type (HW/SW) : 03 (0x03) ErrNum (devInfo) : 00 (0x00) System Errorcode : 0x41830041 Loopback test failed. Unable to analyze the reason for failure Error Type : Warning PhyPortLayer : Fibre Channel Port(s) Affected : fc3/25-32 Error Description : Test:IntPortLoopback failed threshold consecutive times. DSAP : 0 (0x0) UUID : 0 (0x0) (Ticks: 5700947D jiffies) exception information --- exception instance 3 ---- Module Slot Number: 3 Device Id : 206 Device Name : F16 Fwd Driver Device Errorcode : 0xcce03600 Device ID : 206 (0xce) Device Instance : 03 (0x03) Dev Type (HW/SW) : 06 (0x06) ErrNum (devInfo) : 00 (0x00) System Errorcode : 0x42ba0025 fatal error Error Type : Minor error PhyPortLayer : Fibre Channel Port(s) Affected : fc3/25-32 Error Description : F16_FWD_EACL_REG_PAR_ERR DSAP : 0 (0x0) UUID : 0 (0x0) (Ticks: 5700890E jiffies) # sh system error-id 0xcce03600 Error Description: Device Name:[F16 Fwd Driver] Instance:[3] Error Type:[interrupt error] code:[0]

Cause

This is due to Cisco bug CSCut60399, This is a hardware error on the linecard port asic. The error code does not indicate this is a double-bit ECC error.

Resolution

Work Around:1-Double-bit ECC hardware error on 8-port asic. 2-Reload the card to attempt port recovery. 3-If this does not work, replace the affect module.The bug is not yet fixed by Cisco therefore there is no fixed OS for it.

Support Cases