Symptoms

Several ports on one module DS-X9448-768K9 are stuck in HWfailure state with error-id 0xcce03600 although the module is up & working normal as shown below:show logging log%MODULE-2-MOD_SOMEPORTS_FAILED: Module 3 reported failure on ports fc3/25-32 (Fibre Channel) due to (null) in device DEV_F16_FWD (device error 0xcce03600)Accounting log:type=update:id=vsh.9838:user=svc-isan:cmd=exceptionlog module 3 syserr 0x42ba0025 devid 206 errtype 2 errcode 3437245952 phylayer 1 ports 25-32 harderror 1 desc F16_FWD_IFIB_PIORD_MSB_ECC_ERR (SUCCESS)`show module`Mod Ports Module-Type Model Status--- ----- ----------------------------------- ------------------ ----------3 48 2/4/8/10/16 Gbps Advanced FC Module DS-X9448-768K9 okexception information --- exception instance 2 ----Module Slot Number: 3Device Id : 0Device Name : undefDevice Errorcode : 0xc0000300Device ID : 00 (0x00)Device Instance : 00 (0x00)Dev Type (HW/SW) : 03 (0x03)ErrNum (devInfo) : 00 (0x00)System Errorcode : 0x41830041 Loopback test failed. Unable to analyze the reason for failureError Type : WarningPhyPortLayer : Fibre ChannelPort(s) Affected : fc3/25-32Error Description : Test:IntPortLoopback failed threshold consecutive times.DSAP : 0 (0x0)UUID : 0 (0x0) (Ticks: 5700947D jiffies) exception information --- exception instance 3 ----Module Slot Number: 3Device Id : 206Device Name : F16 Fwd DriverDevice Errorcode : 0xcce03600Device ID : 206 (0xce)Device Instance : 03 (0x03)Dev Type (HW/SW) : 06 (0x06)ErrNum (devInfo) : 00 (0x00)System Errorcode : 0x42ba0025 fatal errorError Type : Minor errorPhyPortLayer : Fibre ChannelPort(s) Affected : fc3/25-32Error Description : F16_FWD_EACL_REG_PAR_ERRDSAP : 0 (0x0)UUID : 0 (0x0) (Ticks: 5700890E jiffies) # sh system error-id 0xcce03600Error Description: Device Name:[F16 Fwd Driver] Instance:[3] Error Type:[interrupt error] code:[0] 

Cause

This is due to Cisco bug CSCut60399, This is a hardware error on the linecard port asic. The error code does not indicate this is a double-bit ECC error.

Resolution

Work Around:1-Double-bit ECC hardware error on 8-port asic. 2-Reload the card to attempt port recovery. 3-If this does not work, replace the affect module.The bug is not yet fixed by Cisco therefore there is no fixed OS for it.

Support Cases