Hi,
My OS is NW6.5 SP5. NCS:1.8.0. HBA:QLA2312,driver:6.90.4,firmware:3.03.08.
I encounted the problem "cluster:node castout fatal,san device alert". Then "n65nss5a.exe and "nw65os5a.exe" was installed. I also prolong the tolerance=slave watchdog=60 senconds. But the abend error still existed. Can any help me? Thanks in advance.
Abend Log File:(I post some of abend log here, more abend please see attachment)
Memory at ESP
8A27E53C 9CCFEF9E 8966A8A0-00000000 8A27E564 .Oo. .f( .... .'ed
8A27E54C 00000000 00000002-0A060004 9CF44A15 .... .... .... .tJ.
8A27E55C 9CCFEF9E 802C5D10-8A27E588 00000000 .Oo. .,]. .'e. ....
8A27E56C 00000002 0A060004-9CF44DE7 9CCFEF9E .... .... .tMg .Oo.
8A27E57C 00000001 00000002-00000002 8A27E5AC .... .... .... .'e,
8A27E58C 00000000 00000002-0A060004 9CF47F6B .... .... .... .t.k
8A27E59C 00000001 00000003-00000000 FE101CC4 .... .... .... ~..D
8A27E5AC 00000000 00000000-00000002 0A060004 .... .... .... ....
8A27E5BC 802C4144 0A060004-00000000 00000003 .,AD .... .... ....
8A27E5CC 00000002 8A2DBE00-00000002 00000000 .... .->. .... ....
8A27E5DC 00000002 802DF8F9-8A2DBE00 00000003 .... .-xy .->. ....
8A27E5EC 00000002 FFADDB40-0022063C 0022071F .... .-[@ .".< ."..
8A27E5FC 00000002 8A2932C0-FE101A84 FE101A80 .... .)2@ ~... ~...
8A27E60C 0022063C 0022071F-FE101A84 8A2DCC00 .".< .".. ~... .-L.
8A27E61C 00000000 00000002-8A297540 802C5A72 .... .... .)u@ .,Zr
8A27E62C FE101A80 802C59E1-00000000 00000002 ~... .,Ya .... ....

Stack Walk
Current EIP: 9CE5A0E3 CLSTRLIB.NLM|NWCLSTR_Abend+3F
Stack Contents
8A27E558 9CF44A15 VLL.NLM|VipNSShutdown+429
8A27E55C 9CCFEF9E 53554C43 3A524554 646F4E20 61632065 CLUSTER: Node ca
8A27E574 9CF44DE7 VLL.NLM|VllProviderPostEvent+C3
8A27E578 9CCFEF9E 53554C43 3A524554 646F4E20 61632065 CLUSTER: Node ca
8A27E598 9CF47F6B SBD.NLM|SBD.NLM (Code)+1F6B
8A27E59C 00000001
8A27E5A0 00000003
8A27E5A4 00000000
8A27E5BC 802C4144 MM.NLM|MM_CallApplicationAlert+94
8A27E5C0 0A060004 00070001 A4CE0B62 00000005 7F8E1296 ....b.N$........
8A27E5C4 00000000
8A27E5C8 00000003
8A27E5CC 00000002
8A27E5E0 802DF8F9 MM.NLM|PartitionAlertRoutine+185
8A27E5E4 8A2DBE00 8A2977E0 8A2DC180 2F00002E 0000002E `w)..A-..../....
8A27E5E8 00000003
8A27E5EC 00000002
8A27E808 802D4746 MM.NLM|DeactivateIOObject+A6
8A27E80C 8A2DBE00 8A2977E0 8A2DC180 2F00002E 0000002E `w)..A-..../....
8A27E810 8A297540 8A2D9AA0 8973D640 2C00002B 0000002B .-.@Vs.+..,+...
8A27E814 00000003
8A27E818 00000002
8A27E830 802D3FAA MM.NLM|GenericIOObjectClassControl+106
8A27E834 8A2DBE00 8A2977E0 8A2DC180 2F00002E 0000002E `w)..A-..../....
8A27E838 00000002
8A27E848 802C4498 MM.NLM|MM_DeactivateObject+68
8A27E84C 00000002
8A27E850 8A2DBE00 8A2977E0 8A2DC180 2F00002E 0000002E `w)..A-..../....
8A27E854 00000002
8A27E858 00000000
8A27E85C 00000000
8A27E860 00000000
8A27E870 802D421E MM.NLM|UnregisterIOObject+16
8A27E874 2F00002E 30430000 34353130 00003439 00000000 ..C0015494......
8A27E878 00000002
8A27E88C 802D3F46 MM.NLM|GenericIOObjectClassControl+A2
8A27E890 8A2DBE00 8A2977E0 8A2DC180 2F00002E 0000002E `w)..A-..../....
8A27E894 00000002
8A27E8A4 802C5CB2 MM.NLM|MM_UnregisterObject+E6
8A27E8A8 00FF0002 00000000 01010000 00000103 21E00000 ..............`!
8A27E8AC 8A2DBE00 8A2977E0 8A2DC180 2F00002E 0000002E `w)..A-..../....
8A27E8B0 00000002
8A27E8B4 00000000
8A27E8B8 00000000
8A27E8BC 00000000
8A27E8D4 802DFC68 MM.NLM|PartitionAlertRoutine+4F4
8A27E8D8 2F00002E 30430000 34353130 00003439 00000000 ..C0015494......
8A27E8DC 00000002
8A27EAF8 802D7AB2 MM.NLM|MediaAlertRoutine+19A
8A27EAFC 8A2DA8A0 8A1FC3A0 00000000 FFFFFFFF 00000019 C..............
8A27EB00 8A297540 8A2D9AA0 8973D640 2C00002B 0000002B .-.@Vs.+..,+...
8A27EB04 00000007
8A27EB08 00000002
8A27EB20 802D4746 MM.NLM|DeactivateIOObject+A6
8A27EB24 8A297540 8A2D9AA0 8973D640 2C00002B 0000002B .-.@Vs.+..,+...
8A27EB28 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27EB2C 00000003
8A27EB30 00000002
8A27EB48 802D3FAA MM.NLM|GenericIOObjectClassControl+106
8A27EB4C 8A297540 8A2D9AA0 8973D640 2C00002B 0000002B .-.@Vs.+..,+...
8A27EB50 00000002
8A27EB60 802C4498 MM.NLM|MM_DeactivateObject+68
8A27EB64 00000002
8A27EB68 8A297540 8A2D9AA0 8973D640 2C00002B 0000002B .-.@Vs.+..,+...
8A27EB6C 00000002
8A27EB70 00000000
8A27EB74 00000000
8A27EB78 00000000
8A27EB88 802D7BF8 MM.NLM|MediaAlertRoutine+2E0
8A27EB8C 2C00002B ED99004C D93BA406 54CDC66E 33B356DD L..m.$;YnFMT]V33
8A27EB90 00000002
8A27EBA8 802F8C82 MM.NLM|FailoverAlertRoutine+366
8A27EBAC 8A297540 8A2D9AA0 8973D640 2C00002B 0000002B .-.@Vs.+..,+...
8A27EBB0 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27EBB4 00000007
8A27EBB8 00000002
8A27EBE4 802D4746 MM.NLM|DeactivateIOObject+A6
8A27EBE8 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27EBEC 00000000
8A27EBF0 00000003
8A27EBF4 00000002
8A27EC0C 802D3FAA MM.NLM|GenericIOObjectClassControl+106
8A27EC10 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27EC14 00000002
8A27EC24 802C4498 MM.NLM|MM_DeactivateObject+68
8A27EC28 00000002
8A27EC2C 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27EC30 00000002
8A27EC34 00000000
8A27EC38 00000000
8A27EC3C 00000000
8A27EC4C 802D421E MM.NLM|UnregisterIOObject+16
8A27EC50 2D00002C
8A27EC54 00000002
8A27EC68 802D3F46 MM.NLM|GenericIOObjectClassControl+A2
8A27EC6C 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27EC70 00000002
8A27EC80 802C5CB2 MM.NLM|MM_UnregisterObject+E6
8A27EC84 00FF0002 00000000 01010000 00000103 21E00000 ..............`!
8A27EC88 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27EC8C 00000002
8A27EC90 00000000
8A27EC94 00000000
8A27EC98 00000000
8A27ECB0 802F8F32 MM.NLM|FailoverAlertRoutine+616
8A27ECB4 2D00002C
8A27ECB8 00000002
8A27ECE4 802D4BB1 MM.NLM|GenericIOObjectAlertRoutine+C5
8A27ECE8 8973D640 8A297540 8A2977E0 2D00002C 0000002C @u).`w).,..-,...
8A27ECEC 8A2968A0 8A1FE7E0 8A296C20 FF000011 00000011 `g.. l).........
8A27ECF0 00000008
8A27ECF4 00000002
8A27ED08 802D4263 MM.NLM|UnregisterIOObject+5B
8A27ED2C 802D3F46 MM.NLM|GenericIOObjectClassControl+A2
8A27ED30 8A2968A0 8A1FE7E0 8A296C20 FF000011 00000011 `g.. l).........
8A27ED34 00000002
8A27ED44 802C5CB2 MM.NLM|MM_UnregisterObject+E6
8A27ED48 00FF0002 00000000 01010000 00000103 21E00000 ..............`!
8A27ED4C 8A2968A0 8A1FE7E0 8A296C20 FF000011 00000011 `g.. l).........
8A27ED50 00000002
8A27ED54 00000000
8A27ED58 00000000
8A27ED5C 00000000
8A27ED74 8972550D NWPA.NLM|ScanAndBuildDeviceList+925
8A27ED78 12000011 96686B5C 8001DF22 AE55CA00 00AC226F \kh."_...JU.o",.
8A27ED7C 00000002
8A27EEB4 89725CCF NWPA.NLM|CDI_Rescan_Bus+87
8A27EEB8 895E1300 00000000 00000000 00000000 00000000 ................
8A27EECC 8A24BA42 SCSIHD.CDM|AE_DeviceDisappearedEvent+62
8A27EED0 00000006
8A27EED4 CCCCCCCC
8A27EEE0 8971FACD NWPA.NLM|NPAThreadRoutine+3D
8A27EEE4 895E1800 895E1C00 00000000 00000000 00FF91C0 ..^.........@...
8A27EF18 00369B12 SERVER.NLM|CallAESRoutineWithEsiSet+A
8A27EF1C 00208798 8971FA90 FFFFFFFF 04AA3080 8971FA90 .zq......0*..zq.
8A27EF28 0026A2F2 SERVER.NLM|WTDFrontEndHandler+62
8A27EF2C 00208798 8971FA90 FFFFFFFF 04AA3080 8971FA90 .zq......0*..zq.
8A27EF38 00369A82 SERVER.NLM|StartWorkToDo+23
8A27EF3C 002087A0 04AA3080 8971FA90 FE10C2C0 00000000 .0*..zq.@B.~....
8A27EF50 0021B7CC SERVER.NLM|WorkerThread+508
8A27EF68 00228758 SERVER.NLM|TcoNewSystemThreadEntryPoint+40
8A27EF6C 8A2932C0 00000000 00000000 00000000 00000000 ................
8A27EF70 00000000
(stack end)