认真就输

            环境：DB 10.2.0.4 RAC OS: SOLARIS 10

ocssd日志：

[    CSSD]2013-09-04 19:02:17.372 [5] >TRACE:   clssnm_skgxncheck: checking up on reconfig
[    CSSD]2013-09-04 19:02:17.372 [5] >TRACE:   clssnm_skgxncheck: node(0) is on in supermap
[    CSSD]2013-09-04 19:02:17.372 [5] >TRACE:   clssnm_skgxncheck: new node 0, unique 1378291630
[    CSSD]2013-09-04 19:02:17.372 [5] >TRACE:   clssnm_skgxncheck: node(1) is on in supermap
[    CSSD]2013-09-04 19:02:17.375 [1] >TRACE:   clssnmNMInitialize: misscount set to (600)
[    CSSD]2013-09-04 19:02:17.376 [1] >TRACE:   clssnmNMInitialize: Network heartbeat thresholds are: impending reconfig 300000 ms, reconfig start (misscount) 600000 ms
[    CSSD]2013-09-04 19:02:17.382 [1] >TRACE:   clssnmDiskStateChange: state from 1 to 2 disk (0//dev/vx/rdsk/ocrvotedg/votevol)
[    CSSD]2013-09-04 19:02:17.382 [6] >TRACE:   clssnmvDPT: spawned for disk 0 (/dev/vx/rdsk/ocrvotedg/votevol)
[    CSSD]2013-09-04 19:02:19.407 [6] >TRACE:   clssnmDiskStateChange: state from 2 to 4 disk (0//dev/vx/rdsk/ocrvotedg/votevol)
[    CSSD]2013-09-04 19:02:19.408 [1] >ERROR:   Internal Error Information:
  Category: 1234
  Operation: scls_scr_setval
  Location: open
  Other: cant open file
  Dep: 2

[    CSSD]2013-09-04 19:02:19.408 [1] >ERROR:   clssscSclsFatal: failure 8 reading fatal mode
[    CSSD]2013-09-04 19:02:19.408 [1] >ERROR:   ###################################
[    CSSD]2013-09-04 19:02:19.408 [1] >ERROR:   clssscExit: CSSD aborting
[    CSSD]2013-09-04 19:02:19.408 [1] >ERROR:   ###################################

crsd日志：

2013-09-04 19:08:49.988: [ COMMCRS][27]clsc_connect: (cf3250) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_sol2_crs))

2013-09-04 19:08:49.988: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9

2013-09-04 19:08:49.988: [  CRSRTI][1] CSS is not ready. Received status 3 from CSS. Waiting for good status .. 

2013-09-04 19:08:51.085: [ COMMCRS][29]clsc_connect: (cf3310) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_sol2_crs))

2013-09-04 19:08:51.085: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9

2013-09-04 19:08:51.085: [  CRSRTI][1] CSS is not ready. Received status 3 from CSS. Waiting for good status .. 

对比两个节点的/var/opt/oracle/scls_scr/sol2目录下的文件，发现节点2少了文件。

$ pwd
/var/opt/oracle/scls_scr/sol2/oracle
$ cat cssfatal
enable$

创建oracle目录，并创建cssfatal文件后，重新启动crs，故障得以解决