Rac集群单节点CRS打不开

[c328863068]

Oracle集群一共两个节点，1节点正常。2节点crs启动不了。
这是日志：希望老司机们帮帮忙
2018-03-19 09:22:59.697: [ GIPCNET][4150241024] gipcmodNetworkProcessSend: slos op : sgipcnValidateSocket
2018-03-19 09:22:59.697: [ GIPCNET][4150241024] gipcmodNetworkProcessSend: slos dep : Invalid argument (22)
2018-03-19 09:22:59.697: [ GIPCNET][4150241024] gipcmodNetworkProcessSend: slos loc : address not
2018-03-19 09:22:59.697: [ GIPCNET][4150241024] gipcmodNetworkProcessSend: slos info: addr 'xxx.xxx.x.61:39289', len 6608, buf 0x7fa3e40291c8, cookie 0x7fa3e4019060
2018-03-19 09:22:59.697: [GIPCXCPT][4150241024] gipcInternalSendSync: failed sync request, ret gipcretEndpointNotAvailable (40)
2018-03-19 09:22:59.697: [GIPCXCPT][4150241024] gipcSendSyncF [gipchaLowerInternalSend : gipchaLower.c : 781]: EXCEPTION[ ret gipcretEndpointNotAvailable (40) ] failed to send on endp 0x7fa3e4009900 [00000000000001ce] { gipcEndpoint : localAddr 'udp://xxx.xxx.x.61:39289', remoteAddr '', numPend 5, numReady 0, numDone 0, numDead 0, numTransfer 0, objFlags 0x0, pidPeer 0, flags 0x2, usrFlags 0x4000 }, addr 0x7fa3e4019db0 [0000000000000293] { gipcAddress : name 'udp://192.168.2.60:49271', objFlags 0x0, addrFlags 0x1 }, buf 0x7fa3e40291c8, len 6608, flags 0x0
2018-03-19 09:22:59.697: [GIPCHGEN][4150241024] gipchaInterfaceFail: marking interface failing 0x7fa3e80293e0 { host 'oracle1', haName '58c3-bafd-42b3-0c6a', local 0x7fa3e800bb30, ip 'xxx.xxx.x.60:49271', subnet 'xxx.xxx.x.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0x6 }
2018-03-19 09:22:59.697: [GIPCHALO][4150241024] gipchaLowerInternalSend: failed to initiate send on interface 0x7fa3e80293e0 { host 'oracle1', haName '58c3-bafd-42b3-0c6a', local 0x7fa3e800bb30, ip 'xxx.xxx.x.60:49271', subnet 'xxx.xxx.x.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0x86 }, hctx 0x2e1d970 [0000000000000010] { gipchaContext : host 'oracle2', name '00b7-871f-0d5a-2c68', luid 'bd5f9077-00000000', numNode 1, numInf 1, usrFlags 0x0, flags 0x1 }

[minsic78]

看crsctl命令的输出，监听确实没启动，看下进程还有没有： ps -ef|grep -i listener 如果还有残留的监听进程，kill掉后再启动试试

[惜分飞]

这里看，应该是私网（可能haip）相关的异常，具体需要结合当时的系统情况分析

[c328863068]

把crs起来了。但是crs_stat -t查看节点2发现两个问题1、监听没起，但是用节点2登陆了数据库。。2、scan ip没起。又蛋疼了

[minsic78]

“用节点2登录了数据库”是什么意思？在节点2的操作系统上直接sqlplus '/as sysdba'登录的？这样登录和监听没关系，监听可以手工启动，有没有曾经对监听做过什么srvctl disable操作？ “scan ip没起” 你用crsctl stat res -t命令看下，SCANIP应该启动在节点1了

[c328863068]

[grid@oracle2 ~]$ crsctl stat res -t -------------------------------------------------------------------------------- NAME TARGET STATE SERVER STATE_DETAILS -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.CRS.dg ONLINE ONLINE oracle1 ONLINE ONLINE oracle2 ora.DATA.dg ONLINE ONLINE oracle1 ONLINE ONLINE oracle2 ora.FRA.dg ONLINE ONLINE oracle1 ONLINE ONLINE oracle2 ora.LISTENER.lsnr ONLINE ONLINE oracle1 ONLINE ONLINE oracle2 ora.asm ONLINE ONLINE oracle1 Started ONLINE ONLINE oracle2 Started ora.gsd OFFLINE OFFLINE oracle1 OFFLINE OFFLINE oracle2 ora.net1.network ONLINE ONLINE oracle1 ONLINE ONLINE oracle2 ora.ons ONLINE ONLINE oracle1 ONLINE ONLINE oracle2 -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE OFFLINE ora.cvu 1 ONLINE ONLINE oracle1 ora.oc4j 1 ONLINE ONLINE oracle1 ora.oracle1.vip 1 ONLINE ONLINE oracle1 ora.oracle2.vip 1 ONLINE ONLINE oracle2 ora.scan1.vip 1 ONLINE OFFLINE ora.whsw.db 1 ONLINE ONLINE oracle1 Open 2 ONLINE ONLINE oracle2 Open 这是查看结果。

[c328863068]

手动启动监听报已经启动了

[c328863068]

[grid@oracle2 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora.CRS.dg ora....up.type ONLINE ONLINE oracle1 ora.DATA.dg ora....up.type ONLINE ONLINE oracle1 ora.FRA.dg ora....up.type ONLINE ONLINE oracle1 ora....ER.lsnr ora....er.type ONLINE ONLINE oracle1 ora....N1.lsnr ora....er.type ONLINE OFFLINE ora.asm ora.asm.type ONLINE ONLINE oracle1 ora.cvu ora.cvu.type ONLINE ONLINE oracle1 ora.gsd ora.gsd.type OFFLINE OFFLINE ora....network ora....rk.type ONLINE ONLINE oracle1 ora.oc4j ora.oc4j.type ONLINE ONLINE oracle1 ora.ons ora.ons.type ONLINE ONLINE oracle1 ora....SM1.asm application ONLINE ONLINE oracle1 ora....E1.lsnr application ONLINE ONLINE oracle1 ora....le1.gsd application OFFLINE OFFLINE ora....le1.ons application ONLINE ONLINE oracle1 ora....le1.vip ora....t1.type ONLINE ONLINE oracle1 ora....SM2.asm application ONLINE ONLINE oracle2 ora....E2.lsnr application ONLINE ONLINE oracle2 ora....le2.gsd application OFFLINE OFFLINE ora....le2.ons application ONLINE ONLINE oracle2 ora....le2.vip ora....t1.type ONLINE ONLINE oracle2 ora.scan1.vip ora....ip.type ONLINE OFFLINE ora.whsw.db ora....se.type ONLINE ONLINE oracle1 gsd可以不理会，现在就看ora.scan1.vip应该在节点2上启动，但是没启动。ora....N1.lsnr ora....er.type 这个应该也是在节点2上跑