oracle rac vip不通,Oracle RAC 中vip网关引起错误的解决-程序员宅基地
技术标签： oracle rac vip不通
在虚拟机上刚装完Oracle RAC，重新启动系统后。重新启动了oracle所有的服务，一开始所有的服务都正常。
但是过了一会，节点2的vip又再次飘移到了节点1上，并且节点2的监听服务也OFFLINE了。反复启动了几次都是同样的效果的。
[root@node2 bin]# ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.devdb.db application ONLINE ONLINE node2
ora....b1.inst application ONLINE ONLINE node1
ora....b2.inst application ONLINE ONLINE node2
ora....SM1.asm application ONLINE ONLINE node1
ora....E1.lsnr application ONLINE ONLINE node1
ora.node1.gsd application ONLINE ONLINE node1
ora.node1.ons application ONLINE ONLINE node1
ora.node1.vip application ONLINE ONLINE node1
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application ONLINE OFFLINE
ora.node2.gsd application ONLINE ONLINE node2
ora.node2.ons application ONLINE ONLINE node2
ora.node2.vip application ONLINE ONLINE node1
节点2上的监听没有起，并且节点2的vip起在节点1上。之前监听器是在节点1上建立的一个集群监听。
尝试将节点2的vip停止下来再重新启动，发现只能在节点1上启动。
/u01/app/oracle/crs/log/node2/crsd/crsd.log的日志报错：
2014-11-03 13:41:33.386: [ CRSRES][2659736480]0Attempting to start `ora.node2.vip` on member `node2`
2014-11-03 13:41:46.720: [ CRSAPP][2659736480]0StartResource error for ora.rac10g2.vip error code = 1
2014-11-03 13:41:51.405: [ CRSRES][2659736480]0Start of `ora.node2.vip` on member `node2` failed.
2014-11-03 13:41:51.532: [ CRSRES][2659736480]0Attempting to start `ora.node2.vip` on member `node1`
2014-11-03 13:41:55.388: [ CRSRES][2659736480]0Start of `ora.node2.vip` on member `node1` succeeded.
将所有服务都停止，然后一一重启就好了。
[root@node2 bin]# ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.devdb.db application ONLINE ONLINE node2
ora....b1.inst application ONLINE ONLINE node1
ora....b2.inst application ONLINE ONLINE node2
ora....SM1.asm application ONLINE ONLINE node1
ora....E1.lsnr application ONLINE ONLINE node1
ora.node1.gsd application ONLINE ONLINE node1
ora.node1.ons application ONLINE ONLINE node1
ora.node1.vip application ONLINE ONLINE node1
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application ONLINE ONLINE node2
ora.node2.gsd application ONLINE ONLINE node2
ora.node2.ons application ONLINE ONLINE node2
ora.node2.vip application ONLINE ONLINE node2
但是过了一会，节点2的vip又再次飘移到了节点1上，并且节点2的监听服务也OFFLINE了。
在/u01/app/oracle/crs/log/node2/racg下的ora.node2.vip.log日志中发现如下报错：
[root@node2 bin]# cat /u01/app/oracle/product/crs/log/node2/racg/ora.node2.vip.log
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
2014-11-03 09:58:20.864: [ RACG][3067430592] [8114][3067430592][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 09:58:20.864: [ RACG][3067430592] [8114][3067430592][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 09:58:20.864: [ RACG][3067430592] [8114][3067430592][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 09:58:20.864: [ RACG][3067430592] [8114][3067430592][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.330s
2014-11-03 09:58:20.864: [ RACG][3067430592] [8114][3067430592][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.340s
2014-11-03 10:01:36.674: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)
2014-11-03 10:01:36.674: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:01:36.674: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 10:01:36.674: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.240s
2014-11-03 10:01:38.818: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)
2014-11-03 10:01:38.818: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:01:38.818: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 10:01:38.818: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.150s
2014-11-03 10:01:38.818: [ RACG][3068290752] [12884][3068290752][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 4.530s
2014-11-03 10:01:41.418: [ RACG][3068180160] [13098][3068180160][ora.node2.vip]: bounce eth0 (host=node2)
2014-11-03 10:05:41.296: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)
2014-11-03 10:05:41.296: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:05:41.296: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 10:05:41.296: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.150s
2014-11-03 10:05:43.434: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: IP:143.168.0.15 is already up in the network (host=node2)
2014-11-03 10:05:43.434: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:05:43.434: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 10:05:43.434: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: clsrcexecut: rc = 1, time = 2.140s
2014-11-03 10:05:43.434: [ RACG][3067840192] [18850][3067840192][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 4.350s
2014-11-03 10:05:45.791: [ RACG][3067639488] [19001][3067639488][ora.node2.vip]: bounce eth0 (host=node2)
2014-11-03 10:53:28.997: [ RACG][3067741888] [2298][3067741888][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 10:53:28.997: [ RACG][3067741888] [2298][3067741888][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:53:28.997: [ RACG][3067741888] [2298][3067741888][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 10:53:28.997: [ RACG][3067741888] [2298][3067741888][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.390s
2014-11-03 10:53:28.997: [ RACG][3067741888] [2298][3067741888][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 9.930s
2014-11-03 10:56:47.744: [ RACG][3067373248] [7351][3067373248][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 10:56:47.745: [ RACG][3067373248] [7351][3067373248][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:56:47.745: [ RACG][3067373248] [7351][3067373248][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 10:56:47.745: [ RACG][3067373248] [7351][3067373248][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.320s
2014-11-03 10:56:47.745: [ RACG][3067373248] [7351][3067373248][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.340s
2014-11-03 10:58:35.730: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 10:58:35.730: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:58:35.730: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 10:58:35.730: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.240s
2014-11-03 10:58:42.058: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 10:58:42.058: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 10:58:42.058: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 10:58:42.058: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.330s
2014-11-03 10:58:42.058: [ RACG][3067692736] [9859][3067692736][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 15.590s
2014-11-03 11:01:20.158: [ OCRMSG][3068126912]prom_rpc: CLSC send failure..ret code 11
2014-11-03 11:01:20.187: [ OCRMSG][3068126912]prom_rpc: possible OCR retry scenario
2014-11-03 11:01:21.188: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #0
2014-11-03 11:01:21.380: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:22.382: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #1
2014-11-03 11:01:22.567: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:23.569: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #2
2014-11-03 11:01:23.757: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:24.758: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #3
2014-11-03 11:01:24.946: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:25.947: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #4
2014-11-03 11:01:26.138: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:27.139: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #5
2014-11-03 11:01:27.327: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:28.328: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #6
2014-11-03 11:01:28.523: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:29.525: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #7
2014-11-03 11:01:29.708: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:30.709: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #8
2014-11-03 11:01:30.893: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:31.894: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #9
2014-11-03 11:01:32.080: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:33.081: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #10
2014-11-03 11:01:33.269: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:34.271: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #11
2014-11-03 11:01:34.459: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:35.461: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #12
2014-11-03 11:01:35.647: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:36.649: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #13
2014-11-03 11:01:36.836: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:37.837: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #14
2014-11-03 11:01:38.024: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
[ OCRAPI][3068126912]a_get_last_error: Buf too small (0, 95)
2014-11-03 11:01:38.024: [ RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrccssgetnodename: clssnsqname() failed. rc=21
2014-11-03 11:01:38.216: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:39.217: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #0
2014-11-03 11:01:39.399: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:40.400: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #1
2014-11-03 11:01:40.584: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:41.587: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #2
2014-11-03 11:01:41.779: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:42.780: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #3
2014-11-03 11:01:42.970: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:43.972: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #4
2014-11-03 11:01:44.159: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:45.162: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #5
2014-11-03 11:01:45.347: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:46.348: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #6
2014-11-03 11:01:46.541: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:47.542: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #7
2014-11-03 11:01:47.729: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:48.731: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #8
2014-11-03 11:01:48.919: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:49.920: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #9
2014-11-03 11:01:50.103: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:51.107: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #10
2014-11-03 11:01:51.294: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:52.295: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #11
2014-11-03 11:01:52.488: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:53.489: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #12
2014-11-03 11:01:53.676: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:54.677: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #13
2014-11-03 11:01:54.865: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:55.867: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #14
2014-11-03 11:01:56.050: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
[ OCRAPI][3068126912]a_get_last_error: Buf too small (0, 95)
2014-11-03 11:01:56.051: [ RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrccssgetnodename: clssnsqname() failed. rc=21
2014-11-03 11:01:56.051: [ RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrcep: clsrcgetnodename error: leaving node name null
2014-11-03 11:01:56.237: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:57.239: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #0
2014-11-03 11:01:57.434: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:58.436: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #1
2014-11-03 11:01:58.629: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:01:59.630: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #2
2014-11-03 11:01:59.817: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:00.819: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #3
2014-11-03 11:02:01.006: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:02.008: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #4
2014-11-03 11:02:02.192: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:03.193: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #5
2014-11-03 11:02:03.402: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:04.403: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #6
2014-11-03 11:02:04.587: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:05.589: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #7
2014-11-03 11:02:05.775: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:06.777: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #8
2014-11-03 11:02:06.965: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:07.966: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #9
2014-11-03 11:02:08.155: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:09.156: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #10
2014-11-03 11:02:09.348: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:10.349: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #11
2014-11-03 11:02:10.535: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:11.536: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #12
2014-11-03 11:02:11.722: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:12.722: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #13
2014-11-03 11:02:12.908: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
2014-11-03 11:02:13.909: [ OCRAPI][3068126912]procr_open: Node Failure. Attempting retry #14
2014-11-03 11:02:14.096: [ OCRCLI][3068126912]oac_reconnect_server: Could not connect to server. clsc ret 9
[ OCRAPI][3068126912]a_get_last_error: Buf too small (0, 95)
2014-11-03 11:02:14.096: [ RACG][3068126912] [13698][3068126912][ora.node2.vip]: clsrccssalive: Unable to get node number stat=21
2014-11-03 11:22:23.844: [ RACG][3068208832] [27259][3068208832][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 11:22:23.844: [ RACG][3068208832] [27259][3068208832][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 11:22:23.844: [ RACG][3068208832] [27259][3068208832][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 11:22:23.844: [ RACG][3068208832] [27259][3068208832][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.330s
2014-11-03 11:22:23.844: [ RACG][3068208832] [27259][3068208832][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.350s
2014-11-03 11:24:23.113: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 11:24:23.114: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 11:24:23.114: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 11:24:23.114: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.310s
2014-11-03 11:24:32.479: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 11:24:32.479: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 11:24:32.479: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 11:24:32.479: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.360s
2014-11-03 11:24:32.479: [ RACG][3068204736] [30064][3068204736][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 18.690s
2014-11-03 13:49:31.224: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 13:49:31.266: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 13:49:31.266: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 13:49:31.266: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.680s
2014-11-03 13:49:40.790: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 13:49:40.790: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 13:49:40.790: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 13:49:40.790: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.530s
2014-11-03 13:49:40.790: [ RACG][3067307712] [4955][3067307712][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 19.720s
2014-11-03 13:53:22.690: [ RACG][3068077760] [10724][3068077760][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 13:53:22.690: [ RACG][3068077760] [10724][3068077760][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 13:53:22.690: [ RACG][3068077760] [10724][3068077760][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 13:53:22.690: [ RACG][3068077760] [10724][3068077760][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.440s
2014-11-03 13:53:22.690: [ RACG][3068077760] [10724][3068077760][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.460s
2014-11-03 14:16:51.547: [ RACG][3067770560] [12993][3067770560][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:16:51.547: [ RACG][3067770560] [12993][3067770560][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:16:51.547: [ RACG][3067770560] [12993][3067770560][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 14:16:51.547: [ RACG][3067770560] [12993][3067770560][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.250s
2014-11-03 14:20:23.748: [ RACG][3067922112] [18191][3067922112][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:20:23.749: [ RACG][3067922112] [18191][3067922112][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:20:23.749: [ RACG][3067922112] [18191][3067922112][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 14:20:23.749: [ RACG][3067922112] [18191][3067922112][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.220s
2014-11-03 14:20:23.749: [ RACG][3067922112] [18191][3067922112][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.240s
2014-11-03 14:28:08.920: [ RACG][3068122816] [29510][3068122816][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:28:08.921: [ RACG][3068122816] [29510][3068122816][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:28:08.921: [ RACG][3068122816] [29510][3068122816][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 14:28:08.921: [ RACG][3068122816] [29510][3068122816][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.360s
2014-11-03 14:28:08.921: [ RACG][3068122816] [29510][3068122816][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.370s
2014-11-03 14:37:35.267: [ RACG][3067410112] [10640][3067410112][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:37:35.267: [ RACG][3067410112] [10640][3067410112][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:37:35.267: [ RACG][3067410112] [10640][3067410112][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 14:37:35.267: [ RACG][3067410112] [10640][3067410112][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.280s
2014-11-03 14:37:35.267: [ RACG][3067410112] [10640][3067410112][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.300s
2014-11-03 14:40:36.266: [ RACG][3067541184] [15021][3067541184][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:40:36.266: [ RACG][3067541184] [15021][3067541184][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:40:36.266: [ RACG][3067541184] [15021][3067541184][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 14:40:36.266: [ RACG][3067541184] [15021][3067541184][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.310s
2014-11-03 14:40:36.267: [ RACG][3067541184] [15021][3067541184][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.380s
2014-11-03 14:43:27.050: [ RACG][3067307712] [19015][3067307712][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:43:27.050: [ RACG][3067307712] [19015][3067307712][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:43:27.050: [ RACG][3067307712] [19015][3067307712][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 14:43:27.050: [ RACG][3067307712] [19015][3067307712][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.280s
2014-11-03 14:47:19.942: [ RACG][3067995840] [23291][3067995840][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:47:19.942: [ RACG][3067995840] [23291][3067995840][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:47:19.942: [ RACG][3067995840] [23291][3067995840][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 14:47:19.942: [ RACG][3067995840] [23291][3067995840][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.230s
2014-11-03 14:47:19.942: [ RACG][3067995840] [23291][3067995840][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.250s
2014-11-03 14:51:49.744: [ RACG][3067389632] [30018][3067389632][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 14:51:49.745: [ RACG][3067389632] [30018][3067389632][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 14:51:49.745: [ RACG][3067389632] [30018][3067389632][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 14:51:49.745: [ RACG][3067389632] [30018][3067389632][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.520s
2014-11-03 14:51:49.745: [ RACG][3067389632] [30018][3067389632][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.540s
2014-11-03 15:54:22.213: [ RACG][3067971264] [5646][3067971264][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 15:54:22.218: [ RACG][3067971264] [5646][3067971264][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 15:54:22.218: [ RACG][3067971264] [5646][3067971264][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 15:54:22.218: [ RACG][3067971264] [5646][3067971264][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.380s
2014-11-03 15:54:22.218: [ RACG][3067971264] [5646][3067971264][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.430s
2014-11-03 15:59:28.335: [ RACG][3067631296] [13317][3067631296][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 15:59:28.335: [ RACG][3067631296] [13317][3067631296][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 15:59:28.335: [ RACG][3067631296] [13317][3067631296][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 15:59:28.335: [ RACG][3067631296] [13317][3067631296][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.510s
2014-11-03 16:37:22.661: [ RACG][3067848384] [31375][3067848384][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 16:37:22.661: [ RACG][3067848384] [31375][3067848384][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 16:37:22.661: [ RACG][3067848384] [31375][3067848384][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 16:37:22.661: [ RACG][3067848384] [31375][3067848384][ora.node2.vip]: clsrcexecut: rc = 1, time = 51.290s
2014-11-03 16:37:22.661: [ RACG][3067848384] [31375][3067848384][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 113.690s
2014-11-03 16:37:57.544: [ RACG][3067524800] [32281][3067524800][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 16:37:57.545: [ RACG][3067524800] [32281][3067524800][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 16:37:57.545: [ RACG][3067524800] [32281][3067524800][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 16:37:57.545: [ RACG][3067524800] [32281][3067524800][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.720s
2014-11-03 16:37:57.545: [ RACG][3067524800] [32281][3067524800][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 11.210s
2014-11-03 16:43:06.214: [ RACG][3067926208] [5514][3067926208][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 16:43:06.215: [ RACG][3067926208] [5514][3067926208][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 16:43:06.215: [ RACG][3067926208] [5514][3067926208][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 16:43:06.215: [ RACG][3067926208] [5514][3067926208][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.250s
2014-11-03 16:44:25.848: [ RACG][3067700928] [7520][3067700928][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 16:44:25.848: [ RACG][3067700928] [7520][3067700928][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 16:44:25.848: [ RACG][3067700928] [7520][3067700928][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 16:44:25.848: [ RACG][3067700928] [7520][3067700928][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.380s
2014-11-03 16:44:25.848: [ RACG][3067700928] [7520][3067700928][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.400s
2014-11-03 16:49:22.955: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 16:49:22.955: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 16:49:22.955: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip start node2
2014-11-03 16:49:22.955: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.320s
2014-11-03 16:49:32.234: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 16:49:32.234: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 16:49:32.234: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 16:49:32.234: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: clsrcexecut: rc = 1, time = 9.280s
2014-11-03 16:49:32.234: [ RACG][3067414208] [14413][3067414208][ora.node2.vip]: end for resource = ora.node2.vip, action = start, status = 1, time = 18.630s
2014-11-03 17:29:29.895: [ RACG][3067782848] [5942][3067782848][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 17:29:29.895: [ RACG][3067782848] [5942][3067782848][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 17:29:29.895: [ RACG][3067782848] [5942][3067782848][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 17:29:29.895: [ RACG][3067782848] [5942][3067782848][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.370s
2014-11-03 17:29:29.895: [ RACG][3067782848] [5942][3067782848][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.390s
2014-11-03 17:38:01.381: [ RACG][3067832000] [18181][3067832000][ora.node2.vip]: Interface eth0 checked failed (host=node2)
Invalid parameters, or failed to bring up VIP (host=node2)
2014-11-03 17:38:01.381: [ RACG][3067832000] [18181][3067832000][ora.node2.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/u01/app/oracle/product/crs
2014-11-03 17:38:01.381: [ RACG][3067832000] [18181][3067832000][ora.node2.vip]: clsrcexecut: cmd = /u01/app/oracle/product/crs/bin/racgeut -e _USR_ORA_DEBUG=0 54 /u01/app/oracle/product/crs/bin/racgvip check node2
2014-11-03 17:38:01.381: [ RACG][3067832000] [18181][3067832000][ora.node2.vip]: clsrcexecut: rc = 1, time = 6.210s
2014-11-03 17:38:01.381: [ RACG][3067832000] [18181][3067832000][ora.node2.vip]: end for resource = ora.node2.vip, action = check, status = 1, time = 6.260s
发现eth0 ping的网关不正常。
将eth1上的网关设置删除后，还是出现相同的报错，怀疑是vip的默认网关配置出了问题。
将所有的服务都停止。
对节点2的vip进行debug，最后的5是_USR_ORA_DEBUG flag ，表示级别。
[root@rac10g2 ~]# crsctl debug log res "ora.node2.vip:5"
Set Resource Debug Module: ora.node2.vip Level: 5
启动ora.node2.vip。
[root@rac10g2 ~]# crs_start ora.node2.vip
查看trace日志。trace日志在$ORA_CRS_HOME/log//racg/
果然发现默认网关设置不正常，设置为192.168.94.1，并不是预计的192.168.1.1。
2014-11-03 15:53:15.830: [ RACG][3086924000] [2200][3086924000][ora.rac10g2.vip]: Fri Nov 03 15:53:09 CST 2014 [ 2204 ] /sbin/mii-tool eth0 error
Fri Nov 18 15:53:09 CST 2014 [ 2204 ] defaultgw: started
Fri Nov 03 15:53:09 CST 2014 [ 2204 ] defaultgw: completed with 192.168.94.1
2014-11-03 15:53:15.830: [ RACG][3086924000] [2200][3086924000][ora.node2.vip]: ping to 192.168.94.1 via eth0 failed, rc = 1 (host=node2)
ping to 192.168.94.1 via eth0 failed, rc = 1 (host=rac10g2)
Fri Nov 03 15:53:15 CST 2014 [ 2204 ] checkIf: ping and RX packets checked if=eth0 failed
Interface eth0 checked failed (host=node2)
2014-11-03 15:53:15.830: [ RACG][3086924000] [2200][3086924000][ora.node2.vip]: Fri Dec 18 15:53:15 CST 2014 [ 2204 ] checkIf: end for if=eth0
Invalid parameters, or failed to bring up VIP (host=node2)
修改默认网关：
修改文件$ORA_CRS_HOME/bin/racgvip，将以下内容修改为想要指派的新的网关。
DEFAULTGW原本是没有值的，现在修改为192.168.1.1。
# hard code default gateway here if needed
DEFAULTGW=192.168.1.1
修改之后，在trace看到该部分已经检测ok。
2014-11-03 16:11:40.984: [ RACG][3086924000] [7808][3086924000][ora.rac10g2.vip]: Fri Nov 03 16:11:40 CST 2014 [ 7812 ] /sbin/mii-tool eth0 error
Fri Nov 03 16:11:40 CST 2014 [ 7812 ] checkIf: ping checked if=eth0 ok
Fri Nov 03 16:11:40 CST 2014 [ 7812 ] checkIf: end for if=eth0
该修改需要在节点1和节点2上同时修改，观察很长一段时间之后，没有再发现之前的问题。
其实该问题的出现，主要的原因是在eth1上配置了默认网关，用于私有网络的网卡不建议配置网关。所以该问题中，如果没有特别的必要，将私有网卡上的网关删除，删除默认路由网关，重启vip即可解决该问题。
智能推荐
appium设置会话时间，可以超长时。Open Application-程序员宅基地
文章浏览阅读1.2k次。转载于:https://www.cnblogs.com/1234abcdttttjy001/p/10650408.html_appium 连接超时的时间设置
最新版Flink CDC MySQL同步Elasticsearch（一）_the mysql server has a timezone offset (28800 seco-程序员宅基地
文章浏览阅读1.2w次，点赞2次，收藏9次。（需要自行进行构建编译，笔者构建的已经上次至次博客。需要可以进行下载，csdn需要积分下载，无法设置免费的，需要免费版可以直接联系笔者）首先我们要基于Flink CDC MySQL同步MySQL的环境基础上（flink-1.17.1、Java8、MySQL8）搭建。，笔者的Flink CDC MySQL同步Elasticsearch第一篇讲解完毕，希望能帮助到搭建。笔者已经搭建好环境，这里不做具体演示了，如果需要Es的搭建教程情况笔者其他博客。：这是笔者遇到的问题，具体问题具体解决即可。_the mysql server has a timezone offset (28800 seconds ahead of utc) which do
Spring Cloud中间件_springcloud中间件-程序员宅基地
文章浏览阅读1k次。spring cloud 中间件_springcloud中间件
vxe-table实现增加行（push）滚动条到对应行_vxe-table 滚动到某一行-程序员宅基地
文章浏览阅读3.3k次。自己试了vxe-table的官方文档方法，没有成功。最后使用了原生的方法scrollTo（）实现了，加入计时器效果更明显 setTimeout(() => { document .getElementsByClassName("vxe-table--body-wrapper")[0] .scrollTo(0, this.$refs.xTable2.tableHeight); }, 500);..._vxe-table 滚动到某一行
Android 程序反编译_@ref/0x7f070000是什么意思-程序员宅基地
文章浏览阅读426次。Apk文件的格式Android application package文件。每个要安装到android平台的应用都要被编译打包为一个单独的文件，后缀名为.apk，其中包含了应用的二进制代码、资源、配置文件等。apk文件实际是一个zip压缩包，可以通过解压缩工具解开。可以用zip解开*.apk文件，下面是一个helloword的apk示例文件。|– AndroidManifest.xml |– ME..._@ref/0x7f070000是什么意思
Python单元测试unittest加载方式之二：加载测试套件_python 测试套加载环境文件-程序员宅基地
文章浏览阅读1w次，点赞8次，收藏3次。Python、unittest_python 测试套加载环境文件
随便推点
CPU的亲和性_cpu亲和性-程序员宅基地
文章浏览阅读478次。CPU领域中最广为人知的一条定律——摩尔定律：预计18个月会将芯片的性能提高一倍。过去几十年，各大公司致力于提高CPU晶体管密度和提高CPU工作频率，使得CPU的性能提升基本符合摩尔定律。但随着工艺不断发展，晶体管密度提升已经接近物理极限，CPU工作频率也由于功耗和发热的制约而无法继续提升。在基础物理领域没有大的突破的前提下，单核CPU的性能提升日益困难，于是，各大公司将目光投向了通过增加CPU核心数提高性能领域，双核、4核、8核、16核等一系列多核CPU相继问世。_cpu亲和性
Vuforia 云辨认 多图教程_vuforia识别多个图片-程序员宅基地
文章浏览阅读3.2k次。一 创立云辨认库起首在应用云辨认之前我们须要拥有一个KEY 一个KEY对应一个宣布的APP 我们之前注册的基本KEY就可以应用云办事 可是每个月/每个APP用户/每张辨认图有1000次的扫描限制 所以基本的只能支撑我们测试或者极小频率的应用办事的价钱可以参看下图 接下来我们树立一个云辨认库 打开tARget治理页面点击ADD DATABASE添加一个数据库 _vuforia识别多个图片
从《编程之美》买票找零问题说起，娓娓道来卡特兰数——兼爬坑指南_排队找零问题-程序员宅基地
文章浏览阅读3.4k次。转自：从《编程之美》买票找零问题说起，娓娓道来卡特兰数——兼爬坑指南引子： 大约两个月前，我在练习一些招聘的笔试题中，有一道和卡特兰数相关。那时还没来得及开始仔细看《编程之美》，就先翻到那一章节，草草地看了下买票找零的例子和证明并把书上的背下来了事。当然，只靠这个式子是可以解决一些问题的，但不知是《编程之美》的作者有意挖的陷阱来甄别所谓的“Poser”，还是疏忽了没有进一步讨论，又或_排队找零问题
【MATLAB】信号与系统 — 周期矩形（三角形）脉冲信号_matlab周期矩形脉冲信号-程序员宅基地
文章浏览阅读4.5k次。【MATLAB】信号与系统 — 周期矩形（三角形）脉冲信号。_matlab周期矩形脉冲信号
linux下升级BMC,Linux下升级IBM3650主板bios、bmc和raid卡firmware-程序员宅基地
文章浏览阅读1.1k次。IBM3650自带的raid10卡型号是8k-l，在IBM主站下载以下程序：1 ibm_sw_srapp_9.30-17006_anyos_32-64.iso中抽取RaidMan-9.30-17006.i386.rpm2 ibm_fw_aacraid_8k-8kl-5.2.0-17003_linux_32-64.bin3 ibm_fw_bios_gge149a-1.19_linux_i386.sh..._ibm3650m4升级bios
NanoPi NEO3上手日记第二天——装个WiFi（OpenWrt系统无线配置均适用）_rtl8811cu openwrt-程序员宅基地
文章浏览阅读1w次。NanoPi NEO3上手日记第二天——装个WiFi_rtl8811cu openwrt