Oracle11g R2 RAC 更改OCR磁盘冗余模式
Oracle11g开始，OCR和voting disk都存放在ASM中且放在一个磁盘组上
ASM磁盘组冗余模式有三种：
EXTERNAL（外部冗余）：1块盘
NORMAL模式（两路镜像）：3块盘
HIGH模式（三路镜像）：5块盘
OCR磁盘组中存放：ocr,voting disk,asm的spfile
测试环境：OEL5.6_64+Oracle 11.2.0.2 两节点RAC（在安装时，OCR采用了EXTERNAL，本测试将EXTERNAL改为NORMAL）
变更步骤（注：在执行变更时，只启动了1节点的cluster）：
1：查看OCR、voting disk信息
2：备份OCR
3：创建磁盘组
4：备份spfile
5：OCR增加磁盘组
6：移除原磁盘组
7：迁移voting disk
8：修改spfile
9：启动2节点crs
10： 启动数据库
详细步骤如下：
1：查看OCR、voting disk信息，使用的磁盘组为OV
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
[root@rac1 ~]# ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2708 Available space (kbytes) : 259412 ID : 1300327955 Device/File Name : +OV Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@rac1 ~]# [root@rac1 ~]# crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 8a7a5abc934f4f93bf2bc8c5c9e96a09 (/dev/raw/raw1) [OV] Located 1 voting disk(s). [root@rac1 ~]# |
2：备份OCR，不时之需
|
1 2 3 4 5 6 7 8 9 10 11 12 |
[root@rac1 ~]# ocrconfig -showbackup rac1 2014/02/07 14:47:21 /u01/app/11.2.0/grid/cdata/rac-cluster/backup00.ocr rac1 2014/02/07 14:47:21 /u01/app/11.2.0/grid/cdata/rac-cluster/day.ocr rac1 2014/02/07 14:47:21 /u01/app/11.2.0/grid/cdata/rac-cluster/week.ocr rac1 2014/02/07 15:05:16 /u01/app/11.2.0/grid/cdata/rac-cluster/backup_20140207_150516.ocr rac1 2014/02/07 13:30:21 /u01/app/11.2.0/grid/cdata/rac-cluster/backup_20140207_133021.ocr [root@rac1 ~]# |
Orcle11g 默认情况下，Oracle RAC连续启动4小时，就自动备份，如果没有备份，那么也可以采取手工备份的方式进行备份，如下：
|
1 2 |
ocrconfig –export ocrconfig –manualbackup |
3：创建磁盘组（前提要提前准备磁盘）
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
[grid@rac1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.2.0 Production on Sat Feb 8 10:24:19 2014 Copyright (c) 1982, 2010, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> select name,compatibility,database_compatibility from v$asm_diskgroup; NAME COMPATIBILIT DATABASE_COMPATIBILITY ---------- ------------ ---------------------- DATA 11.2.0.0.0 10.1.0.0.0 OV 11.2.0.0.0 10.1.0.0.0 SQL> SQL> CREATE DISKGROUP ocr_vote NORMAL REDUNDANCY DISK '/dev/raw/raw3','/dev/raw/raw4','/dev/raw/raw5' ATTRIBUTE 'compatible.asm' = '11.2'; Diskgroup created. SQL> select name,compatibility,database_compatibility from v$asm_diskgroup; NAME COMPATIBILIT DATABASE_COMPATIBILITY ---------- ------------ ---------------------- DATA 11.2.0.0.0 10.1.0.0.0 OV 11.2.0.0.0 10.1.0.0.0 OCR_VOTE 11.2.0.0.0 10.1.0.0.0 SQL> |
4：备份spfile
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
[grid@rac1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.2.0 Production on Sat Feb 8 10:44:51 2014 Copyright (c) 1982, 2010, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> show parameter spfile NAME TYPE VALUE ------------------------------------ ----------- -------------------------------------------------------- spfile string +OV/rac-cluster/asmparameterfile/registry.253.838208731 SQL> create pfile='/home/grid/asm_pfile.ora' from spfile; File created. SQL> exit Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options [grid@rac1 ~]$ |
5：OCR增加磁盘组
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 |
--查看asm磁盘 SQL> select name,group_number ,disk_number,state,redundancy ,total_mb,free_mb,path from v$asm_disk where name is not null; NAME GROUP_NUMBER DISK_NUMBER STATE REDUNDA TOTAL_MB FREE_MB PATH --------------- ------------ ----------- -------- ------- ---------- ---------- -------------------- OCR_VOTE_0000 3 0 NORMAL UNKNOWN 392 339 /dev/raw/raw3 OCR_VOTE_0001 3 1 NORMAL UNKNOWN 392 339 /dev/raw/raw4 OCR_VOTE_0002 3 2 NORMAL UNKNOWN 392 339 /dev/raw/raw5 OV_0000 2 0 NORMAL UNKNOWN 1098 702 /dev/raw/raw1 DATA_0000 1 0 NORMAL UNKNOWN 11185 9220 /dev/raw/raw2 SQL> --磁盘组状态 SQL> select name,state from v$asm_diskgroup; NAME STATE --------------- ----------- DATA MOUNTED OV MOUNTED OCR_VOTE MOUNTED SQL> --再次ocrcheck [root@rac1 ~]# ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2708 Available space (kbytes) : 259412 ID : 1300327955 Device/File Name : +OV Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@rac1 ~]# --增加磁盘组 [root@rac1 ~]# ocrconfig -add +OCR_VOTE [root@rac1 ~]# ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2708 Available space (kbytes) : 259412 ID : 1300327955 Device/File Name : +OV Device/File integrity check succeeded Device/File Name : +OCR_VOTE Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@rac1 ~]# |
6：移除原磁盘组
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
--移除OCR [root@rac1 ~]# ocrconfig -delete +OV [root@rac1 ~]# [root@rac1 ~]# ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2708 Available space (kbytes) : 259412 ID : 1300327955 Device/File Name : +OCR_VOTE Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@rac1 ~]# |
7：迁移voting disk
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
[root@rac1 ~]# crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 8a7a5abc934f4f93bf2bc8c5c9e96a09 (/dev/raw/raw1) [OV] Located 1 voting disk(s). [root@rac1 ~]# [root@rac1 ~]# [root@rac1 ~]# crsctl replace votedisk +OCR_VOTE Successful addition of voting disk 86afcfe1a8ce4f32bf9a54281333b40c. Successful addition of voting disk 5c7b07b4be314fc7bfb5fb99a4acbb78. Successful addition of voting disk 0c03e8dc70274f65bf3c3ec55312d24d. Successful deletion of voting disk 8a7a5abc934f4f93bf2bc8c5c9e96a09. Successfully replaced voting disk group with +OCR_VOTE. CRS-4266: Voting file(s) successfully replaced [root@rac1 ~]# [root@rac1 ~]# crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 86afcfe1a8ce4f32bf9a54281333b40c (/dev/raw/raw3) [OCR_VOTE] 2. ONLINE 5c7b07b4be314fc7bfb5fb99a4acbb78 (/dev/raw/raw4) [OCR_VOTE] 3. ONLINE 0c03e8dc70274f65bf3c3ec55312d24d (/dev/raw/raw5) [OCR_VOTE] Located 3 voting disk(s). [root@rac1 ~]# |
8：修改spfile，将spfile写入新的OCR磁盘组
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
[grid@rac1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.2.0 Production on Sat Feb 8 11:26:26 2014 Copyright (c) 1982, 2010, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> show parameter spfile NAME TYPE VALUE ------------------------------------ ----------- ------------------------------------------------------- spfile string +OV/rac-cluster/asmparameterfile/registry.253.838208731 SQL> shutdown abort; ASM instance shutdown SQL> SQL> startup pfile='/home/grid/asm_pfile.ora'; ASM instance started Total System Global Area 283930624 bytes Fixed Size 2225792 bytes Variable Size 256539008 bytes ASM Cache 25165824 bytes ASM diskgroups mounted SQL> SQL> show parameter spfile NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ spfile string SQL> SQL> create spfile='+OCR_VOTE' from pfile='/home/grid/asm_pfile.ora'; File created. SQL> shutdown abort; ASM instance shutdown SQL> SQL> SQL> startup ASM instance started Total System Global Area 283930624 bytes Fixed Size 2225792 bytes Variable Size 256539008 bytes ASM Cache 25165824 bytes ASM diskgroups mounted SQL> SQL> show parameter spfile; NAME TYPE VALUE ------------------------------------ ----------- ---------------------------------------------------------------- spfile string +OCR_VOTE/rac-cluster/asmparameterfile/registry.253.838985395 SQL> |
9：启动2节点crs
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
[root@rac2 ~]# crsctl start crs CRS-4123: Oracle High Availability Services has been started. [root@rac2 ~]# --此时执行ocrcheck将报如下错误 [root@rac2 ~]# ocrcheck PROT-602: Failed to retrieve data from the cluster registry PROC-26: Error while accessing the physical storage [root@rac2 ~]# --产生如上错误信息的情况有好多种，但就本测试而言是因为/etc/oracle/ocr.loc文件中的配置信息没有更改。 [root@rac2 ~]# cat /etc/oracle/ocr.loc ocrconfig_loc=+OV local_only=FALSE [root@rac2 ~]# --修改后如下： [root@rac2 ~]# cat /etc/oracle/ocr.loc ocrconfig_loc=+OCR_VOTE local_only=FALSE [root@rac2 ~]# --再次启动crs，本测试把节点1的crs也关闭了，重新全部重启了一下。 [root@rac1 ~]# crsctl stop cluster -all …… [root@rac1 ~]# crsctl start cluster -all …… --完美启动crs [root@rac2 ~]# crsctl stat res -t -------------------------------------------------------------------------------- NAME TARGET STATE SERVER STATE_DETAILS -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.DATA.dg ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.LISTENER.lsnr ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.OCR_VOTE.dg ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.OV.dg ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.asm ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.gsd OFFLINE OFFLINE rac1 OFFLINE OFFLINE rac2 ora.net1.network ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.ons ONLINE ONLINE rac1 ONLINE ONLINE rac2 -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE rac2 ora.cvu 1 ONLINE ONLINE rac2 ora.oc4j 1 ONLINE ONLINE rac2 ora.rac1.vip 1 ONLINE ONLINE rac1 ora.rac2.vip 1 ONLINE ONLINE rac2 ora.racdb.db 1 OFFLINE OFFLINE 2 OFFLINE OFFLINE ora.scan1.vip 1 ONLINE ONLINE rac2 [root@rac2 ~]# |
10： 启动数据库
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
[root@rac1 ~]# srvctl start database -d racdb [root@rac1 ~]# crsctl stat res -t -------------------------------------------------------------------------------- NAME TARGET STATE SERVER STATE_DETAILS -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.DATA.dg ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.LISTENER.lsnr ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.OCR_VOTE.dg ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.OV.dg ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.asm ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.gsd OFFLINE OFFLINE rac1 OFFLINE OFFLINE rac2 ora.net1.network ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.ons ONLINE ONLINE rac1 ONLINE ONLINE rac2 -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE rac2 ora.cvu 1 ONLINE ONLINE rac2 ora.oc4j 1 ONLINE ONLINE rac2 ora.rac1.vip 1 ONLINE ONLINE rac1 ora.rac2.vip 1 ONLINE ONLINE rac2 ora.racdb.db 1 ONLINE ONLINE rac1 Open 2 ONLINE ONLINE rac2 Open ora.scan1.vip 1 ONLINE ONLINE rac2 [root@rac1 ~]# |