Linux + Oracle 11g R2 RAC 安装配置详细过程

kangxinfei

贡献于2013-03-26

字数:0 关键词: Oracle 数据库服务器

D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 作者:mfkqwyc86 QQ:113257174 itpub空间:http://space.itpub.net/9664900 环境: Oracle Linux AS 5.5两台 Oracle 11g R2 1、IP规划 127.0.0.1 localhost.localdomain localhost #public ip 192.168.10.211 rac1 192.168.10.212 rac2 #priv ip 10.10.10.211 rac1prv 10.10.10.212 rac2prv #vip ip 192.168.10.213 rac1vip 192.168.10.214 rac2vip #scan ip 192.168.10.215 racscan 2、磁盘规划 +CRS 三个2G的盘 +DGDATA 三个10G的盘 +DGRECOVERY 两个5G的盘 /usr/sbin/groupadd -g 501 oinstall /usr/sbin/groupadd -g 502 dba /usr/sbin/groupadd -g 503 oper /usr/sbin/groupadd -g 504 asmadmin /usr/sbin/groupadd -g 505 asmoper /usr/sbin/groupadd -g 506 asmdba /usr/sbin/useradd -g oinstall -G dba,asmdba,oper oracle /usr/sbin/useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid [root@ora1 ~]# id oracle uid=501(oracle) gid=501(oinstall) groups=501(oinstall),502(dba),503(oper),506(asmdba) [root@ora1 ~]# id grid uid=502(grid) gid=501(oinstall) groups=501(oinstall),502(dba),503(oper),504(asmadmin),505(asmoper),506(asmdba) mkdir /oracle/app/ chown -R grid:oinstall /oracle/app/ chmod -R 775 /oracle/app/ mkdir -p /oracle/app/oraInventory chown -R grid:oinstall /oracle/app/oraInventory chmod -R 775 /oracle/app/oraInventory mkdir -p /oracle/app/grid mkdir -p /oracle/app/oracle chown -R grid:oinstall /oracle/app/grid chown -R oracle:oinstall /oracle/app/oracle chmod -R 775 /oracle/app/oracle chmod -R 775 /oracle/app/grid passwd grid -1- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 passwd oracle 2、操作系统版本: [root@rac1 ~]# lsb_release -a LSB Version: :core-3.1-ia32:core-3.1-noarch:graphics-3.1-ia32:graphics-3.1-noarch Distributor ID: EnterpriseEnterpriseServer Description: Enterprise Linux Enterprise Linux Server release 5.5 (Carthage) Release: 5.5 Codename: Carthage [root@rac1 ~]# uname -a Linux rac1 2.6.18-194.el5 #1 SMP Mon Mar 29 20:06:41 EDT 2010 i686 i686 i386 GNU/Linux [root@rac1 ~]# 修改系统参数: vi /etc/security/limits.conf #ORACLE SETTING grid soft nproc 2047 grid hard nproc 16384 grid soft nofile 1024 grid hard nofile 65536 oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 vi /etc/pam.d/login #ORACLE SETTING session required pam_limits.so # vi /etc/sysctl.conf #ORACLE SETTING fs.aio-max-nr = 1048576 fs.file-max = 6815744 kernel.shmall = 2097152 kernel.shmmax = 536870912 kernel.shmmni = 4096 kernel.sem = 250 32000 100 128 net.ipv4.ip_local_port_range = 9000 65500 net.core.rmem_default = 262144 net.core.rmem_max = 4194304 net.core.wmem_default = 262144 net.core.wmem_max = 1048586 gird时间同步所需要的设置(11gR2新增检查项) #Network Time Protocol Setting /sbin/service ntpd stop chkconfig ntpd off rm /etc/ntp.conf mv /etc/ntp.conf to /etc/ntp.conf.org /dev/shm 共享内存不足的处理 解决方法: 例如:为了将/dev/shm的大小增加到1GB,修改/etc/fstab的这行:默认的: none /dev/shm tmpfs defaults 0 0 改成: none /dev/shm tmpfs defaults,size=1024m 0 0 size参数也可以用G作单位:size=1G。 重新mount /dev/shm使之生效: # mount -o remount /dev/shm -2- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 或者: # umount /dev/shm # mount -a 马上可以用"df -h"命令检查变化。 修改gird、oracle用户的.bash_profile文件: #grid 用户配置文件 ORACLE_HOSTNAME请自行设置 TMP=/tmp; export TMP TMPDIR=$TMP; export TMPDIR ORACLE_SID=+ASM1; export ORACLE_SID ORACLE_BASE=/oracle/app/oracle; export ORACLE_BASE ORACLE_HOME=/oracle/app/grid/product/11.2.0; export ORACLE_HOME NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT THREADS_FLAG=native; export THREADS_FLAG PATH=$ORACLE_HOME/bin:$PATH; export PATH THREADS_FLAG=native; export THREADS_FLAG PATH=$ORACLE_HOME/bin:$PATH; export PATH if [ $USER = "oracle" ] || [ $USER = "grid" ]; then if [ $SHELL = "/bin/ksh" ]; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi umask 022 fi #oracle用户配置文件 ORACLE_HOSTNAME请自行设置 # Oracle Settings oracle TMP=/tmp; export TMP TMPDIR=$TMP; export TMPDIR ORACLE_BASE=/oracle/app/oracle; export ORACLE_BASE ORACLE_HOME=$ORACLE_BASE/product/11.2.0; export ORACLE_HOME ORACLE_SID=racdb1; export ORACLE_SID ORACLE_TERM=xterm; export ORACLE_TERM PATH=/usr/sbin:$PATH; export PATH PATH=$ORACLE_HOME/bin:$PATH; export PATH LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATH CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT NLS_LANG=AMERICAN_AMERICA.ZHS16GBK;export NLS_LANG if [ $USER = "oracle" ] || [ $USER = "grid" ]; then if [ $SHELL = "/bin/ksh" ]; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi umask 022 fi 配置信任关系 设置SSH, -3- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 1).在主节点RAC1上以grid,oracle用户身份生成用户的公匙和私匙 # ping rac2-eth0 # ping rac2-eth1 # su - oracle $ mkdir ~/.ssh $ ssh-keygen -t rsa $ ssh-keygen -t dsa 2).在副节点RAC2、RAC3上执行相同的操作,确保通信无阻 # ping rac1-eth0 # ping rac1-eth1 # su - oracle $ mkdir ~/.ssh $ ssh-keygen -t rsa $ ssh-keygen -t dsa 3).在主节点RAC1上oracle用户执行以下操作 $ cat ~/.ssh/id_rsa.pub >> ./.ssh/authorized_keys $ cat ~/.ssh/id_dsa.pub >> ./.ssh/authorized_keys $ ssh rac2 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys $ ssh rac2 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys $ scp ~/.ssh/authorized_keys rac2:~/.ssh/authorized_keys 4).主节点RAC1上执行检验操作 $ ssh rac1 date $ ssh rac2 date $ ssh rac3 date $ ssh rac1priv date $ ssh rac2priv date $ ssh rac3priv date 5).在副节点RAC2上执行检验操作 $ ssh rac1 date $ ssh rac2 date $ ssh rac3 date $ ssh rac1priv date $ ssh rac2priv date $ ssh rac3priv date 安装ASM oracleasm-2.6.18-194.el5-2.0.5-1.el5.i686.rpm oracleasmlib-2.0.4-1.el5.i386.rpm oracleasm-support-2.1.3-1.el5.i386.rpm 格式化硬盘 Disk /dev/sdd: 2147 MB, 2147483648 bytes 255 heads, 63 sectors/track, 261 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdd1 1 261 2096451 83 Linux Disk /dev/sde: 2147 MB, 2147483648 bytes 255 heads, 63 sectors/track, 261 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sde1 1 261 2096451 83 Linux Disk /dev/sdf: 2147 MB, 2147483648 bytes -4- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 255 heads, 63 sectors/track, 261 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdf1 1 261 2096451 83 Linux Disk /dev/sdg: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdg1 1 1305 10482381 83 Linux Disk /dev/sdh: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdh1 1 1305 10482381 83 Linux Disk /dev/sdi: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdi1 1 1305 10482381 83 Linux Disk /dev/sdj: 5368 MB, 5368709120 bytes 255 heads, 63 sectors/track, 652 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdj1 1 652 5237158+ 83 Linux Disk /dev/sdk: 5368 MB, 5368709120 bytes 255 heads, 63 sectors/track, 652 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdk1 1 652 5237158+ 83 Linux 配置ASM [root@ora1 ~]# /etc/init.d/oracleasm configure Configuring the Oracle ASM library driver. This will configure the on-boot properties of the Oracle ASM library driver. The following questions will determine whether the driver is loaded on boot and what permissions it will have. The current values will be shown in brackets ('[]'). Hitting without typing an answer will keep that current value. Ctrl-C will abort. Default user to own the driver interface []: grid Default group to own the driver interface []: asmadmin Start Oracle ASM library driver on boot (y/n) [n]: y Scan for Oracle ASM disks on boot (y/n) [y]: y Writing Oracle ASM library driver configuration: done Initializing the Oracle ASMLib driver: [ OK ] Scanning the system for Oracle ASMLib disks: [ OK ] 创建asm盘 -5- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 +CRS 三个2G的盘 +DGDATA 三个10G的盘 +DGRECOVERY 两个5G的盘 /dev/sdd: 2097152 /dev/sde: 2097152 /dev/sdf: 2097152 /dev/sdg: 10485760 /dev/sdh: 10485760 /dev/sdi: 10485760 /dev/sdj: 5242880 /dev/sdk: 5242880 [root@ora2 asm]# /etc/init.d/oracleasm createdisk CRS1 /dev/sdd1 Marking disk "CRS1" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm createdisk CRS2 /dev/sde1 Marking disk "CRS2" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm createdisk CRS3 /dev/sdf1 Marking disk "CRS3" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm createdisk DATA1 /dev/sdg1 Marking disk "DATA1" as an ASM disk: [FAILED] [root@ora2 asm]# /etc/init.d/oracleasm createdisk DATA1 /dev/sdg1 Marking disk "DATA1" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm createdisk DATA2 /dev/sdh1 Marking disk "DATA2" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm createdisk DATA3 /dev/sdi1 Marking disk "DATA3" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm createdisk REC1 /dev/sdj1 Marking disk "REC1" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm createdisk REC2 /dev/sdk1 Marking disk "REC2" as an ASM disk: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm scandisks Scanning the system for Oracle ASMLib disks: [ OK ] [root@ora2 asm]# /etc/init.d/oracleasm listdisks CRS1 CRS2 CRS3 DATA1 DATA2 DATA3 REC1 REC2 安装cvuqdisk包并验证 在两个 Oracle RAC 节点上安装操作系统程序包 cvuqdisk。如果没有 cvuqdisk,集群验证实用程序就无法发现共享磁盘,当运行(手动运行或在 Oracle Grid Infrastructure 安装结束时自动运行)集群验证实用程序时,您会收到这样的错误消息:“Package cvuqdisk not installed”。使用适用于您的硬件体系结构(例如,x86_64 或 i386)的 cvuqdisk RPM。 cvuqdisk RPM 包含在 Oracle Grid Infrastructure 安装介质上的 rpm 目录中。 设置环境变量 CVUQDISK_GRP,使其指向作为 cvuqdisk 的所有者所在的组(本文为 oinstall): export CVUQDISK_GRP=oinstall 使用 CVU 验证是否满足 Oracle 集群件要求 记住要作为 grid 用户在将要执行 Oracle 安装的节点 (racnode1) 上运行。此外,必须为 grid 用户配置通过用户等效性实现的 SSH 连通性。 在grid软件目录里运行以下命令: ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -fixup -verbose [grid@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -fixup -verbose -6- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Performing pre-checks for cluster services setup Checking node reachability... Check: Node reachability from node "rac1" Destination Node Reachable? ------------------------------------ ------------------------ rac2 yes rac1 yes Result: Node reachability check passed from node "rac1" Checking user equivalence... Check: User equivalence for user "grid" Node Name Comment ------------------------------------ ------------------------ rac2 passed rac1 passed Result: User equivalence check passed for user "grid" Checking node connectivity... Checking hosts config file... Node Name Status Comment ------------ ------------------------ ------------------------ rac2 passed rac1 passed Verification of the hosts config file successful Interface information for node "rac2" Name IP Address Subnet Gateway Def. Gateway HW Address MTU ------ --------------- --------------- --------------- --------------- ----------------- ------ eth0 192.168.10.212 192.168.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:F3:23 1500 eth1 10.10.10.212 10.10.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:F3:2D 1500 Interface information for node "rac1" Name IP Address Subnet Gateway Def. Gateway HW Address MTU ------ --------------- --------------- --------------- --------------- ----------------- ------ eth0 192.168.10.211 192.168.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:E3:03 1500 eth1 10.10.10.211 10.10.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:E3:0D 1500 Check: Node connectivity of subnet "192.168.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- rac2:eth0 rac1:eth0 yes Result: Node connectivity passed for subnet "192.168.10.0" with node(s) rac2,rac1 Check: TCP connectivity of subnet "192.168.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- -7- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 rac1:192.168.10.211 rac2:192.168.10.212 passed Result: TCP connectivity check passed for subnet "192.168.10.0" Check: Node connectivity of subnet "10.10.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- rac2:eth1 rac1:eth1 yes Result: Node connectivity passed for subnet "10.10.10.0" with node(s) rac2,rac1 Check: TCP connectivity of subnet "10.10.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- rac1:10.10.10.211 rac2:10.10.10.212 passed Result: TCP connectivity check passed for subnet "10.10.10.0" Interfaces found on subnet "192.168.10.0" that are likely candidates for VIP are: rac2 eth0:192.168.10.212 rac1 eth0:192.168.10.211 Interfaces found on subnet "10.10.10.0" that are likely candidates for a private interconnect are: rac2 eth1:10.10.10.212 rac1 eth1:10.10.10.211 Result: Node connectivity check passed Check: Total memory Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 887.82MB (909124.0KB) 1.5GB (1572864.0KB) failed rac1 887.82MB (909124.0KB) 1.5GB (1572864.0KB) failed Result: Total memory check failed Check: Available memory Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 802.25MB (821504.0KB) 50MB (51200.0KB) passed rac1 795.72MB (814816.0KB) 50MB (51200.0KB) passed Result: Available memory check passed Check: Swap space Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- Result: Swap space check failed Check: Free disk space for "rac2:/tmp" Path Node Name Mount point Available Required Comment ---------------- ------------ ------------ ------------ ------------ ------------ /tmp rac2 / 14.44GB 1GB passed Result: Free disk space check passed for "rac2:/tmp" Check: Free disk space for "rac1:/tmp" Path Node Name Mount point Available Required Comment ---------------- ------------ ------------ ------------ ------------ ------------ /tmp rac1 / 14.43GB 1GB passed Result: Free disk space check passed for "rac1:/tmp" Check: User existence for "grid" Node Name Status Comment ------------ ------------------------ ------------------------ rac2 exists passed -8- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 rac1 exists passed Result: User existence check passed for "grid" Check: Group existence for "oinstall" Node Name Status Comment ------------ ------------------------ ------------------------ rac2 exists passed rac1 exists passed Result: Group existence check passed for "oinstall" Check: Group existence for "dba" Node Name Status Comment ------------ ------------------------ ------------------------ rac2 exists passed rac1 exists passed Result: Group existence check passed for "dba" Check: Membership of user "grid" in group "oinstall" [as Primary] Node Name User Exists Group Exists User in Group Primary Comment ---------------- ------------ ------------ ------------ ------------ ------------ rac2 yes yes yes yes passed rac1 yes yes yes yes passed Result: Membership check for user "grid" in group "oinstall" [as Primary] passed Check: Membership of user "grid" in group "dba" Node Name User Exists Group Exists User in Group Comment ---------------- ------------ ------------ ------------ ---------------- rac2 yes yes yes passed rac1 yes yes yes passed Result: Membership check for user "grid" in group "dba" passed Check: Run level Node Name run level Required Comment ------------ ------------------------ ------------------------ ---------- rac2 5 3,5 passed rac1 5 3,5 passed Result: Run level check passed Check: Hard limits for "maximum open file descriptors" Node Name Type Available Required Comment ---------------- ------------ ------------ ------------ ---------------- rac2 hard 65536 65536 passed rac1 hard 65536 65536 passed Result: Hard limits check passed for "maximum open file descriptors" Check: Soft limits for "maximum open file descriptors" Node Name Type Available Required Comment ---------------- ------------ ------------ ------------ ---------------- rac2 soft 1024 1024 passed rac1 soft 1024 1024 passed Result: Soft limits check passed for "maximum open file descriptors" Check: Hard limits for "maximum user processes" Node Name Type Available Required Comment ---------------- ------------ ------------ ------------ ---------------- rac2 hard 16384 16384 passed rac1 hard 16384 16384 passed Result: Hard limits check passed for "maximum user processes" Check: Soft limits for "maximum user processes" Node Name Type Available Required Comment ---------------- ------------ ------------ ------------ ---------------- rac2 soft 2047 2047 passed rac1 soft 2047 2047 passed Result: Soft limits check passed for "maximum user processes" -9- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Check: System architecture Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 i686 x86 passed rac1 i686 x86 passed Result: System architecture check passed Check: Kernel version Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 2.6.18-194.el5 2.6.18 passed rac1 2.6.18-194.el5 2.6.18 passed Result: Kernel version check passed Check: Kernel parameter for "semmsl" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 250 250 passed rac1 250 250 passed Result: Kernel parameter check passed for "semmsl" Check: Kernel parameter for "semmns" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 32000 32000 passed rac1 32000 32000 passed Result: Kernel parameter check passed for "semmns" Check: Kernel parameter for "semopm" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 100 100 passed rac1 100 100 passed Result: Kernel parameter check passed for "semopm" Check: Kernel parameter for "semmni" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 128 128 passed rac1 128 128 passed Result: Kernel parameter check passed for "semmni" Check: Kernel parameter for "shmmax" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 536870912 536870912 passed rac1 536870912 536870912 passed Result: Kernel parameter check passed for "shmmax" Check: Kernel parameter for "shmmni" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 4096 4096 passed rac1 4096 4096 passed Result: Kernel parameter check passed for "shmmni" Check: Kernel parameter for "shmall" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 2097152 2097152 passed rac1 2097152 2097152 passed Result: Kernel parameter check passed for "shmall" Check: Kernel parameter for "file-max" -10- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 6815744 6815744 passed rac1 6815744 6815744 passed Result: Kernel parameter check passed for "file-max" Check: Kernel parameter for "ip_local_port_range" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 between 9000 & 65500 between 9000 & 65500 passed rac1 between 9000 & 65500 between 9000 & 65500 passed Result: Kernel parameter check passed for "ip_local_port_range" Check: Kernel parameter for "rmem_default" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 262144 262144 passed rac1 262144 262144 passed Result: Kernel parameter check passed for "rmem_default" Check: Kernel parameter for "rmem_max" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 4194304 4194304 passed rac1 4194304 4194304 passed Result: Kernel parameter check passed for "rmem_max" Check: Kernel parameter for "wmem_default" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 262144 262144 passed rac1 262144 262144 passed Result: Kernel parameter check passed for "wmem_default" Check: Kernel parameter for "wmem_max" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 1048586 1048576 passed rac1 1048586 1048576 passed Result: Kernel parameter check passed for "wmem_max" Check: Kernel parameter for "aio-max-nr" Node Name Configured Required Comment ------------ ------------------------ ------------------------ ---------- rac2 1048576 1048576 passed rac1 1048576 1048576 passed Result: Kernel parameter check passed for "aio-max-nr" Check: Package existence for "make-3.81" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 make-3.81-3.el5 make-3.81 passed rac1 make-3.81-3.el5 make-3.81 passed Result: Package existence check passed for "make-3.81" Check: Package existence for "binutils-2.17.50.0.6" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6 passed rac1 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6 passed Result: Package existence check passed for "binutils-2.17.50.0.6" Check: Package existence for "gcc-4.1.2" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- -11- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 rac2 gcc-4.1.2-48.el5 gcc-4.1.2 passed rac1 gcc-4.1.2-48.el5 gcc-4.1.2 passed Result: Package existence check passed for "gcc-4.1.2" Check: Package existence for "gcc-c++-4.1.2" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 gcc-c++-4.1.2-48.el5 gcc-c++-4.1.2 passed rac1 gcc-c++-4.1.2-48.el5 gcc-c++-4.1.2 passed Result: Package existence check passed for "gcc-c++-4.1.2" Check: Package existence for "libgomp-4.1.2" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 libgomp-4.4.0-6.el5 libgomp-4.1.2 passed rac1 libgomp-4.4.0-6.el5 libgomp-4.1.2 passed Result: Package existence check passed for "libgomp-4.1.2" Check: Package existence for "libaio-0.3.106" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 libaio-0.3.106-5 libaio-0.3.106 passed rac1 libaio-0.3.106-5 libaio-0.3.106 passed Result: Package existence check passed for "libaio-0.3.106" Check: Package existence for "glibc-2.5-24" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 glibc-2.5-49 glibc-2.5-24 passed rac1 glibc-2.5-49 glibc-2.5-24 passed Result: Package existence check passed for "glibc-2.5-24" Check: Package existence for "compat-libstdc++-33-3.2.3" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 compat-libstdc++-33-3.2.3-61 compat-libstdc++-33-3.2.3 passed rac1 compat-libstdc++-33-3.2.3-61 compat-libstdc++-33-3.2.3 passed Result: Package existence check passed for "compat-libstdc++-33-3.2.3" Check: Package existence for "elfutils-libelf-0.125" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 elfutils-libelf-0.137-3.el5 elfutils-libelf-0.125 passed rac1 elfutils-libelf-0.137-3.el5 elfutils-libelf-0.125 passed Result: Package existence check passed for "elfutils-libelf-0.125" Check: Package existence for "elfutils-libelf-devel-0.125" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125 passed rac1 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125 passed Result: Package existence check passed for "elfutils-libelf-devel-0.125" Check: Package existence for "glibc-common-2.5" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 glibc-common-2.5-49 glibc-common-2.5 passed rac1 glibc-common-2.5-49 glibc-common-2.5 passed Result: Package existence check passed for "glibc-common-2.5" Check: Package existence for "glibc-devel-2.5" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 glibc-devel-2.5-49 glibc-devel-2.5 passed rac1 glibc-devel-2.5-49 glibc-devel-2.5 passed -12- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Result: Package existence check passed for "glibc-devel-2.5" Check: Package existence for "glibc-headers-2.5" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 glibc-headers-2.5-49 glibc-headers-2.5 passed rac1 glibc-headers-2.5-49 glibc-headers-2.5 passed Result: Package existence check passed for "glibc-headers-2.5" Check: Package existence for "libaio-devel-0.3.106" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 missing libaio-devel-0.3.106 failed rac1 missing libaio-devel-0.3.106 failed Result: Package existence check failed for "libaio-devel-0.3.106" Check: Package existence for "libgcc-4.1.2" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 libgcc-4.1.2-48.el5 libgcc-4.1.2 passed rac1 libgcc-4.1.2-48.el5 libgcc-4.1.2 passed Result: Package existence check passed for "libgcc-4.1.2" Check: Package existence for "libstdc++-4.1.2" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 libstdc++-4.1.2-48.el5 libstdc++-4.1.2 passed rac1 libstdc++-4.1.2-48.el5 libstdc++-4.1.2 passed Result: Package existence check passed for "libstdc++-4.1.2" Check: Package existence for "libstdc++-devel-4.1.2" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 libstdc++-devel-4.1.2-48.el5 libstdc++-devel-4.1.2 passed rac1 libstdc++-devel-4.1.2-48.el5 libstdc++-devel-4.1.2 passed Result: Package existence check passed for "libstdc++-devel-4.1.2" Check: Package existence for "sysstat-7.0.2" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 sysstat-7.0.2-3.el5 sysstat-7.0.2 passed rac1 sysstat-7.0.2-3.el5 sysstat-7.0.2 passed Result: Package existence check passed for "sysstat-7.0.2" Check: Package existence for "unixODBC-2.2.11" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 unixODBC-2.2.11-7.1 unixODBC-2.2.11 passed rac1 unixODBC-2.2.11-7.1 unixODBC-2.2.11 passed Result: Package existence check passed for "unixODBC-2.2.11" Check: Package existence for "unixODBC-devel-2.2.11" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 unixODBC-devel-2.2.11-7.1 unixODBC-devel-2.2.11 passed rac1 unixODBC-devel-2.2.11-7.1 unixODBC-devel-2.2.11 passed Result: Package existence check passed for "unixODBC-devel-2.2.11" Check: Package existence for "ksh-20060214" Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 ksh-20100202-1.el5 ksh-20060214 passed rac1 ksh-20100202-1.el5 ksh-20060214 passed Result: Package existence check passed for "ksh-20060214" -13- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Checking for multiple users with UID value 0 Result: Check for multiple users with UID value 0 passed Check: Current group ID Result: Current group ID check passed Checking Core file name pattern consistency... Core file name pattern consistency check passed. Checking to make sure user "grid" is not in "root" group Node Name Status Comment ------------ ------------------------ ------------------------ rac2 does not exist passed rac1 does not exist passed Result: User "grid" is not part of "root" group. Check passed Check default user file creation mask Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- rac2 0022 0022 passed rac1 0022 0022 passed Result: Default user file creation mask check passed Starting Clock synchronization checks using Network Time Protocol(NTP)... NTP Configuration file check started... Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes Result: Clock synchronization check using Network Time Protocol(NTP) passed Pre-check for cluster services setup was unsuccessful on all the nodes. 使用 CVU 验证硬件和操作系统设置 ./runcluvfy.sh stage -post hwos -n rac1,rac2 -verbose [grid@rac1 grid]$ ./runcluvfy.sh stage -post hwos -n rac1,rac2 -verbose Performing post-checks for hardware and operating system setup Checking node reachability... Check: Node reachability from node "rac1" Destination Node Reachable? ------------------------------------ ------------------------ rac2 yes rac1 yes Result: Node reachability check passed from node "rac1" Checking user equivalence... Check: User equivalence for user "grid" Node Name Comment ------------------------------------ ------------------------ rac2 passed rac1 passed Result: User equivalence check passed for user "grid" Checking node connectivity... -14- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Checking hosts config file... Node Name Status Comment ------------ ------------------------ ------------------------ rac2 passed rac1 passed Verification of the hosts config file successful Interface information for node "rac2" Name IP Address Subnet Gateway Def. Gateway HW Address MTU ------ --------------- --------------- --------------- --------------- ----------------- ------ eth0 192.168.10.212 192.168.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:F3:23 1500 eth1 10.10.10.212 10.10.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:F3:2D 1500 Interface information for node "rac1" Name IP Address Subnet Gateway Def. Gateway HW Address MTU ------ --------------- --------------- --------------- --------------- ----------------- ------ eth0 192.168.10.211 192.168.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:E3:03 1500 eth1 10.10.10.211 10.10.10.0 0.0.0.0 192.168.10.1 00:0C:29:76:E3:0D 1500 Check: Node connectivity of subnet "192.168.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- rac2:eth0 rac1:eth0 yes Result: Node connectivity passed for subnet "192.168.10.0" with node(s) rac2,rac1 Check: TCP connectivity of subnet "192.168.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- rac1:192.168.10.211 rac2:192.168.10.212 passed Result: TCP connectivity check passed for subnet "192.168.10.0" Check: Node connectivity of subnet "10.10.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- rac2:eth1 rac1:eth1 yes Result: Node connectivity passed for subnet "10.10.10.0" with node(s) rac2,rac1 Check: TCP connectivity of subnet "10.10.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- rac1:10.10.10.211 rac2:10.10.10.212 passed Result: TCP connectivity check passed for subnet "10.10.10.0" Interfaces found on subnet "192.168.10.0" that are likely candidates for VIP are: rac2 eth0:192.168.10.212 rac1 eth0:192.168.10.211 Interfaces found on subnet "10.10.10.0" that are likely candidates for a private interconnect are: -15- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 rac2 eth1:10.10.10.212 rac1 eth1:10.10.10.211 Result: Node connectivity check passed Checking for multiple users with UID value 0 Result: Check for multiple users with UID value 0 passed Post-check for hardware and operating system setup was successful. 6、 su - grid ./runInstaller scan配置: cluster scan: sanclusters scanname: racscan scanport: 1521 /oracle/app/oraInventory/orainstRoot.sh [root@rac1 soft]# /oracle/app/oraInventory/orainstRoot.sh Changing permissions of /oracle/app/oraInventory. Adding read,write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /oracle/app/oraInventory to oinstall. The execution of the script is complete. [root@rac2 soft]# /oracle/app/oraInventory/orainstRoot.sh Changing permissions of /oracle/app/oraInventory. Adding read,write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /oracle/app/oraInventory to oinstall. The execution of the script is complete. /oracle/app/grid/product/11.2.0/root.sh [root@rac1 soft]# /oracle/app/oraInventory/orainstRoot.sh Changing permissions of /oracle/app/oraInventory. Adding read,write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /oracle/app/oraInventory to oinstall. The execution of the script is complete. [root@rac1 soft]# /oracle/app/grid/product/11.2.0/root.sh Running Oracle 11g root.sh script... The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /oracle/app/grid/product/11.2.0 Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... -16- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2010-07-28 16:19:03: Parsing the host name 2010-07-28 16:19:03: Checking for super user privileges 2010-07-28 16:19:03: User has super user privileges Using configuration parameter file: /oracle/app/grid/product/11.2.0/crs/install/crsconfig_params Creating trace directory LOCAL ADD MODE Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started. ohasd is starting CRS-4123: Oracle High Availability Services has been started. ohasd is starting CRS-2672: Attempting to start 'ora.gipcd' on 'rac1' CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1' CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1' CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1' CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac1' CRS-2672: Attempting to start 'ora.diskmon' on 'rac1' CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'rac1' CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded ASM created and started successfully. DiskGroup CRS created successfully. clscfg: -install mode specified Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. -17- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Operation successful. CRS-2672: Attempting to start 'ora.crsd' on 'rac1' CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded CRS-4256: Updating the profile Successful addition of voting disk a81aaf52b2b74ff5bf7a773e7966ea7c. Successfully replaced voting disk group with +CRS. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE a81aaf52b2b74ff5bf7a773e7966ea7c (ORCL:CRS1) [CRS] Located 1 voting disk(s). CRS-2673: Attempting to stop 'ora.crsd' on 'rac1' CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac1' CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1' CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'rac1' CRS-2677: Stop of 'ora.cssdmonitor' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac1' CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1' CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1' CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1' CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1' CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'rac1' CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1' CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1' CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac1' CRS-2672: Attempting to start 'ora.diskmon' on 'rac1' CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'rac1' CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'rac1' CRS-2676: Start of 'ora.asm' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'rac1' CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'rac1' CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'rac1' CRS-2676: Start of 'ora.asm' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.CRS.dg' on 'rac1' CRS-2676: Start of 'ora.CRS.dg' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.registry.acfs' on 'rac1' CRS-2676: Start of 'ora.registry.acfs' on 'rac1' succeeded rac1 2010/07/28 16:31:27 /oracle/app/grid/product/11.2.0/cdata/rac1/backup_20100728_163127.olr Configure Oracle Grid Infrastructure for a Cluster ... succeeded Updating inventory properties for clusterware Starting Oracle Universal Installer... Checking swap space: must be greater than 500 MB. Actual 971 MB Passed The inventory pointer is located at /etc/oraInst.loc The inventory is located at /oracle/app/oraInventory 'UpdateNodeList' was successful. -18- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 [root@rac2 soft]# /oracle/app/grid/product/11.2.0/root.sh Running Oracle 11g root.sh script... The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /oracle/app/grid/product/11.2.0 Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying dbhome to /usr/local/bin ... The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying oraenv to /usr/local/bin ... The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying coraenv to /usr/local/bin ... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2010-08-02 14:32:28: Parsing the host name 2010-08-02 14:32:28: Checking for super user privileges 2010-08-02 14:32:28: User has super user privileges Using configuration parameter file: /oracle/app/grid/product/11.2.0/crs/install/crsconfig_params Creating trace directory LOCAL ADD MODE Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started. ohasd is starting CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating An active cluster was found during exclusive startup, restarting to join the cluster CRS-2672: Attempting to start 'ora.mdnsd' on 'rac2' CRS-2676: Start of 'ora.mdnsd' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'rac2' CRS-2676: Start of 'ora.gipcd' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'rac2' CRS-2676: Start of 'ora.gpnpd' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2' CRS-2676: Start of 'ora.cssdmonitor' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac2' CRS-2672: Attempting to start 'ora.diskmon' on 'rac2' CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'rac2' CRS-2676: Start of 'ora.ctssd' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac2' CRS-2676: Start of 'ora.drivers.acfs' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.asm' on 'rac2' CRS-2676: Start of 'ora.asm' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'rac2' CRS-2676: Start of 'ora.crsd' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'rac2' CRS-2676: Start of 'ora.evmd' on 'rac2' succeeded rac2 2010/08/02 14:37:51 /oracle/app/grid/product/11.2.0/cdata/rac2/backup_20100802_143751.olr -19- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 Configure Oracle Grid Infrastructure for a Cluster ... succeeded Updating inventory properties for clusterware Starting Oracle Universal Installer... Checking swap space: must be greater than 500 MB. Actual 1202 MB Passed The inventory pointer is located at /etc/oraInst.loc The inventory is located at /oracle/app/oraInventory 'UpdateNodeList' was successful. [grid@rac2 ~]$ srvctl enable oc4j PRKO-2116 : OC4J is already enabled [grid@rac2 ~]$ srvctl start oc4j [grid@rac2 ~]$ srvctl enable nodeapps PRKO-2415 : VIP is already enabled on node(s): rac1,rac2 PRKO-2416 : Network resource is already enabled. PRKO-2417 : ONS is already enabled on node(s): rac1,rac2 PRKO-2418 : eONS is already enabled on node(s): rac1,rac2 [grid@rac2 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora.CRS.dg ora....up.type ONLINE ONLINE rac1 ora....ER.lsnr ora....er.type ONLINE ONLINE rac1 ora....N1.lsnr ora....er.type ONLINE ONLINE rac1 ora.asm ora.asm.type ONLINE ONLINE rac1 ora.eons ora.eons.type ONLINE ONLINE rac1 ora.gsd ora.gsd.type ONLINE ONLINE rac1 ora....network ora....rk.type ONLINE ONLINE rac1 ora.oc4j ora.oc4j.type ONLINE ONLINE rac2 ora.ons ora.ons.type ONLINE ONLINE rac1 ora....SM1.asm application ONLINE ONLINE rac1 ora....C1.lsnr application ONLINE ONLINE rac1 ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip ora....t1.type ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip ora....t1.type ONLINE ONLINE rac2 ora....ry.acfs ora....fs.type ONLINE ONLINE rac1 ora.scan1.vip ora....ip.type ONLINE ONLINE rac1 资源组状态: crsctl status resource -t [grid@rac2 ~]$ crsctl status resource -t -------------------------------------------------------------------------------- NAME TARGET STATE SERVER STATE_DETAILS -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.CRS.dg ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.LISTENER.lsnr ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.asm ONLINE ONLINE rac1 Started ONLINE ONLINE rac2 Started ora.eons ONLINE ONLINE rac1 -20- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 ONLINE ONLINE rac2 ora.gsd ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.net1.network ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.ons ONLINE ONLINE rac1 ONLINE ONLINE rac2 ora.registry.acfs ONLINE ONLINE rac1 ONLINE ONLINE rac2 -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE rac1 ora.oc4j 1 ONLINE ONLINE rac2 ora.rac1.vip 1 ONLINE ONLINE rac1 ora.rac2.vip 1 ONLINE ONLINE rac2 ora.scan1.vip 1 ONLINE ONLINE rac1 检查集群节点: olsnodes -l 检查 Oracle 集群注册表 (OCR): ocrcheck [grid@rac1 ~]$ ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2404 Available space (kbytes) : 259716 ID : 1095774749 Device/File Name : +CRS Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check bypassed due to non-privileged user [grid@rac2 ~]$ ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2404 Available space (kbytes) : 259716 -21- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 ID : 1095774749 Device/File Name : +CRS Device/File integrity check failed Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check failed Logical corruption check bypassed due to insufficient quorum 检查表决磁盘: crsctl query css votedisk [grid@rac1 ~]$ crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 589c0071c9304fecbff651e64eeb281a (ORCL:CRS1) [CRS] Located 1 voting disk(s). Oc4j,gsd服务默认是disable的,如果要启动,启用即可 [node1:grid]srvctl status oc4j OC4J is disabled [node1: grid]srvctl status nodeapps VIP node1-vip is enabled VIP node1-vip is running on node: node1 VIP node2-vip is enabled VIP node2-vip is running on node: node2 Network is enabled Network is running on node: node1 Network is running on node: node2 GSD is disabled GSD is not running on node: node1 GSD is not running on node: node2 ONS is enabled ONS daemon is running on node: node1 ONS daemon is running on node: node2 eONS is enabled eONS daemon is running on node: node1 eONS daemon is running on node: node2 [node1:grid]$srvctl enable oc4j [node1:grid]$srvctl start oc4j [node1:grid]$srvctl enable nodeapps [node1:grid]$srvctl start nodeapps 重启grid cluster 为数据和快速恢复区创建 ASM 磁盘组: asmca su - oracle -22- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 ./runInstaller [root@rac2 ~]# /oracle/app/oracle/product/11.2.0/root.sh Running Oracle 11g root.sh script... The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /oracle/app/oracle/product/11.2.0 Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying dbhome to /usr/local/bin ... The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying oraenv to /usr/local/bin ... The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying coraenv to /usr/local/bin ... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. Finished product-specific root actions. [root@rac2 ~]# crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora.CRS.dg ora....up.type ONLINE ONLINE rac1 ora.DGDATA.dg ora....up.type ONLINE ONLINE rac1 ora....VERY.dg ora....up.type ONLINE ONLINE rac1 ora....ER.lsnr ora....er.type ONLINE ONLINE rac1 ora....N1.lsnr ora....er.type ONLINE ONLINE rac2 ora.asm ora.asm.type ONLINE ONLINE rac1 ora.eons ora.eons.type ONLINE ONLINE rac1 ora.gsd ora.gsd.type ONLINE ONLINE rac1 ora....network ora....rk.type ONLINE ONLINE rac1 ora.oc4j ora.oc4j.type ONLINE ONLINE rac2 ora.ons ora.ons.type ONLINE ONLINE rac1 ora....SM1.asm application ONLINE ONLINE rac1 ora....C1.lsnr application ONLINE ONLINE rac1 ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip ora....t1.type ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip ora....t1.type ONLINE ONLINE rac2 ora....ry.acfs ora....fs.type ONLINE ONLINE rac1 ora.scan1.vip ora....ip.type ONLINE ONLINE rac2 su - oracle ./dbca 手工配置services (命令注册不能用与DB相同的service名) -23- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 srvctl add service -d -s -r "" [-a ""] [-P ] [root@rac1 backup]# srvctl add service -h Usage: srvctl add service -d -s -r "" [-a ""] [-P ] -d Unique name for the database -s Service name -r "" List of preferred instances -a "" List of available instances -P TAF policy (NONE, BASIC, or PRECONNECT) Usage: srvctl add service -d -s -u {-r "" | -a ""} -d Unique name for the database -s Service name -u Add a new instance to service configuration -r Name of new preferred instance -a Name of new available instance -h Print usage /oracle/app/crs/bin/srvctl add service -d racdb -s racdb_s racdb1 -a racdb2 -P BASIC /oracle/app/crs/bin/srvctl add service -d racdb -s racdb_s -r racdb1,racdb2 -P BASIC (建议) [root@rac2 ~]# crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac1 ora....C1.lsnr application ONLINE ONLINE rac1 ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip application ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip application ONLINE ONLINE rac2 ora.racdb.db application ONLINE ONLINE rac1 ora....b1.inst application ONLINE ONLINE rac1 ora....b2.inst application ONLINE ONLINE rac2 ora....db_s.cs application ONLINE ONLINE rac1 ora....db1.srv application ONLINE ONLINE rac1 ora....db2.srv application ONLINE ONLINE rac2 与之前不同service名后,则数据库会自己变为新的service名字,如下: NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ service_names string racdb_s 7、crs_stat -t [oracle@rac2 bin]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip application ONLINE ONLINE rac1 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip application ONLINE ONLINE rac2 -24- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 ALTER DISKGROUP RACDISK DROP DISK RACDISK_0001 REBALANCE POWER 11; 8、rac status [oracle@rac2 bin]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac1 ora....C1.lsnr application ONLINE ONLINE rac1 ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip application ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip application ONLINE ONLINE rac2 ora.racdb.db application ONLINE ONLINE rac2 ora....acdb.cs application ONLINE ONLINE rac1 ora....db1.srv application ONLINE ONLINE rac1 ora....db2.srv application ONLINE ONLINE rac2 ora....b1.inst application ONLINE ONLINE rac1 ora....b2.inst application ONLINE ONLINE rac2 ############################################ 9、listener.ora与tnsnames.ora listener.ora: LISTENER_RAC1 = (DESCRIPTION_LIST = (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.21)(PORT = 1521)(IP = FIRST)) (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.11)(PORT = 1521)(IP = FIRST)) ) ) SID_LIST_LISTENER_RAC1 = (SID_LIST = (SID_DESC = (SID_NAME = PLSExtProc) (ORACLE_HOME = /oracle/app/product/10.2.0/db_1) (PROGRAM = extproc) ) ) tnsnames: RACDB1 = (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.21)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = racdb) (INSTANCE_NAME = racdb1) ) ) RACDB = (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.21)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.22)(PORT = 1521)) -25- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 (LOAD_BALANCE = yes) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = racdb) (FAILOVER_MODE = (TYPE = SELECT) (METHOD = BASIC) (RETRIES = 180) (DELAY = 5) ) ) ) LISTENERS_RACDB = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.21)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.22)(PORT = 1521)) ) LISTENERS_RACDB1 = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.21)(PORT = 1521)) ) LISTENERS_RACDB2 = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.22)(PORT = 1521)) ) EXTPROC_CONNECTION_DATA = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC0)) ) (CONNECT_DATA = (SID = PLSExtProc) (PRESENTATION = RO) ) ) RACDB2 = (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.10.22)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = racdb) (INSTANCE_NAME = racdb2) ) ) alter system set LOCAL_LISTENER = 'LISTENERS_RACDB1' scope=both sid='racdb1'; alter system set REMOTE_LISTENER = 'LISTENERS_RACDB' scope=both sid='racdb1'; alter system set LOCAL_LISTENER = 'LISTENERS_RACDB2' scope=both sid='racdb2'; alter system set REMOTE_LISTENER = 'LISTENERS_RACDB' scope=both sid='racdb2'; ############################################ 10、配置启动归档及闪回 --先配归档才可以启动闪回 alter system set cluster_database=false scope=spfile -26- D:\Backup\desktop\【Oracle RAC】Linux + Oracle 11g R2 RAC 安装配置详细过程.txt 2010年10月27日 10:22 #alter system set db_recovery_file_dest='D:\oracle\flashdb' scope=both; alter system switch logfile; startup mount alter database archivelog; alter system set cluster_database=true scope=spfile shutdown immediate; startup SQL> archive log list; Database log mode Archive Mode Automatic archival Enabled Archive destination USE_DB_RECOVERY_FILE_DEST Oldest online log sequence 11 Next log sequence to archive 12 Current log sequence 12 SQL> select max(sequence#) from v$archived_log col NAME format a80 SQL> select SEQUENCE#,NAME,FIRST_TIME, NEXT_TIME FROM v$ARCHIVED_LOG ORDER BY SEQUENCE#; SEQUENCE# NAME FIRST_TIME NEXT_TIME ---------- ----------------------------- 11 +DG_RECOVERY/racdb/archivelog/2010_05_18/thread_2_seq_11.257.719357641 18-MAY-10 18-MAY-10 --查看归档丢失的情况: SELECT THREAD#,LOW_SEQUENCE#,HIGH_SEQUENCE# from v$archive_gap; --启动闪回 alter system set db_recovery_file_dest_size=2g scope=both; alter system set db_recovery_file_dest='+DG_RECOVERY' scope=both; alter database flashback ON; SQL> show parameter recovery NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ db_recovery_file_dest string +DG_RECOVERY db_recovery_file_dest_size big integer 2G recovery_parallelism integer 0 -27-

下载文档,方便阅读与编辑

文档的实际排版效果,会与网站的显示效果略有不同!!

需要 5 金币 [ 分享文档获得金币 ] 14 人已下载

下载文档

相关文档