测试环境：os:rhel 5 db:11.2.0.3.7(gi) sfrac:5.1
1,配置ip地址与hosts文件
linux平台配置IP地址相当的方面，达到了aix smit mktcpip那么简单，使用setup或者system-network-config完成，配置完ip地址后，在hosts文件中增加下面内容
#############public ip############### 192.168.111.62 rac41 192.168.111.63 rac42 #############public-vip############## 192.168.111.64 rac41-vip 192.168.111.65 rac42-vip #############scan#################### 192.168.111.66 rac4-scan #############private################# 192.168.112.62 rac41-priv 192.168.112.63 rac42-priv 192.168.113.62 rac411-priv 192.168.113.63 rac421-priv
2，增加sfrac的环境变量
[root@rac41 ~]# tail -2 .bash_profile export MANPATH=$MANPATH:/opt/VRTS/man export PATH=/usr/sbin:/sbin:/usr/bin:/usr/lib/vxvm/bin:/opt/VRTSvcs/bin:/opt/VRTS/bin:/opt/VRTSvcs/rac/bin:/opt/VRTSob/bin:$PATH; 3，增加gi/rdbms环境变量 ORACLE_BASE=/u01/11.2.0/grid GRID_HOME=/u01/app/oraInventory ORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1 export PATH=$GRID_HOME/bin:$ORACLE_HOME/bin:$PATH
3，上传并解压文件
[root@rac41 tmp]# ls -l rhel5_x86_64_basic.zip -rw-r--r-- 1 root root 361220978 May 17 14:35 rhel5_x86_64_basic.zip [root@rac41 tmp]# unzip rhel5_x86_64_basic.zip Archive: rhel5_x86_64_basic.zip
4，安装sfrac
[root@rac41 tmp]# source ~/.bash_profile [root@rac41 tmp]# rm rhel5_x86_64_basic.zip rm: remove regular file `rhel5_x86_64_basic.zip'? y [root@rac41 tmp]# chmod -R 777 /tmp/rhel5_x86_64 [root@rac41 tmp]# cd rhel5_x86_64/ [root@rac41 rhel5_x86_64]# cd storage_foundation_for_oracle_rac/ [root@rac41 storage_foundation_for_oracle_rac]# ./installsfrac rac41 rac42 Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program rac41 rac42 Copyright (c) 2010 Symantec Corporation. All rights reserved. Symantec, the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. The Licensed Software and Documentation are deemed to be "commercial computer software" and "commercial computer software documentation" as defined in FAR Sections 12.212 and DFARS Section 227.7202. Logs are being written to /var/tmp/installsfrac-201309130706Fuf while installsfrac is in progress. Do you agree with the terms of the End User License Agreement as specified in the storage_foundation_for_oracle_rac/EULA/en/EULA_SF_Oracle_Rac_Ux_5.1SP1.pdf file present on media? [y,n,q,?] y Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program rac41 rac42 1) Install minimal required Veritas Storage Foundation for Oracle RAC rpms - 416 MB required 2) Install recommended Veritas Storage Foundation for Oracle RAC rpms - 587 MB required 3) Install all Veritas Storage Foundation for Oracle RAC rpms - 624 MB required 4) Display rpms to be installed for each option Select the rpms to be installed on all systems? [1-4,q,?] (2) 3 Logs are being written to /var/tmp/installsfrac-201309130706Fuf while installsfrac is in progress Verifying systems: 12% __________________________________________________________________ Estimated time remaining: 7:25 1 of 8 Checking system communication ................................................................ Done Either ssh or rsh is needed to be setup between the local node and rac42 for communication Would you like the installer to setup ssh/rsh communication automatically between the nodes? Superuser passwords for the systems will be asked. [y,n,q] (y) 回车 Enter the superuser password for system rac42: 输入root用户密码 1) Setup ssh between the nodes 2) Setup rsh between the nodes Select the communication method [1-2,q,?] (1) 回车 Setting up communication between systems. Please wait. Logs are being written to /var/tmp/installsfrac-201309130706Fuf while installsfrac is in progress Verifying systems: 100% Estimated time remaining: 0:00 8 of 8 Checking system communication ................................................................ Done Checking release compatibility ............................................................... Done Checking installed product ................................................................... Done Checking prerequisite patches and rpms ....................................................... Done Checking platform version .................................................................... Done Checking file space .......................................................................... Done Performing product license checks ............................................................ Done Performing product prechecks ................................................................. Done System verification checks completed successfully The following warnings were discovered on the systems: You have only 1 CPU in system rac41. It is required that you run SFRAC on servers with more than 1 CPU. You have only 1 CPU in system rac42. It is required that you run SFRAC on servers with more than 1 CPU. Do you want to continue? [y,n,q] (y) 回车 The following Veritas Storage Foundation for Oracle RAC rpms will be installed on all systems: Rpm Rpm Description VRTSvlic Veritas Licensing VRTSperl Veritas Perl 5.10.0 Redistribution VRTSspt Veritas Software Support Tools by Symantec VRTSvxvm Veritas Volume Manager Binaries VRTSaslapm Volume Manager - ASL/APM VRTSob Veritas Enterprise Administrator Service by Symantec VRTSlvmconv Veritas Linux LVM to VxVM Converter VRTSsfmh Veritas Storage Foundation Managed Host by Symantec VRTSvxfs Veritas File System VRTSfssdk Veritas File System Software Developer Kit VRTSatClient Symantec Product Authentication Service Client VRTSatServer Symantec Product Authentication Service VRTSllt Veritas Low Latency Transport VRTSgab Veritas Group Membership and Atomic Broadcast VRTSvxfen Veritas I/O Fencing by Symantec VRTSamf Veritas Asynchronous Monitoring Framework by Symantec VRTSvcs Veritas Cluster Server VRTScps Veritas Cluster Server - Coordinated Point Server VRTSvcsag Veritas Cluster Server Bundled Agents by Symantec VRTSvcsdr Veritas Cluster Server Disk Reservation Modules VRTSvcsea Veritas Cluster Server Enterprise Agents by Symantec VRTSdbed Veritas Storage Foundation Databases VRTSglm Veritas Group Lock Manager VRTScavf Veritas Cluster Server Agents for Cluster File System VRTSgms Veritas Group Messaging Services VRTSodm Veritas Oracle Disk Manager VRTSdbac Veritas Oracle Real Application Cluster Support Package by Symantec Press [Enter] to continue: 回车，开始安装 To comply with the terms of Symantec's End User License Agreement, you have 60 days to either: * Enter a valid license key matching the functionality in use on the systems * Enable keyless licensing and manage the systems with a Management Server. For more details visit http://go.symantec.com/sfhakeyless. The product is fully functional during these 60 days. 1) Enter a valid license key 2) Enable keyless licensing and complete system licensing later How would you like to license the systems? [1-2,q] (2) 回车 Would you like to enable the Veritas Volume Replicator? [y,n,q] (n)回车 Would you like to enable the Global Cluster Option? [y,n,q] (n) 回车
5，配置sfrac
接着上面的配置，如果已经退出，可以使用/opt/VRTS/install/installsfrac rac41 rac42来配置
Would you like to configure SFRAC on rac41 rac42? [y,n,q] (n) y这里我们需要配置所以选择y
1) Configure SFRAC sub-components
2) SFRAC Installation and Configuration Checks
3) Prepare to Install Oracle
4) Install Oracle Clusterware/Grid Infrastructure and Database
5) Post Oracle Installation Tasks
6) Exit SFRAC Configuration
Choose option: [1-6,q] (1) 1
To configure VCS for SFRAC the following information is required:
A unique cluster name
A unique cluster ID number between 0-65535
Two or more NICs per system used for heartbeat links
All systems are being configured to create one cluster.
Enter the unique cluster name: [q,?] rac4_cluster
Enter a unique cluster ID number between 0-65535: [b,q,?] 114（整个网络要唯一）
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
1) Configure heartbeat links using LLT over Ethernet
2) Configure heartbeat links using LLT over UDP
3) Automatically detect configuration for LLT over Ethernet
b) Back to previous menu
How would you like to configure heartbeat links? [1-3,b,q,?] (1)
Discovering NICs on rac41 ............................................... Discovered eth0 eth1 eth2
Enter the NIC for the first private heartbeat link on rac41: [b,q,?] eth1
eth1 has an IP address configured on it. It could be a public NIC on rac41.
Are you sure you want to use eth1 for the first private heartbeat link? [y,n,q,b,?] (n) y
Would you like to configure a second private heartbeat link? [y,n,q,b,?] (y) y
Enter the NIC for the second private heartbeat link on rac41: [b,q,?] eth2
eth2 has an IP address configured on it. It could be a public NIC on rac41.
Are you sure you want to use eth2 for the second private heartbeat link? [y,n,q,b,?] (n) y
Are you using the same NICs for private heartbeat links on all systems? [y,n,q,b,?] (y)
Checking media speed for eth1 on rac41 ................................................... 1000Mb/s
Checking media speed for eth2 on rac41 ................................................... 1000Mb/s
Checking media speed for eth1 on rac42 ................................................... 1000Mb/s
Checking media speed for eth2 on rac42 ................................................... 1000Mb/s
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
Cluster information verification:
Cluster Name: rac4_cluster
Cluster ID Number: 114
Private Heartbeat NICs for rac41:
link1=eth1
link2=eth2
Private Heartbeat NICs for rac42:
link1=eth1
link2=eth2
Is this information correct? [y,n,q,b,?] (y)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
Virtual IP can be specified in RemoteGroup resource, and can be used to connect to the cluster using
Java GUI
The following data is required to configure the Virtual IP of the Cluster:
A public NIC used by each system in the cluster
A Virtual IP address and netmask
Do you want to configure the Virtual IP? [y,n,q,?] (n)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
Veritas Cluster Server can be configured to utilize Symantec Security Services
Running VCS in Secure Mode guarantees that all inter-system communication is encrypted, and users are
verified with security credentials.
When running VCS in Secure Mode, NIS and system usernames and passwords are used to verify identity.
VCS usernames and passwords are no longer utilized when a cluster is running in Secure Mode.
Before configuring a cluster to operate using Symantec Security Services, another system must already
have Symantec Security Services installed and be operating as a Root Broker. Refer to the Veritas
Cluster Server Installation Guide for more information on configuring a Symantec Product Authentication
Service Root Broker.
Would you like to configure VCS to use Symantec Security Services? [y,n,q] (n)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
The following information is required to add VCS users:
A user name
A password for the user
User privileges (Administrator, Operator, or Guest)
Do you want to set the username and/or password for the Admin user
(default username = 'admin', password='password')? [y,n,q] (n)
Do you want to add another user to the cluster? [y,n,q] (n)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
VCS User verification:
User: admin Privilege: Administrators
Passwords are not displayed
Is this information correct? [y,n,q] (y)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
The following information is required to configure SMTP notification:
The domain-based hostname of the SMTP server
The email address of each SMTP recipient
A minimum severity level of messages to send to each recipient
Do you want to configure SMTP notification? [y,n,q,?] (n)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
The following information is required to configure SNMP notification:
System names of SNMP consoles to receive VCS trap messages
SNMP trap daemon port numbers for each console
A minimum severity level of messages to send to each console
Do you want to configure SNMP notification? [y,n,q,?] (n)
All SFRAC processes that are currently running must be stopped
Do you want to stop SFRAC processes now? [y,n,q,?] (y)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
Do you want to stop SFRAC processes now? [y,n,q,?] (y)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
Logs are being written to /var/tmp/installsfrac-201309130706Fuf while installsfrac is in progress
Stopping SFRAC: 100%
Estimated time remaining: 0:00 12 of 12
Performing SFRAC prestop tasks ............................................................... Done
Stopping vcsmm ............................................................................... Done
Stopping vxgms ............................................................................... Done
Stopping vxglm ............................................................................... Done
Stopping vxcpserv ............................................................................ Done
Stopping had ................................................................................. Done
Stopping hashadow ............................................................................ Done
Stopping CmdServer ........................................................................... Done
Stopping amf ................................................................................. Done
Stopping vxfen ............................................................................... Done
Stopping gab ................................................................................. Done
Stopping llt ................................................................................. Done
Veritas Storage Foundation for Oracle RAC Shutdown completed successfully
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
Logs are being written to /var/tmp/installsfrac-201309130706Fuf while installsfrac is in progress
Starting SFRAC: 100%
Estimated time remaining: 0:00 24 of 24
Performing SFRAC configuration ............................................................... Done
Starting vxdmp ............................................................................... Done
Starting vxio ................................................................................ Done
Starting vxspec .............................................................................. Done
Starting vxconfigd ........................................................................... Done
Starting vxesd ............................................................................... Done
Starting vxrelocd ............................................................................ Done
Starting vxcached ............................................................................ Done
Starting vxconfigbackupd ..................................................................... Done
Starting vxattachd ........................................................................... Done
Starting vxportal ............................................................................ Done
Starting fdd ................................................................................. Done
Starting llt ................................................................................. Done
Starting gab ................................................................................. Done
Starting vxfen ............................................................................... Done
Starting vxglm ............................................................................... Done
Starting had ................................................................................. Done
Starting hashadow ............................................................................ Done
Starting CmdServer ........................................................................... Done
Starting vxdbd ............................................................................... Done
Starting vxgms ............................................................................... Done
Starting vxodm ............................................................................... Done
Starting vcsmm ............................................................................... Done
Performing SFRAC poststart tasks ............................................................. Done
Veritas Storage Foundation for Oracle RAC Startup completed successfully
If you have not yet configured Symantec I/O fencing, run the command '/opt/VRTS/install/installsfrac
-fencing' to configure it
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Install Program
rac41 rac42
1) Configure SFRAC sub-components
2) SFRAC Installation and Configuration Checks
3) Prepare to Install Oracle
4) Install Oracle Clusterware/Grid Infrastructure and Database
5) Post Oracle Installation Tasks
6) Exit SFRAC Configuration
Choose option: [1-6,q] (1)
6，创建gi/rdbms相关的用户组与用户名
/usr/sbin/groupadd -g 501 oinstall /usr/sbin/groupadd -g 502 dba /usr/sbin/groupadd -g 504 asmadmin /usr/sbin/groupadd -g 506 asmdba /usr/sbin/groupadd -g 507 asmoper /usr/sbin/useradd -u 501 -g oinstall -G dba,asmadmin,asmdba,asmoper grid /usr/sbin/useradd -u 502 -g oinstall -G dba,asmdba oracle echo "oracle"|passwd oracle --stdin echo "oracle"|passwd grid --stdin
7，配置系统参数
echo "fs.aio-max-nr = 1048576
fs.file-max = 6815744
kernel.shmall = 2097152
kernel.shmmax = 11036870912
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048586">>/etc/sysctl.conf
8，配置资源限制
echo "oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 grid soft nproc 2047 grid hard nproc 16384 grid soft nofile 1024 grid hard nofile 65536">>/etc/security/limits.conf 如果要配置大页这里需要加上memlock echo "session required pam_limits.so">>/etc/pam.d/login
9，创建目录
mkdir -p /u01/app/oraInventory chown -R grid:oinstall /u01/app/oraInventory chmod -R 775 /u01/app/oraInventory mkdir -p /u01/11.2.0/grid chown -R grid:oinstall /u01/11.2.0/grid chmod -R 775 /u01/11.2.0/grid mkdir -p /u01/app/oracle chown -R oracle:oinstall /u01/app/oracle chmod -R 775 /u01/app/oracle mkdir -p /u01/app/oracle/product/11.2.0/db_1 chown -R oracle:oinstall /u01/app/oracle/product/11.2.0/db_1 chmod -R 775 /u01/app/oracle/product/11.2.0/db_1
10，配置yum
mount /dev/cdrom /media echo " [RHEL5.8] name = Enterprise Linux 5.5 DVD baseurl=file:///media/Server/ gpgcheck=0 enabled=1">/etc/yum.repos.d/public-yum-el5.repo
11，软件检查与安装
rpm -q --qf '%{NAME}-%{VERSION}-%{RELEASE} (%{ARCH})\n' binutils \
compat-libstdc++-33 \
elfutils-libelf \
elfutils-libelf-devel \
gcc \
gcc-c++ \
glibc \
glibc-common \
glibc-devel \
glibc-headers \
ksh \
libaio \
libaio-devel \
libgcc \
libstdc++ \
libstdc++-devel \
make \
sysstat \
unixODBC \
unixODBC-devel \
libaio-devel
yum -y install unixODBC unixODBC-devel libaio-devel
12，配置ntp
root@rac41 ~]# echo "server 127.127.1.0> #broadcastclient > driftfile /etc/ntp.drift > tracefile /etc/ntp.trace">/etc/ntp.conf [root@rac41 ~]# vi /etc/sysconfig/ntpd # Drop root to id 'ntp:ntp' by default. OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid" [root@rac41 ~]# chkconfig --level 345 ntpd on [root@rac41 ~]# /etc/init.d/ntpd restart Shutting down ntpd: [FAILED] ntpd: Synchronizing with time server: [FAILED] Starting ntpd: [ OK ] [root@rac42 ~]# echo "server rac41 > #broadcastclient > driftfile /etc/ntp.drift > tracefile /etc/ntp.trace"> /etc/ntp.conf [root@rac42 ~]# vi /etc/sysconfig/ntpd # Drop root to id 'ntp:ntp' by default. OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid" # Set to 'yes' to sync hw clock after successful ntpdate SYNC_HWCLOCK=no # Additional options for ntpdate NTPDATE_OPTIONS="" [root@rac42 ~]# chkconfig --level 345 ntpd on [root@rac42 ~]# /etc/init.d/ntpd restart Shutting down ntpd: [FAILED] ntpd: Synchronizing with time server: [FAILED] Starting ntpd: [ OK ]
13，配置css资源组
格式化磁盘
[root@rac42 ~]# vxdisk list
DEVICE TYPE DISK GROUP STATUS
disk_0 auto - - error
disk_1 auto - - error
sda auto:none - - online invalid
[root@rac42 ~]# /opt/VRTS/bin/vxdisksetup -i disk_0
[root@rac42 ~]# /opt/VRTS/bin/vxdisksetup -i disk_1
[root@rac42 ~]# vxdisk list
DEVICE TYPE DISK GROUP STATUS
disk_0 auto:cdsdisk - - online
disk_1 auto:cdsdisk - - online
sda auto:none - - online invalid
[root@rac41 ~]# cd /opt/VRTS/install
[root@rac41 install]# ./installsfrac rac41 rac42
Do you want to re-configure VCS? [y,n,q] (n)
rac41 rac42
1) Create Oracle User and Group
2) Create Storage for OCR and Voting disk
3) Oracle Network Configuration
4) Exit SFRAC Configuration
b) Back to previous menu
Choose option: [1-4,b,q] (1) 2
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Create Storage for OCR and Voting disk
Ensure that SFRAC is running for creating disk groups, volumes and file systems for Oracle
Press [Enter] to continue:
Do you want the installer to assist you in creating disk groups, volumes and file systems for Oracle?
(Mirroring enabled by default) [y,n,q] (n) y
1) Create a disk group
2) Use an existing disk group
b) Back to previous menu
Choose option: [1-2,b,q] 1
The following disks are not part of any disk group
1) disk_0 auto - - error
2) disk_1 auto - - error
3) sda auto:none - - online invalid
b) Back to previous menu
Select the serial numbers of at least two disks separated by spaces for creating storage for OCR and
Voting disk (exclude disks used for Operating System and data):
[1-3,b,q] 1 2
Enter the disk group name: [b] (ocrvotedg) votedg
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Create Storage for OCR and Voting disk
Verify information for creating storage for OCR and Voting disk (Disks allocation):
CVM Master node: rac41
Selected disks (including mirroring):
1. disk_0
2. disk_1
Disk group name: votedg
Is this information correct? [y,n,q] (y)
Intializing disk disk_0 on Master (rac41) .................................................. Failed
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
1) Create Oracle User and Group
2) Create Storage for OCR and Voting disk
3) Oracle Network Configuration
4) Exit SFRAC Configuration
b) Back to previous menu
Choose option: [1-4,b,q] (1) 2
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Create Storage for OCR and Voting disk
Ensure that SFRAC is running for creating disk groups, volumes and file systems for Oracle
Press [Enter] to continue:
Do you want the installer to assist you in creating disk groups, volumes and file systems for Oracle?
(Mirroring enabled by default) [y,n,q] (n) y
1) Create a disk group
2) Use an existing disk group
b) Back to previous menu
Choose option: [1-2,b,q] 1
The following disks are not part of any disk group
1) disk_0 auto:cdsdisk - - online
2) disk_1 auto:cdsdisk - - online
3) sda auto:none - - online invalid
b) Back to previous menu
Select the serial numbers of at least two disks separated by spaces for creating storage for OCR and
Voting disk (exclude disks used for Operating System and data):
[1-3,b,q] 1 2
Enter the disk group name: [b] (ocrvotedg) newocrvotedg
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Create Storage for OCR and Voting disk
Verify information for creating storage for OCR and Voting disk (Disks allocation):
CVM Master node: rac41
Selected disks (including mirroring):
1. disk_0
2. disk_1
Disk group name: newocrvotedg
Is this information correct? [y,n,q] (y)
Intializing disk disk_0 on Master (rac41) .................................................... Done
Intializing disk disk_1 on Master (rac41) .................................................... Done
Initializing disk group on Master (rac41) .................................................... Done
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Create Storage for OCR and Voting disk
Storage scheme for OCR and Voting disk storage:
1) CVM Raw Volume
2) Clustered File System
b) Back to previous menu
Select the storage scheme to be used: [1-2,b,q] 2
Enter the volume name for OCR and Voting disk: [b] (ocrvotevol) newocrvotevol
Enter the volume size for OCR and Voting disk (in MB): [b] (640)
Enter Oracle UNIX user name: [b] grid
Enter Oracle UNIX group name: [b] (oinstall) asmadmin
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Create Storage for OCR and Voting disk
Verify information about creating storage for OCR and Voting disk:
Storage scheme for OCR and Voting disk: Clustered File System
Volume name for OCR and Voting disk: newocrvotevol
Volume size for OCR and Voting disk: 640
Oracle UNIX user: grid
Oracle UNIX group: asmadmin
Is this information correct? [y,n,q] (y)
Creating volume 'newocrvotevol' for OCR and Voting disk on CVM Master (rac41)
................ Done
Starting all the volumes on diskgroup 'newocrvotedg' on rac41 ................................ Done
Enter the mount point location for CFS (common for all the nodes): [b] (/ocrvote) /newocrvote
Creating CFS mount point at /newocrvote ...................................................... Done
Creating (on the Master node) and mounting (on all the nodes) CFS ............................ Done
Setting the owner of the CFS mountpoint '/newocrvote' as 'grid:asmadmin' on rac41 ............ Done
Setting the permissions of the CFS mountpoint '/newocrvote' as '755' on rac41 ................ Done
Setting the owner of the CFS mountpoint '/newocrvote' as 'grid:asmadmin' on rac42 ............ Done
Setting the permissions of the CFS mountpoint '/newocrvote' as '755' on rac42 ................ Done
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Create Storage for OCR and Voting disk
Adding CFSMount 'ocrvote_mnt_newocrvotedg' and CVMVolDg 'ocrvote_voldg_newocrvotedg' resources to VCS
configuration:
Changing permissions on the VCS configuration file ........................................... Done
Setting up the file system ................................................................... Done
Setting up the volumes ....................................................................... Done
Linking the parent and child ................................................................. Done
Beginning enabling the system ................................................................ Done
Making CVMVolDg resource 'ocrvote_voldg_newocrvotedg' online on rac41 ........................ Done
Making CVMVolDg resource 'ocrvote_voldg_newocrvotedg' online on rac42 ........................ Done
rac41 rac42
1) Create Oracle User and Group
2) Create Storage for OCR and Voting disk
3) Oracle Network Configuration
4) Exit SFRAC Configuration
b) Back to previous menu
Choose option: [1-4,b,q] (1) 3
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
1) Configure private IP addresses (PrivNIC Configuration)
2) Configure private IP addresses (MultiPrivNIC Configuration)
3) Exit SFRAC Configuration
b) Back to previous menu
Choose option: [1-3,b,q] (1)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Configure private IP addresses (PrivNIC Configuration)
This step will configure private IP addresses using PrivNIC resource of VCS
* All LLT links will be used for PrivNIC configuration
* Ensure that the same NICs are used for private interconnect on each node of your cluster
* All IP addresses must be of same type, either all IPv4 or all IPv6
* The private IP addresses must be added to /etc/hosts on all nodes before installing Oracle
Clusterware. If you choose the Installer to add IP addresses in /etc/hosts then only those IP addresses
which do not already exist in this file on any node will be added
* Oracle UDP IPC private IP addresses must be added to the oracle init file as cluster_interconnect
parameter
* All IP addresses must be in the same subnet. Otherwise, Oracle Clusterware/Grid Infrastructure/Oracle
Database UDP IPC will not be able to communicate properly across the nodes
Press [Enter] to continue:
Verifying VCS Engine status on rac41 ...................................................... Running
Verifying VCS Engine status on rac42 ...................................................... Running
Discovering LLT links ........................................................ discovered eth1 eth2
Checking the existence of PrivNIC resources ......................................... doesn't exist
Enter the PrivNIC resource name: [b] (ora_priv)
PrivNIC agent requires you to set the priority of the network interfaces. Based on this priority, the
agent chooses the appropriate interface during failover.
Current PrivNIC interface priority order is: eth1=0 eth2=1
Do you want to update the priority of the PrivNIC interfaces? [y,n,q] (n)
Do you want the Installer to add IP addresses in /etc/hosts file? [y,n,q] (y) n
Enter the private IP for rac41: [b] 192.168.112.62
Enter the private IP for rac42: [b] 192.168.112.63
Enter the Netmask for private network: [b] (255.255.255.0)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Configure private IP addresses (PrivNIC Configuration)
Verify private IP configuration information:
Resource name: ora_priv
System: rac41
Private Interfaces: eth1 eth2
Private IP address: 192.168.112.62
System: rac42
Private Interfaces: eth1 eth2
Private IP address: 192.168.112.63
Netmask: 255.255.255.0
Is this information correct? [y,n,q] (y)
Changing configuration to read-write mode .................................................... Done
Adding new ora_priv resource ................................................................. Done
Updating resource configuration .............................................................. Done
查看资源状态
[root@rac41 install]# hares -state
#Resource Attribute System Value
cvm_clus State rac41 ONLINE
cvm_clus State rac42 ONLINE
cvm_vxconfigd State rac41 ONLINE
cvm_vxconfigd State rac42 ONLINE
ocrvote_mnt_newocrvotedg State rac41 ONLINE
ocrvote_mnt_newocrvotedg State rac42 ONLINE
ocrvote_voldg_newocrvotedg State rac41 ONLINE
ocrvote_voldg_newocrvotedg State rac42 ONLINE
ora_priv State rac41 ONLINE
ora_priv State rac42 ONLINE
vxfsckd State rac41 ONLINE
vxfsckd State rac42 ONLINE
重启一次主机 （这里可以重启，也可以不用重启）
重启后资源等一切正常
13，安装grid
[root@rac41 rpm]# rpm -ivh cvuqdisk-1.0.9-1.rpm Preparing... ########################################### [100%] Using default group oinstall to install package 1:cvuqdisk ########################################### [100%] [root@rac41 rpm]# [root@rac42 ~]# rpm -ivh /tmp/cvuqdisk-1.0.9-1.rpm Preparing... ########################################### [100%] Using default group oinstall to install package 1:cvuqdisk ########################################### [100%] [grid@rac41 ~]$ vi .bash_profile # .bash_profile # Get the aliases and functions if [ -f ~/.bashrc ]; then . ~/.bashrc fi # User specific environment and startup programs PATH=$PATH:$HOME/bin export PATH export ORACLE_BASE=/u01/app/grid export ORACLE_HOME=/u01/app/11.2.0/grid export PATH=$ORACLE_HOME/bin:$PATH export TNS_ADMIN=$ORACLE_HOME/network/admin export ORACLE_SID=+ASM1 export DISPLAY=192.168.111.1:0.0 stty erase ^h set -o vi [grid@rac41 ~]$ source !$ source .bash_profile [grid@rac41 grid]$ ./runInstaller Starting Oracle Universal Installer... Checking Temp space: must be greater than 120 MB. Actual 24901 MB Passed Checking swap space: must be greater than 150 MB. Actual 8191 MB Passed Checking monitor: must be configured to display at least 256 colors. Actual 16777216 Passed Preparing to launch Oracle Universal Installer from /tmp/OraInstall2013-09-13_08-11-57AM. Please wait ...
.
![clip_image008[1]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0081.png "clip_image008[1]"){kind=small}
分别在两个节点 [root@rac41 u01]# /u01/app/11.2.0/grid/root.sh Performing root user operation for Oracle 11g The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/11.2.0/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Creating trace directory User ignored Prerequisites during installation OLR initialization - successful root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert Adding Clusterware entries to inittab CRS-2672: Attempting to start 'ora.mdnsd' on 'rac41' CRS-2676: Start of 'ora.mdnsd' on 'rac41' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'rac41' CRS-2676: Start of 'ora.gpnpd' on 'rac41' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac41' CRS-2672: Attempting to start 'ora.gipcd' on 'rac41' CRS-2676: Start of 'ora.cssdmonitor' on 'rac41' succeeded CRS-2676: Start of 'ora.gipcd' on 'rac41' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac41' CRS-2672: Attempting to start 'ora.diskmon' on 'rac41' CRS-2676: Start of 'ora.diskmon' on 'rac41' succeeded CRS-2676: Start of 'ora.cssd' on 'rac41' succeeded clscfg: -install mode specified Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. Now formatting voting disk: /newocrvote/newvote. CRS-4603: Successful addition of voting disk /newocrvote/newvote. ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 622b58d0dd204f24bf9e8e4d63e36d77 (/newocrvote/newvote) [] Located 1 voting disk(s). Configure Oracle Grid Infrastructure for a Cluster ... succeeded [root@rac42 11.2.0]# /u01/app/oraInventory/orainstRoot.sh Changing permissions of /u01/app/oraInventory. Adding read,write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /u01/app/oraInventory to oinstall. The execution of the script is complete. [root@rac42 11.2.0]# /u01/app/11.2.0/grid/root.sh Performing root user operation for Oracle 11g The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/11.2.0/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Creating trace directory User ignored Prerequisites during installation OLR initialization - successful Adding Clusterware entries to inittab CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node unknown, number unknown, and is terminating An active cluster was found during exclusive startup, restarting to join the cluster Configure Oracle Grid Infrastructure for a Cluster ... succeeded
![clip_image001[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0014.png "clip_image001[4]")
![clip_image002[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0024.png "clip_image002[4]")
14 安装数据库
[oracle@rac41 tmp]$ cat ~/.bash_profile
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/bin
export PATH
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export PATH=$ORACLE_HOME/bin:$PATH
export TNS_ADMIN=$ORACLE_HOME/network/admin
export ORACLE_SID=power1
export DISPLAY=192.168.111.1:0.0
stty erase ^h
set -o vi
[oracle@rac41 tmp]$ cd database/
[oracle@rac41 database]$ ls
doc install readme.html response rpm runInstaller sshsetup stage welcome.html
[oracle@rac41 database]$ ./runInstaller
![clip_image001[6]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0016.png "clip_image001[6]")
![clip_image002[6]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0026.png "clip_image002[6]")
![clip_image003[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0034.png "clip_image003[4]")
![clip_image004[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0044.png "clip_image004[4]")
![clip_image005[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0054.png "clip_image005[4]")
![clip_image006[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0064.png "clip_image006[4]")
![clip_image007[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0074.png "clip_image007[4]")
![clip_image008[6]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0086.png "clip_image008[6]")
![clip_image009[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0094.png "clip_image009[4]")
![clip_image010[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0104.png "clip_image010[4]")
![clip_image011[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0114.png "clip_image011[4]")
![clip_image012[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0124.png "clip_image012[4]")
![clip_image013[4]](http://www.htz.pw/wp-content/uploads/2013/09/clip_image0134.png "clip_image013[4]")
[root@rac41 tmp]# /u01/app/oracle/product/11.2.0/db_1/root.sh Performing root user operation for Oracle 11g The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/11.2.0/db_1 Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Finished product-specific root actions. [root@rac42 ~]# /u01/app/oracle/product/11.2.0/db_1/root.sh Performing root user operation for Oracle 11g The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/11.2.0/db_1 Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Finished product-specific root actions.
14，link gi/rdbms
[root@rac41 install]# ./installsfrac -configure rac41 rac42
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Copyright (c) 2010 Symantec Corporation. All rights reserved. Symantec, the Symantec Logo are
trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other
countries. Other names may be trademarks of their respective owners.
The Licensed Software and Documentation are deemed to be "commercial computer software" and "commercial
computer software documentation" as defined in FAR Sections 12.212 and DFARS Section 227.7202.
Logs are being written to /var/tmp/installsfrac-201309130917itD while installsfrac is in progress.
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Logs are being written to /var/tmp/installsfrac-201309130917itD while installsfrac is in progress
Verifying systems: 100%
Estimated time remaining: 0:00 5 of 5
Checking system communication ................................................................ Done
Checking release compatibility ............................................................... Done
Checking installed product ................................................................... Done
Checking platform version .................................................................... Done
Performing product prechecks ................................................................. Done
System verification checks completed successfully
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
1) Configure SFRAC sub-components
2) SFRAC Installation and Configuration Checks
3) Prepare to Install Oracle
4) Install Oracle Clusterware/Grid Infrastructure and Database
5) Post Oracle Installation Tasks
6) Exit SFRAC Configuration
Choose option: [1-6,q] (1) 5
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
1) Configure CSSD agent
2) Relink Oracle Database Binary
3) Exit SFRAC Configuration
b) Back to previous menu
Choose option: [1-3,b,q] (1) 1
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Configure CSSD agent
Enter absolute path of Oracle Clusterware/Grid Infrastructure Home directory: [b]
(/u01/app/11.2.0/grid)
Verifying Oracle Clusterware/Grid Infrastructure status on rac41 .......................... Running
Verifying Oracle Clusterware/Grid Infrastructure status on rac42 .......................... Running
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Configure CSSD agent
The Oracle clusterware components, the corresponding VCS resource and service groups are as follows:
Type Resource Name Service Group
=============================================================
Private IP ora_priv cvm
OCR ocrvote_mnt_newocrvotedg cvm
Voting disk ocrvote_mnt_newocrvotedg cvm
Do you want to continue? [y,n,q] (y)
Adding CSSD agent to VCS configuration ....................................................... Done
Setting dependency of CSSD resource on PrivNIC/MultiPrivNIC resource ......................... Done
Setting dependency of CSSD resource on OCR (CFSMount/CVMVolDg) resource ocrvote_mnt_newocrvotedg Done
Setting dependency of CSSD resource on Voting disk (CFSMount/CVMVolDg) resource ocrvote_mnt_newocrvotedg Done
Enabling CSSD agent .......................................................................... Done
Saving the updated VCS configuration ......................................................... Done
Disable Oracle Clusterware/Grid Infrastructure auto-startup on rac41 ......................... Done
Disable Oracle Clusterware/Grid Infrastructure auto-startup on rac42 ......................... Done
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
1) Configure CSSD agent
2) Relink Oracle Database Binary
3) Exit SFRAC Configuration
b) Back to previous menu
Choose option: [1-3,b,q] (1) 2
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Relink Oracle Database Binary
Enter Oracle UNIX user name: [b] oracle
Enter Oracle UNIX group name: [b] (oinstall)
Enter absolute path of Oracle Clusterware/Grid Infrastructure Home directory: [b]
(/u01/app/11.2.0/grid)
Enter absolute path of Oracle Database Home directory: [b] /u01/app/oracle/product/11.2.0/db_1
Oracle Version Detected: 11.2.0.3
Do you want to continue? [y,n,q] (y)
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
Relink Oracle Database Binary
Verify Oracle database information
Oracle UNIX User: oracle
Oracle UNIX Group: oinstall
Oracle Clusterware/Grid Infrastructure Home: /u01/app/11.2.0/grid
Oracle Database Home: /u01/app/oracle/product/11.2.0/db_1
Oracle Version: 11.2.0.3
Is this information correct? [y,n,q] (y)
Verifying Oracle binaries on rac41 ........................................................... Done
Verifying Oracle binaries on rac42 ........................................................... Done
Verifying Oracle binaries on rac41 ........................................................... Done
Verifying Oracle binaries on rac42 ........................................................... Done
Verifying skgxn library on rac41 ............................................................. Done
Verifying skgxn library on rac42 ............................................................. Done
Verifying Oracle Clusterware/Grid Infrastructure status on rac41 .......................... Running
Verifying Oracle Clusterware/Grid Infrastructure status on rac42 .......................... Running
Changing css misscount to 600 ................................................................ Done
Verifying Oracle Database status ............................................................. Done
rac41
Copying SFRAC ODM library on rac41 ........................................................... Done
Setting permissions oracle:oinstall for Oracle ODM library ................................... Done
rac42
Copying SFRAC ODM library on rac42 ........................................................... Done
Setting permissions oracle:oinstall for Oracle ODM library ................................... Done
Oracle relinking completed successfully
Press [Enter] to continue:
Veritas Storage Foundation for Oracle RAC 5.1 SP1 Configure Program
rac41 rac42
1) Configure CSSD agent
2) Relink Oracle Database Binary
3) Exit SFRAC Configuration
b) Back to previous menu
Choose option: [1-3,b,q] (1) 3
installsfrac log files, summary file, and response file are saved at:
/opt/VRTS/install/logs/installsfrac-201309130917itD
禁用crs自动启动
[root@rac41 bin]# ./crsctl disable crs
CRS-4621: Oracle High Availability Services autostart is disabled.
[root@rac41 ~]# gabconfig -a
GAB Port Memberships
===============================================================
Port a gen fe7f03 membership 01
Port b gen fe7f04 membership 01
Port d gen fe7f01 membership 01
Port f gen fe7f0f membership 01
Port h gen fe7f06 membership 01
Port o gen fe7f02 membership 01
Port u gen fe7f0d membership 01
Port v gen fe7f08 membership 01
Port w gen fe7f0a membership 01
[root@rac41 ~]# hares -state
#Resource Attribute System Value
cssd State rac41 ONLINE
cssd State rac42 ONLINE
cvm_clus State rac41 ONLINE
cvm_clus State rac42 ONLINE
cvm_vxconfigd State rac41 ONLINE
cvm_vxconfigd State rac42 ONLINE
ocrvote_mnt_newocrvotedg State rac41 ONLINE
ocrvote_mnt_newocrvotedg State rac42 ONLINE
ocrvote_voldg_newocrvotedg State rac41 ONLINE
ocrvote_voldg_newocrvotedg State rac42 ONLINE
ora_priv State rac41 ONLINE
ora_priv State rac42 ONLINE
vxfsckd State rac41 ONLINE
vxfsckd State rac42 ONLINE
15，升级到11.2.0.3.7
[oracle@rac41 tmp]$ mv $ORACLE_HOME/OPatch $ORACLE_HOME/opatch [oracle@rac41 tmp]$ cp -R OPatch $ORACLE_HOME/OPatch [oracle@rac41 ~]$ $ORACLE_HOME/OPatch/opatch version OPatch Version: 11.2.0.3.4 OPatch succeeded. [grid@rac41 ~]$ mv $ORACLE_HOME/OPatch $ORACLE_HOME/opatch [grid@rac41 ~]$ cp -R OPatch $ORACLE_HOME/OPatch [grid@rac41 ~]$ $ORACLE_HOME/OPatch/opatch version OPatch Version: 11.2.0.3.4 OPatch succeeded. [root@rac41 tmp]# $ORACLE_HOME/OPatch/opatch auto /tmp/ -ocmrf /tmp/ocm.rsp Executing /u01/app/11.2.0/grid/perl/bin/perl /u01/app/oracle/product/11.2.0/db_1/OPatch/crs/patch11203.pl -patchdir / -patchn tmp -ocmrf /tmp/ocm.rsp -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/s_crsconfig_defs This is the main log file: /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatchauto2013-09-13_09-45-20.log This file will show your detected configuration and all the steps that opatchauto attempted to do on your system: /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatchauto2013-09-13_09-45-20.report.log 2013-09-13 09:45:20: Starting Clusterware Patch Setup Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac41' CRS-2673: Attempting to stop 'ora.crsd' on 'rac41' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac41' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac41' CRS-2673: Attempting to stop 'ora.cvu' on 'rac41' CRS-2673: Attempting to stop 'ora.oc4j' on 'rac41' CRS-2677: Stop of 'ora.cvu' on 'rac41' succeeded CRS-2672: Attempting to start 'ora.cvu' on 'rac42' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac41' succeeded CRS-2673: Attempting to stop 'ora.rac41.vip' on 'rac41' CRS-2677: Stop of 'ora.rac41.vip' on 'rac41' succeeded CRS-2672: Attempting to start 'ora.rac41.vip' on 'rac42' CRS-2676: Start of 'ora.cvu' on 'rac42' succeeded CRS-2676: Start of 'ora.rac41.vip' on 'rac42' succeeded CRS-2677: Stop of 'ora.oc4j' on 'rac41' succeeded CRS-2672: Attempting to start 'ora.oc4j' on 'rac42' CRS-2676: Start of 'ora.oc4j' on 'rac42' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'rac41' CRS-2677: Stop of 'ora.ons' on 'rac41' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'rac41' CRS-2677: Stop of 'ora.net1.network' on 'rac41' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac41' has completed CRS-2677: Stop of 'ora.crsd' on 'rac41' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'rac41' CRS-2673: Attempting to stop 'ora.evmd' on 'rac41' CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac41' CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac41' CRS-2677: Stop of 'ora.evmd' on 'rac41' succeeded CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac41' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'rac41' succeeded CRS-2677: Stop of 'ora.ctssd' on 'rac41' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac41' CRS-2677: Stop of 'ora.cssd' on 'rac41' succeeded CRS-2673: Attempting to stop 'ora.crf' on 'rac41' CRS-2677: Stop of 'ora.crf' on 'rac41' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'rac41' CRS-2677: Stop of 'ora.gipcd' on 'rac41' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac41' CRS-2677: Stop of 'ora.gpnpd' on 'rac41' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac41' has completed CRS-4133: Oracle High Availability Services has been stopped. Successfully unlock /u01/app/11.2.0/grid patch //tmp/16619898 apply successful for home /u01/app/11.2.0/grid patch //tmp/16619892 apply successful for home /u01/app/11.2.0/grid CRS-4123: Oracle High Availability Services has been started. [root@rac41 ~]# $ORACLE_HOME/OPatch/opatch auto /tmp -oh $ORACLE_HOME -ocmrf /tmp/ocm.rsp Executing /u01/app/11.2.0/grid/perl/bin/perl /u01/app/oracle/product/11.2.0/db_1/OPatch/crs/patch11203.pl -patchdir / -patchn tmp -oh /u01/app/oracle/product/11.2.0/db_1 -ocmrf /tmp/ocm.rsp -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/s_crsconfig_defs This is the main log file: /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatchauto2013-09-13_17-15-38.log This file will show your detected configuration and all the steps that opatchauto attempted to do on your system: /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatchauto2013-09-13_17-15-38.report.log 2013-09-13 17:15:38: Starting Clusterware Patch Setup Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params patch //tmp/16619898/custom/server/16619898 apply successful for home /u01/app/oracle/product/11.2.0/db_1 patch //tmp/16619892 apply successful for home /u01/app/oracle/product/11.2.0/db_1
16，删除asm与acfs资源
[grid@rac41 ~]$ crsctl delete resource ora.registry.acfs
[grid@rac41 ~]$ crsctl delete resource ora.asm
[grid@rac41 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE rac41
ONLINE ONLINE rac42
ora.gsd
OFFLINE OFFLINE rac41
OFFLINE OFFLINE rac42
ora.net1.network
ONLINE ONLINE rac41
ONLINE ONLINE rac42
ora.ons
ONLINE ONLINE rac41
ONLINE ONLINE rac42
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac41
ora.cvu
1 ONLINE ONLINE rac41
ora.oc4j
1 OFFLINE OFFLINE
ora.rac41.vip
1 ONLINE ONLINE rac41
ora.rac42.vip
1 ONLINE ONLINE rac42
ora.scan1.vip
1 ONLINE ONLINE rac41
17 查看版本
[grid@rac41 ~]$ $ORACLE_HOME/OPatch/opatch lspatches 16619892;Database Patch Set Update : 11.2.0.3.7 (16619892) 16619898;Grid Infrastructure Patch Set Update : 11.2.0.3.7 (16742216) [oracle@rac41 ~]$ $ORACLE_HOME/OPatch/opatch lspatches 16619892;Database Patch Set Update : 11.2.0.3.7 (16619892) 16619898;Grid Infrastructure Patch Set Update : 11.2.0.3.7 (16742216)
sfrac环境安装11.2.0.3.7(gi)：等您坐沙发呢！