【IT168 技术文档】
Oracle RAC安装部署之规划(一) http://tech.it168.com/a2009/0521/369/000000369243.shtml
二、安装Oracle RAC前的准备
2.1 配置AIX
(对于AIX的配置，通常可以请SA或者系统集成商来协助。但是事情只有亲历亲为才会比较放心，所以下面我们来为RAC进行准备，对AIX进行的相关配置。)
2.1.1、调整aix文件系统
因为默认安装完毕后，每个文件系统都比较小。所以建议扩大这些文件系统的大小。大小的标准根据自己的实际情况来做。
配置结果如下：
2.1.2编辑hosts文件(两个节点)
2.1.3 创建rootvg的镜像
为了保证以后系统的安全，建议配置rootvg的镜像。
2.1.4 调整page size(swap)
2.1.5配置系统配置参数，配置每用户的最大进程数、调整water mark
2.1.6配置网络可调参数
2.1.7修改异步I/O
2.1.8调整syncd频率
2.1.9创建串口设备
2.1.10 转换AIX 64bit内核
2.2 Oracle相关的配置
2.2.1创建用户在db01和db02上，创建oinstall、dba、hagsuser组
2.2.2在db01和db02上，创建oracle用户：
2.2.3安装oracle、hacmp支持包
2.2.4安装磁盘阵列，创建共享卷
准备磁盘阵列
# hostname
db01
# lspv
hdisk0 0002e54aa58657e9 rootvg active
hdisk1 0002657c5acf302b rootvg active
hdisk2 0002657c4d26e7ba None
hdisk3 0002657c5acf4bc3 None
hdisk4 0002657c4cc04d52 None
hdisk5 0002ee503cc8dcaa None
#
# hostname
db02
# lspv
hdisk0 0002e54aa58657e9 rootvg active
hdisk1 0002657c5acf302b rootvg active
hdisk2 0002657c4d26e7ba None
hdisk3 0002657c5acf4bc3 None
hdisk4 0002657c4cc04d52 None
hdisk5 0002ee503cc8dcaa None
?? 在其中一个节点，创建一个并行vg名字为datavg
# hostname
db01
#
# smitty mkvg
Add a Big Volume Group
Type or select values in entry fields.
Press Enter AFTER making all desired changes.
[Entry Fields]
VOLUME GROUP name [datavg] +
Physical partition SIZE in megabytes 512
* PHYSICAL VOLUME names [hdisk2,hdisk3] +
Force the creation of a volume group yes +
Activate volume group AUTOMATICALLY no +
at system restart?
Volume Group MAJOR NUMBER [60]
Create VG Concurrent Capable? enhanced concurrent +
PS：确认所有卷组必须以concurrent模式被激活，两个节点可以同时对磁盘进行操作.
# varyonvg datavg
创建oracle使用的并行卷
使用下面命令。或者将如下命令便写成一个脚本然后执行。后面的partition size的个数请参考自己系统的情况。
mklv -y'rac_crs1024m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_vote1024m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_system_1024m' -w'n' -s'n' -r'n' datavg 4 hdisk2
mklv -y'rac_pwdfile_100m' -w'n' -s'n' -r'n' datavg 1 hdisk2
mklv -y'rac_sysaux_800m' -w'n' -s'n' -r'n' datavg 4 hdisk2
mklv -y'rac_undo1_4096m' -w'n' -s'n' -r'n' datavg 16 hdisk2
mklv -y'rac_undo2_4096m' -w'n' -s'n' -r'n' datavg 16 hdisk2
mklv -y'rac_temp_4096m' -w'n' -s'n' -r'n' datavg 16 hdisk2
mklv -y'rac_users_800m' -w'n' -s'n' -r'n' datavg 4 hdisk2
mklv -y'rac_redo1_1_120m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_redo1_2_120m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_redo1_3_120m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_redo2_1_120m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_redo2_2_120m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_redo2_3_120m' -w'n' -s'n' -r'n' datavg 2 hdisk2
mklv -y'rac_ctl1_100m' -w'n' -s'n' -r'n' datavg 1 hdisk2
mklv -y'rac_ctl2_100m' -w'n' -s'n' -r'n' datavg 1 hdisk2
mklv -y'rac_ctl3_100m' -w'n' -s'n' -r'n' datavg 1 hdisk2
mklv -y'rac_spfile_100m' -w'n' -s'n' -r'n' datavg 1 hdisk2
通过mklv命令创建完lv后，会在/dev/下生成两个文件，比如：
# mklv -y'rac_spfile_100m' -w'n' -s'n' -r'n' datavg 1 hdisk2
那么在/dev/下会生成两个文件
/dev/rac_spfile_100m
/dev/rrac_spfile_100m
前面多了一个r的文件就是我们要使用的character devices。
也就是我们通常所说的裸设备。
在另外一个节点上import共享卷
# hostname
db02
# smitty vg
Volume Groups
Move cursor to desired item and press Enter.
Import a Volume Group
Import a Volume Group
Type or select values in entry fields.
Press Enter AFTER making all desired changes.
[Entry Fields]
VOLUME GROUP name [datavg]
* PHYSICAL VOLUME name [hdisk2,hdisk3] +
Volume Group MAJOR NUMBER [60] +#
修改共享卷的属性(建议两台主机都要做)
# varyonvg datavg
# chown oracle:dba /dev/rrac_*
# varyoffvg datavg
2.2.5配置SSH的对等性
在所有节点配置SSH的对等性
在安装Oracle Real Application clusters之前,必须先配置所有节点的SSH对等性。因为在安装过程种Oracle Universal Installer 使用ssh和scp命令执行远程命令执行及copy的工作。
下面是具体的步骤：
以下步骤在所有节点上执行：
1.以oracle用户登陆
# su – oracle
2.在两个节点的oracle主目录分别创建.ssh目录，并赋予权限。
# mkdir ~/.ssh
# chmod 755 ~/.ssh
3. 在两个节点分别生成RSA key
# /usr/bin/ssh-keygen -t rsa
会出现如下提示:
■ Accept the default location for the key file.
■ Enter and confirm a pass phrase that is different from the oracle user’s password. phrase
密码处直接回车即可
4. 生成DSA key
# /usr/bin/ssh-keygen -t dsa
出现如下提示:
■ Accept the default location for the key file.
■ Enter and confirm a pass phrase that is different from the oracle user’s password. phrase
密码处直接回车即可
5. 以oracle用户身份，在所有节点创建authorized_keys文件，并赋予权限
# touch ~/.ssh/authorized_keys
# cd ~/.ssh
# ls
你应该可以看到你所创建的id_dsa.pub 和id_rsa.pub和authorized_keys
6.在两个节点分别将id_dsa.pub 和id_rsa.pub加入到authorized_keys
节点1：
$ ssh db01 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
$ ssh db01 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
$ ssh db02 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
$ ssh db02 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
节点2：
$ ssh db02 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
$ ssh db02 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
$ ssh db01 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
$ ssh db01 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
PS：如果提示是否连接选择yes，密码输入oracle用户的密码
7.在每个节点上分别设置authorized_keys文件的权限
# chmod 644 ~/.ssh/authorized_keys
8.防止X11转发造成的安装失败,创建~ /.ssh/config，并加入如下内容。
Host *
ForwardX11 no
9.以oracle用户身份，运行Oracle Universal Installer的节点上执行如下命令，然后测试ssh的对等性。
# exec /usr/bin/ssh-agent $SHELL
节点1
# ssh db01 date
# ssh db02 date
节点2
# ssh db02 date
# ssh db01 date
如果都不需要密码，得到时间后。就说明ssh对等性配置成功。
2.2.6安装fix包所需补丁(到IBM网站上下载补丁)
本文档所使用的版本 AIX 5305，HACMP 5.2只需要打一个hamcp的补丁 IY60759即可。
补丁可根据自己的实际情况来决定。
2.2.7打完补丁，包括调整完异步IO等，建议重启一次机器
# shutdown –Fr
2.2.8配置HACMP
1.创建集群
# smitty hacmp
Initialization and Standard Configuration
Add Nodes to an HACMP Cluster
Configure Nodes to an HACMP Cluster (standard)
Type or select values in entry fields.
Press Enter AFTER making all desired changes.
[Entry Fields]
* Cluster Name [dbclt]
New Nodes (via selected communication paths) [db01 db02] +
Currently Configured Node(s)
2.创建资源组racdbrg
# smitty hacmp
Initialization and Standard Configuration
Configure HACMP Resource Groups
Add a Resource Group
Add a Resource Group
Type or select values in entry fields.
Press Enter AFTER making all desired changes.
[Entry Fields]
* Resource Group Name [racdbrg]
* Participating Nodes (Default Node Priority) [db01 db02] +
Startup Policy Online On All Available Nodes +
Fallover Policy Bring Offline (On Error Node Only) +
Fallback Policy Never Fallback +
3.为资源组racdbrg增加共享磁盘
# smitty hacmp
Initialization and Standard Configuration
Configure HACMP Resource Groups
Change/Show Resources for a Resource Group (standard)
Select a Resource Group
Move cursor to desired item and press Enter.
datavg
Change/Show All Resources and Attributes for a Resource Group
Type or select values in entry fields.
Press Enter AFTER making all desired changes.
[Entry Fields]
Resource Group Name racdbrg
Participating Nodes (Default Node Priority) db01 db02
Startup Policy Online On All Available Nodes
Fallover Policy Bring Offline (On Error Node O>
Fallback Policy Never Fallback
Concurrent Volume Groups [datavg] +
Use forced varyon of volume groups, if necessary false +
Application Servers [] +
4.配置串口网络作为HB
# smitty hacmp
Extended Configuration
Extended Topology Configuration
Configure HACMP Communication Interfaces/Devices
Add Communication Interfaces/Devices
Select a category
Move cursor to desired item and press Enter.
> Add Discovered Communication Interface and Devices
Add Pre-defined Communication Interfaces and Devices
Select a category
Move cursor to desired item and press Enter.
Discovery last performed: (Dec 08 20:10)
Communication Interfaces
> Communication Devices
Select Point-to-Point Pair of Discovered Communication Devices to Add
Move cursor to desired item and press F7. Use arrow keys to scroll.
ONE OR MORE items can be selected.
Press Enter AFTER making all selections.
Node Device Device Path Pvid
db01 hdisk2 /dev/hdisk2 0002ee503cc
db02 hdisk2 /dev/hdisk2 0002ee503cc
> db01 tty0 /dev/tty0
> db02 tty0 /dev/tty0
4.配置HB IP网络
# smitty hacmp
Extended Configuration
Extended Topology Configuration
Configure HACMP Networks
Change/Show a Network in the HACMP Cluster
Select a Network to Change/Show
Move cursor to desired item and press Enter.
net_ether_01 (192.168.0.0/24)
net_ether_02 (10.10.2.0/24)
Change/Show an IP-Based Network in the HACMP ClusterType or select values in entry fields.
Press Enter AFTER making all desired changes.
[Entry Fields]
* Network Name net_ether_02
New Network Name []
* Network Type [ether]
* Netmask [255.255.255.0]
* Enable IP Address Takeover via IP Aliases [Yes]
IP Address Offset for Heartbeating over IP Aliases []
* Network attribute private
5.同步集群配置文件
# smitty hacmp
Extended Configuration
Extended Verification and Synchronization
HACMP Verification and Synchronization
Type or select values in entry fields.
Press Enter AFTER making all desired changes.
[Entry Fields]
* Verify, Synchronize or Both [Both]
* Automatically correct errors found during [Yes]
verification?
* Force synchronization if verification fails? [No]
* Verify changes only? [No]
* Logging [Standard]
6.测试HACMP集群
第一个节点
# hostname
db01
# smitty clstart --启动hacmp
# lssrc -g cluster --查看hacmp的状态
第二个节点
# hostname
db02
# smitty clstart
# lssrc -g cluster
# lsvg -o
datavg
rootvg
# lsvg -l datavg
datavg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
rac_crs1024m jfs 2 2 1 closed/syncd N/A
rac_vote1024m jfs 2 2 1 closed/syncd N/A
rac_system_1024m jfs 4 4 1 closed/syncd N/A
rac_pwdfile_100m jfs 1 1 1 closed/syncd N/A
rac_sysaux_800m jfs 4 4 1 closed/syncd N/A
rac_undo1_4096m jfs 16 16 1 closed/syncd N/A
rac_undo2_4096m jfs 16 16 1 closed/syncd N/A
rac_temp_4096m jfs 16 16 1 closed/syncd N/A
rac_users_800m jfs 4 4 1 closed/syncd N/A
rac_redo1_1_120m jfs 2 2 1 closed/syncd N/A
rac_redo1_2_120m jfs 2 2 1 closed/syncd N/A
rac_redo1_3_120m jfs 2 2 1 closed/syncd N/A
rac_redo2_1_120m jfs 2 2 1 closed/syncd N/A
rac_redo2_2_120m jfs 2 2 1 closed/syncd N/A
rac_redo2_3_120m jfs 2 2 1 closed/syncd N/A
rac_ctl1_110m jfs 1 1 1 closed/syncd N/A
rac_ctl2_110m jfs 1 1 1 closed/syncd N/A
rac_ctl3_110m jfs 1 1 1 closed/syncd N/A
rac_spfile_110m jfs 1 1 1 closed/syncd N/A
第一个节点：
# hostname
db01
# smitty clstop
第二个节点：
# hostname
db02
# smitty clstop
# lsvg
rootvg
datavg
# lsvg -o
rootvg
