Ranjit's Oracle Blogs: ADDING A NODE TO A 10g RAC CLUSTER

ADDING A NODE TO A 10g RAC CLUSTER

--------------------------------------------------------------

The most important steps that need to be followed are;

A. Configure the OS and hardware for the new node.

B. Add the node to the cluster.

C. Add the RAC software to the new node.

D. Reconfigure listeners for new node.

E. Add ASM Instance Manually

F. Add instances via DBCA.

A. Configure the OS and hardware for the new node.

-------------------------------------------------------

Prepare the OS and Storage configuration same as current running nodes.

Please consult with available OS vendor documentation for this step.

See Note 264847.1 for network requirements. Also verify that the OCR and Voting files are visible from the new node with correct permissions.

B. Add the node to the cluster.

------------------------------------

B(1). If the CRS Home is owned by root and you are on a version < 10.1.0.4, change the ownership of the CRS Home directories on all nodes to the Oracle user so that OUI can read and write to these directories.

Example:

On rac1 with oracle user:

cd $ORA_CRS_HOME/oui/bin

$ ./addNode.sh

click next.

On the "Specify Cluster Nodes to Add to Installation" screen, add the public and private node names (these should exist in /etc/hosts and should be ping from each of the cluster nodes), click next

Click Next,The "Cluster Node Addition Progress" screen will appear.

Then, You will then be prompted to run rootaddnode.sh as the root user.

Now follow the above screen Instruction:

On Node1 as root user:

#/oracle/product/10.2.0/crs/install/rootaddnode.sh

on Node2 as root user:

#/oracle/product/10.2.0/crs/root.sh

Note:

Once this is finished, click OK in the dialog box to continue, and please Check the CRS home directory, before it was empty now it’s showing with CRS Home.

And also check with olsnodes -n, it shows 2 nodes configuration for cluster.

B(2). after running the CRS root.sh on all new nodes, as the root user run the racgons configuration script

#CRS_HOME/bin/racgons add_config New_node:

Example:

On rac2 with root user:

#ORA_CRS_HOME/bin/racgons add_config rac2:6200 from any node.

Note:

We can find the remote port from the following directory

# cat CRS_HOME/opmn/conf/ons.config

Localport=6100

Remoteport=6200

Loglevel=3

Useocr=on

Note:

I checked on node2 whether the RAC software was successfully installed or not, on node 2:

Node2# cd /oracle/product/10.2.0/crs

#ls

Its show all the files

And also I tried to check the oracle software whether it’s installed or not, on node 2:

node2# cd /oracle/product/10.2.0/db_1

No binaries are installed..its showing empty.

So now try to add the oracle software to the new node (node2).

C. Add the Oracle RAC Database software to New Node with oracle user.

------------------------------------------------------------------------------------

C(1).On a pre-existing node, cd to the $ORACLE_HOME/oui/bin directory and run the addNode.sh script as a oracle user.

c Example:

DISPLAY=ipaddress:0.0; export DISPLAY

On node1 with oracle user:

cd $ORACLE_HOME/oui/bin

./addNode.sh

The OUI Welcome screen will appear, click next.

On the "Specify Cluster Nodes to Add to Installation" screen, specify the node you want to add, click next.

The "Cluster Node Addition Summary" screen will appear, click next

The "Cluster Node Addition Progress" screen will appear. You will then be prompted to run root.sh as the root user.

Follow the above screen Instruction:

On Node2 with root user, run the scrip root.sh:

#/oracle/product/10.2.0/db_1/root.sh

Once this is finished, click OK in the dialog box to continue.

Next you will see the "End of Installation" screen. At this point you may exit the installer.

C(2).Verify that interconnect information is correct with:

oifcfg getif

If it is not correct, change it with:

oifcfg setif command

For example:

crs_home/bin#oifcfg setif -global eth1/10.10.10.0:cluster_interconnect

crs_home/bin# oifcfg setif -node eth1/10.10.10.0:cluster_interconnect

D. Reconfigure listeners for new node.

------------------------------------------------------

Run NETCA on the NEW node as oracle user to verify that the listener is configured on the new node.

Example:

On RAC2:

DISPLAY=ipaddress:0.0; export DISPLAY

$netca

Run crs_stat to verify that the listener CRS resource was created and confirm that all VIP's, GSD's, ONS's, and listeners are ONLINE.

Example:

cd $ORA_CRS_HOME/bin

./crs_stat -t

E.Add ASM instance on new node manually

-------------------------------------------------------------
E(1). add ASM entry in /etc/oratab on new node +ASM2:/u01/app/oracle/product/10.2.0/db_1:NE(2). modify init+ASM1.ora in /u01/app/oracle/product/10.2.0/db_1/dbs cd /u01/app/oracle/product/10.2.0/db_1/dbs mv init+ASM1.ora init+ASM2.ora mv orapw+ASM1 orapw+ASM2E(3).create admin directories for ASM instance mkdir /u01/app/oracle/admin/+ASM/udump cdump hdump bdump pfileE(4).copy init.ora from node1 to new nodenode1$ cd /u01/app/oracle/admin/+ASM/pfileNode1$ scp init.ora oracle@rac2:/oracle/product/10.2.0/admin/+ASM/pfile/E(5). add new ASM instance in /u01/app/oracle/admin/+ASM/pfile/init.ora on all RAC nodesVi init.ora on rac1 and rac2 +ASM2.instance_number=2E(6). add ASM to cluster$srvctl add asm -n rac2 -i +ASM2 -o /u01/app/oracle/product/10.2.0/db_1E(7).start asm instance$srvctl start asm -n rac2

E(8).Check the new ASM Instance add to cluster list with crs_stat command