Oracle® Real Application Clusters
Administration and Deployment Guide
11g Release 2 (11.2)
E16795-08
October 2010
Oracle Real Application Clusters Administration and Deployment Guide, 11g Release 2 (11.2)
E16795-08
Copyright © 1999, 2010, Oracle and/or its affiliates. All rights reserved.
Primary Author: Richard Strohm
Contributing Authors: Troy Anthony, Lance Ashdown, Ram Avudaiappan, Prasad Bagal, Mark Bauer,
Anand Beldalker, Eric Belden, Gajanan Bhat, David Brower, George Claborn, Carol Colrain, Jonathan
Creighton, Rajesh Dasari, Steve Fogel, Richard Frank, GP Prabhaker Gongloor, Wei Hu, Yong Hu,
Dominique Jeunot, Sameer Joshi, Raj K. Kammend, Sana Karam, Roland Knapp, Ken Lee, Karen Li, Barb
Lundhild, Venkat Maddali, Bill Manry, Gaurav Manglik, John McHugh, Saar Maoz, Matthew Mckerley,
Markus Michalewicz, Anil Nair, Philip Newlan, Michael Nowak, Muthu Olagappan, Bharat Paliwal, Hanlin
Qian, Mark Ramacher, Kevin Reardon, Dipak Saggi, Sudheendra Sampath, Viv Schupmann, Daniel Semler,
Ara Shakian, Cathy Shea, Khethavath P. Singh, Kesavan Srinivasan, Janet Stern, Leo Tominna, Peter Wahl,
Tak Wang, Richard Wessman, Douglas Williams, Mike Zampiceni, Michael Zoll
This software and related documentation are provided under a license agreement containing restrictions on
use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your
license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license,
transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse
engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is
prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If
you find any errors, please report them to us in writing.
If this software or related documentation is delivered to the U.S. Government or anyone licensing it on
behalf of the U.S. Government, the following notice is applicable:
U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data
delivered to U.S. Government customers are "commercial computer software" or "commercial technical data"
pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As
such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and
license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of
the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software
License (December 2007). Oracle USA, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
This software is developed for general use in a variety of information management applications. It is not
developed or intended for use in any inherently dangerous applications, including applications which may
create a risk of personal injury. If you use this software in dangerous applications, then you shall be
responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure the safe use
of this software. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of
this software in dangerous applications.
Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks
of their respective owners.
This software and documentation may provide access to or information on content, products, and services
from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all
warranties of any kind with respect to third-party content, products, and services. Oracle Corporation and
its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of
third-party content, products, or services.
iii
Contents
Preface ............................................................................................................................................................... xix
Audience..................................................................................................................................................... xix
Documentation Accessibility................................................................................................................... xix
Related Documents ................................................................................................................................... xx
Conventions ............................................................................................................................................... xxi
What's New in Oracle RAC Administration and Deployment? ..................................... xxiii
Oracle Database 11g Release 2 (11.2.0.2) New Features in Oracle RAC.......................................... xxiii
Oracle Database 11g Release 2 (11.2.0.1) New Features in Oracle RAC.......................................... xxiv
1 Introduction to Oracle RAC
Overview of Oracle RAC ........................................................................................................................ 1-1
Overview of Oracle Clusterware for Oracle RAC.............................................................................. 1-3
Overview of Oracle RAC Architecture and Processing .................................................................... 1-4
Understanding Cluster-Aware Storage Solutions......................................................................... 1-4
Overview of Connecting to Oracle Database Using Services and VIP Addresses................... 1-4
About Oracle RAC Software Components..................................................................................... 1-6
About Oracle RAC Background Processes..................................................................................... 1-6
Overview of Automatic Workload Management ............................................................................... 1-7
Overview of Installing Oracle RAC ..................................................................................................... 1-9
Understanding Compatibility in Oracle RAC Environments ..................................................... 1-9
Overview of Oracle RAC Installation and Database Creation................................................. 1-10
Overview of Extending the Grid Infrastructure and Oracle RAC Software .......................... 1-11
Overview of Managing Oracle RAC Environments....................................................................... 1-12
About Designing and Deploying Oracle RAC Environments.................................................. 1-12
About Administrative Tools for Oracle RAC Environments ................................................... 1-13
About Monitoring Oracle RAC Environments........................................................................... 1-14
About Evaluating Performance in Oracle RAC Environments................................................ 1-15
2 Administering Storage
Overview of Storage in Oracle RAC..................................................................................................... 2-1
Optimal Flexible Architecture ............................................................................................................... 2-2
Data File Access in Oracle RAC ............................................................................................................ 2-2
Redo Log File Storage in Oracle RAC .................................................................................................. 2-3
Automatic Undo Management in Oracle RAC................................................................................... 2-3
iv
Oracle Automatic Storage Management in Oracle RAC .................................................................. 2-4
Storage Management in Oracle RAC .............................................................................................. 2-4
Modifying Disk Group Configurations for Oracle ASM in Oracle RAC................................... 2-5
Oracle ASM Disk Group Management........................................................................................... 2-5
Configuring Preferred Mirror Read Disks in Extended Distance Clusters ............................... 2-6
Converting Single-Instance Oracle ASM to Clustered Oracle ASM........................................... 2-6
Administering Oracle ASM Instances with SRVCTL in Oracle RAC......................................... 2-6
3 Administering Database Instances and Cluster Databases
Tools for Administering Oracle RAC................................................................................................... 3-1
Overview of Oracle RAC Database Administration..................................................................... 3-2
Using the Same Cluster for Administrator-Managed and Policy-Managed Databases... 3-3
Converting an Administrator-Managed Database to a Policy-Managed Database.......... 3-3
Administering Oracle RAC with Oracle Enterprise Manager..................................................... 3-4
Administering Oracle RAC with SQL*Plus ................................................................................... 3-5
Changing the SQL*Plus Prompt ............................................................................................... 3-6
How SQL*Plus Commands Affect Instances.......................................................................... 3-6
Administering Oracle RAC with SRVCTL..................................................................................... 3-7
Starting and Stopping Instances and Oracle RAC Databases......................................................... 3-7
Overview of Starting and Stopping Oracle RAC Instances......................................................... 3-8
Starting and Stopping with Oracle Enterprise Manager.............................................................. 3-8
Starting Up and Shutting Down with SQL*Plus ........................................................................... 3-8
Starting Up and Shutting Down with SRVCTL............................................................................. 3-9
Verifying That Instances are Running .............................................................................................. 3-10
Terminating Sessions On a Specific Cluster Instance.................................................................... 3-11
Overview of Initialization Parameter Files in Oracle RAC .......................................................... 3-13
Setting SPFILE Parameter Values for Oracle RAC..................................................................... 3-13
Parameter File Search Order in Oracle RAC............................................................................... 3-14
Backing Up the Server Parameter File ......................................................................................... 3-15
Initialization Parameter Use in Oracle RAC.................................................................................... 3-15
Parameters That Must Have Identical Settings on All Instances ............................................. 3-17
Parameters That Have Unique Settings on All Instances.......................................................... 3-18
Parameters That Should Have Identical Settings on All Instances.......................................... 3-19
Quiescing Oracle RAC Databases...................................................................................................... 3-20
Administering Multiple Cluster Interconnects on Linux and UNIX Platforms ....................... 3-21
Recommendations for Setting the CLUSTER_INTERCONNECTS Parameter...................... 3-21
Usage Examples for the CLUSTER_INTERCONNECTS Parameter....................................... 3-22
Customizing How Oracle Clusterware Manages Oracle RAC Databases ................................. 3-23
Advanced Oracle Enterprise Manager Administration ................................................................. 3-24
Using Oracle Enterprise Manager Grid Control to Discover Nodes and Instances.............. 3-25
Other Oracle Enterprise Manager Capabilities........................................................................... 3-25
Administering Jobs and Alerts in Oracle RAC........................................................................... 3-26
Administering Jobs in Oracle RAC ....................................................................................... 3-26
Administering Alerts in Oracle RAC with Oracle Enterprise Manager .......................... 3-27
Performing Scheduled Maintenance Using Defined Blackouts in
Oracle Enterprise Manager.................................................................................................... 3-27
v
4 Administering Oracle RAC One Node
Adding an Oracle RAC One Node Database...................................................................................... 4-2
Converting Databases.............................................................................................................................. 4-3
Converting a Database from Oracle RAC to Oracle RAC One Node......................................... 4-3
Converting a Database from Oracle RAC One Node to Oracle RAC......................................... 4-3
Online Database Relocation................................................................................................................... 4-4
5 Introduction to Automatic Workload Management
Overview of Automatic Workload Management ............................................................................... 5-2
Automatic Workload Repository........................................................................................................... 5-3
Service Deployment Options................................................................................................................. 5-3
Using Oracle Services........................................................................................................................ 5-4
Service Characteristics....................................................................................................................... 5-4
Service Name............................................................................................................................... 5-4
Net Service Name ....................................................................................................................... 5-5
Service Edition............................................................................................................................. 5-5
Service Management Policy ...................................................................................................... 5-5
Database Role for a Service ....................................................................................................... 5-5
Instance Preference..................................................................................................................... 5-5
Server Pool Assignment............................................................................................................. 5-6
Load Balancing Advisory Goal for Runtime Connection Load Balancing......................... 5-6
Connection Load Balancing Goal ............................................................................................. 5-7
Distributed Transaction Processing ......................................................................................... 5-7
Subscription to High Availability Events................................................................................ 5-7
Transparent Application Failover Policy ................................................................................ 5-7
Service Usage in an Oracle RAC Database..................................................................................... 5-8
Resource Profile for a Service.................................................................................................... 5-8
Database Resource Manager Consumer Group Mappings for Services............................. 5-8
Performance Monitoring by Service with AWR..................................................................... 5-8
Parallel Operations and Services.............................................................................................. 5-8
Oracle Streams and Oracle RAC............................................................................................... 5-9
Default Service Connections............................................................................................................. 5-9
Connection Load Balancing ................................................................................................................... 5-9
Client-Side Load Balancing............................................................................................................ 5-10
Generic Database Clients........................................................................................................ 5-10
Other Client-Side Connection Features ....................................................................................... 5-10
JDBC Clients ............................................................................................................................. 5-11
Oracle Call Interface Clients................................................................................................... 5-11
Server-Side Load Balancing........................................................................................................... 5-11
Fast Application Notification.............................................................................................................. 5-12
Overview of Fast Application Notification................................................................................. 5-12
Application High Availability with Services and FAN............................................................. 5-13
Managing Unplanned Outages..................................................................................................... 5-13
Managing Planned Outages .......................................................................................................... 5-14
Fast Application Notification High Availability Events ........................................................... 5-14
Using Fast Application Notification Callouts............................................................................. 5-16
