In continuation to my previous posts on Workshop on RAC and ASM and 12c New Feature Pluggable Database. Today I am posting the installation steps for RAC with ASM on the latest Oracle Database 12c release, which I managed to install on my laptop.
Disclaimer:Please consider this as only checklist and steps and not a end-to-end installation guide to install RAC with ASM on Oracle Database 12c.
Following is the list of steps which I had performed for my installation:
1. Download Oracle VM VirtualBox from here.
2. Download Oracle Enterprise Linux 6 from Edelivery
EDelivery-Oracle-12c-Database-Grid-
3. Download Oracle 12c Database for Linux 64 bit (2 Parts – size ) from Edelivery (highlighted in above image)
4. Download Oracle 12c Database Grid for Linux 64 bit (2 Parts – size ) from Edelivery (highlighted in above image)
5. Install VM Virtual Box and OEL 6 on VM Virtual Box.
VirtualBox Guest Additions Package can be installed from this location. Post installation it will prompt you to install the extension package which can be downloaded from here.
6. OEL6 comes with pre-installed oracle users and oinstall users. Ensure that you select the package oracle-rdbms-server-11gR2-preinstall available under system tools. More information on this is available here.
7. At this point, its better if you take the snapshot of your virtual machine. This would help you to avoid repeating the previous steps incase of any issues.
8. Setup the .bash_profile, grid_env and db_env in oracle user home directory.
9. Setup the public ip address, vip address, private address and scan address in the /etc/hosts file.
10. Create directory for oracle database and inventory.
11. Copy the Oracle Software and Grid Software to the path you had mentioned in the .bash_profile.
12. Go to the Grid/rpm directory and install rpm cvuqdisk-1.0.9-1.rpm.
13. Create ASM disks and make it shareable. Login as root partition the disks created under /dev using fdisk command.
14. Install oracleasmlib-2.0.4-1.el6.x86_64.rpm. Use the oracleasm command to createdisks for asm using the disks created in step 12.
15. Clone the Virtual Machine for second node. Ensure that firewall on both the machine are disabled.
16. Configure the second node for Network (for public address and vip address)
17. Setup the SSH password less connectivity to avoid the user equivalence error.
18. Copy the Oracle 12c database files in the inventory location (under /u01)
19. Install the Grid (from /u01/grid/runInstall)
20. This will invoke Installer for Oracle Grid Infrastructure. The wizard includes 13 steps. Including mainly cluster configuration and Creation of ASM Disk Groups.
21. Now, the system is ready to install the Oracle 12c Database (goto /u01/database and run ./runInstaller)
22. At this point, its better if you take the snapshot of your virtual machine again. This would help you to avoid repeating the previous steps in case of any issues.
23. The above command will launch the Oracle Database 12c Release 1 Installer, which is again a 13 steps.
24. Login into the sqlplus and confirm the installation. As shown in below screenshot:
Some Errors which I came across while installing RAC with ASM:
1. OEL6 by default gets installed without desktop and GUI. Default package installation of OEL6 does not include desktop GUI installation. This was resolved by clicking on custom option and selecting the desktop view. (You can also choose either gnome or kde)
2. User Equivalence Error. This was resolved by setting the SSH connectivity and disabling the firewall.
3. Network ethernet settings post clone were not set up properly this led to error while setting up the cluster settings at the time of GRID installation.
4. I missed out step to install cvuqdisk-1.0.9-1.rpm.
5. ASM location was not showing during the GRID installation. This was due to the missing oracleasm rpm.
6. First installation failed because of shortage of disk space. Only 25GB of disk space which was allocated. This was resolved by allocating 35GB to the virtual disk. In addition to this I had allocated 5GB to each ASM disks. Making the total space for the installation for 1 rac node 50GB and if I include the clone node the total installation used up 85GB. Since ASM disks were shared between the nodes.
7. During the Database installation. Database was showing as ‘orcl.localdomain’ by default. This had to be changed to RAC as configured in the .bash_profile file.
Hope you find this steps and content useful for installing RAC on Oracle 12c with ASM. Please feel free to leave your comments.
Happy ‘RAC’ ing 🙂
Cheers!
Vijay
Visit Vijay’s Oracle photo gallery here and know more about him here
23, 24, 25, 26 February 2013 Hotel Lemon Tree, Electronic City, Bangalore, India.
Workshop on Oracle 11gR2 DBA – RAC and ASM
Recently I had attended the workshop on Oracle RAC and ASM at Electronic City, Bangalore, India. The training was given by RAC guru Murali Vallath. I am sharing my learning and experience from this workshop.
I sincerely thank Murali for inspiring and encouraging me to learn the latest feature in Oracle – RAC and ASM.
The training batch comprised participants from different geographical location and spanning different industries. I feel lucky to be part of this batch. Lastly, I thank Sai Ram for organizing this workshop.
Standing (L to R): Syed, Abul, Chandra, Amit, Prabhakar, Vijay (me), Vasu, Rukmini
Sitting (L to R): Bikash, Gautam, Murali, Kushal, Milind, Vivek, Sathish
Photo clicked by Sai Ram, Venue: Lemon Tree Hotel, Electronic City, Bangalore, India
What is Clustering?
Clustering is the grouping of individual computers in such a way that they can act as a single computer system. These combined resources can then be presented to applications as a single system. One benefit of a cluster is that the application does not need to be cluster “aware”, and requires no special coding to take advantage of most cluster related services.
Oracle clustering is a shared everything architecture that involves sharing of storage by the systems of the cluster.
Oracle RAC:
Oracle RAC stands for Real Application Cluster. It was introduced by Oracle with 9i release. Latest version is 11gR2.
Oracle RAC is a cluster database with a shared cache architecture that overcomes the limitations of traditional shared-nothing and shared-disk approaches to provide highly scalable and available database solutions for all your business applications. Oracle RAC is a key component of Oracle’s private cloud architecture.
Single Instance Vs RAC Instance
As can be seen from the below diagram Oracle RAC database has more than one instance, whereas the database is single and shared across all the instances. Thus focus of RAC is on share everything concept. This ensures availability of Oracle database and also the scalability. Each RAC instance is installed on different machine (called nodes) thus scaling the computing power and maximizing availability.
Below is the architecture diagram which shows the implementation of Oracle RAC instance in real life scenario. What it additionally shows is the interconnect (hb) i.e high speed communication between the RAC instances to ensure ACID (Atomicity, Consistency, Independent and Durability).
An Oracle ASM instance is a special Oracle instance that manages Oracle ASM disks.
It’s an instance for Storage Management. Both the ASM and the database instances require shared access to the disks in an ASM disk group.
ASM instances manage the metadata of the disk group and provide file layout information to the database instances. Database instances direct I/O to ASM disks without going through an ASM instance.
An ASM instance is built on the same technology as a database instance. For example, an ASM instance has a system global area (SGA) and background processes that are similar to those of a database instance. However, an ASM instance cannot mount a database and performs fewer tasks than a database instance.
Oracle Commands for RAC & ASM
I have tried to highlight the commands which are used for different instances. As the system has grown with different components, so have the commands to manage and monitor them. Below table shows the list of commands, their usage, where used (RAC/ASM) and home directory where the command is located.
Cluster Verify Utility or cvu performs system checks in integrity of all nodes, integrity of OCR, connectivity between all nodes, compare properties of one node with that of other and space availability
Starting and stopping Oracle Clusterware resources, Enabling and disabling Oracle Clusterware daemons, Checking the health of the cluster, Managing resources that represent third-party applications.
Server Control Utility to manage the Oracle RAC database. SRVCTL commands to add, remove, start, stop, modify, enable, and disable a number of components/objects, such as databases, instances, listeners, SCAN listeners, services, grid naming service (GNS), and Oracle ASM.Some SRVCTL operations for instance, database, service and nodeapps modify the configuration data stored in the Oracle Cluster Registry (OCR). Good link which shows various options for this command is here
ASMCMD is a command-line utility that you can list the content, perform searches, create and remove directories and aliases, display space utilization within Automatic Storage Management (ASM) disk groups. Orafaq link for ASMCMD is here
The ocrconfig command is used to manage the OCR. Ocrconfig provides the ability to import, export, add, delete, restore, overwrite, backup, repair, replace, move, upgrade, or downgrade the OCR. Same command can be used for OLR using –local option.
The ocrdump utility allows you to dump the contents of the OCR or the OLR to a file or to stdout. You can then read the resulting output for diagnostic and administration purposes.
The ocrcheck utility is used to validate the integrity of the OCR and the OLR. Use the ocrcheck command whenever you have made any changes to your cluster (such as changing the VIP for example)
The Oracle Interface Configuration Tool is used to define and administer network interfaces such as the public and private interfaces.
Y
Grid Home,Run as oracle User
Processes
I have tried to consolidate all processes which are available in Single Instance, RAC Instance and ASM Instance of Oracle 11gR2 Database.
Processes
Name
Instance
Single
RAC
ASM
ACFS
ASM Cluster File System CSS Process
Y
Y
ACMS
Atomic Controlfile to Memory Service (ACMS). In an Oracle RAC environment
Y
ARBn
ASM Rebalance Process
Y
ARBx
Background Process
Y
Y
ARCH
Archiver Process
Y
Y
ARCHMON
Archive Monitor
Y
Y
ASMB
Automatic Storage Management
Y
Y
Y
BMRn
Automatic Block Media Recovery Slave Pool Process
Y
Bnnn
ASM Blocking Slave Process for GMON
Y
CJQ0
Job Queue Coordinator Process
Y
CKPTxx
Checkpoint
Y
Y
CTWR
Change Tracking Writer
Y
Y
DBRM
Database Resource Manager Process
Y
DBWn
Database Writer
Y
Y
DIAG
Diagnostic Capture Process
Y
Y
DMnn
Data Pump Master Process
Y
Dnnn
Dispatcher
Y
Y
DRnn
ASM Disk Resynchronization Slave Process
Y
EMNC
EMON Coordinator Process
Y
Y
Ennn
EMON Slave Process
Y
Y
EXTPROC
Callout queues
Y
Y
FBDA
Flashback Data Archiver Process
Y
Y
FMON
File Mapping Monitor Process
Y
Y
GEN0
General Task Execution Process
Y
Y
GMON
ASM Disk Group Monitor Process
Y
GTX0-j
Global Transaction Process. The GTX0-j process provides transparent support for XA global transactions in a RAC environment. The database autotunes the number of these processes based on the workload of XA global transactions.
Y
Innn
Disk and Tape I/O Slave Process
Y
Jnnn
Job Queue Slave Process
Y
LCK0
Instance Enqueue Process. The LCK0 process manages non-Cache Fusion resource requests such as library and row cache requests.
Y
LCKn
Lock Process
Y
Y
LGWR
Log Writer
Y
Y
LISTENER
TCPIP server
Y
Y
LMD
Global Enqueue Service Daemon. The LMD process manages incoming remote resource requests within each instance.
Y
LMHB
Global Cache/Enqueue Service Heartbeat Monitor
Y
Y
Y
LMON
Global Enqueue Service Monitor. The LMON process monitors global enqueues and resources across the cluster and performs global enqueue recovery operations.
Y
LMS
Global Cache Service Process. The LMS process maintains records of the datafile statuses and each cached block by recording information in a Global Resource Directory (GRD).
Y
MARK
Mark AU for Resynchronization Coordinator Process
Y
Y
MMAN
Background Process
Y
Y
MMNL
Memory Monitor Light
Y
Y
MMON
Memory Monitor
Y
Y
Mnnn
MMON Slave Process
Y
Y
ORBn
Background Process
Y
Y
OSMB
Background Process
Y
Y
PING
Interconnect Latency Measurement Process
Y
Y
Y
PMON
Process Monitor
Y
Y
Pnnn
Parallel Query Slave
Y
Y
PRnn
Parallel Recovery Process
Y
PSP0
Process Spawner Process
Y
Y
QMNxx
Advanced Queueing Processes
Y
Y
RBAL
Background Process
Y
Y
RCBG
Result Cache Background Process
Y
Y
RECO
Distributed Transaction Recoverer
Y
Y
RMSn
Oracle RAC Management Processes (RMSn).
Y
RSMN
Remote Slave Monitor manages background slave process creation and communication on remote instances.
Workshop also touched Data Guard theory and Performance Tuning in RAC.
I have tried to share what I learnt in a very simple and concise manner. I hope you find this article useful and If you feel that something could have been done better kindly drop me mail at info@mahawar.net
Cheers!
Vijay Mahawar
Visit Vijay’s Oracle photo gallery here and know more about him here
A given monitor requires more power to display a white (or light) screen than a black (or dark) screen.
"Blackle.com - Saving energy one search at a time"
All content provided in this blog is for informational purposes only.
The owner of this blog makes no representations as to the accuracy or completeness of any information on this site or found by following any link on this site.
The owner will not be liable for any errors or omissions in this information nor for the availability of this information.
The owner will not be liable for any losses, injuries, or damages from the display or use of this information.
The opinions expressed here represent his own and not those of his employer.
