/ dot-dot dot Title:10g RAC Installation Notes Author: Dan Bikle This page contains links to some notes I gathered after the finishing of a 10g RAC installation. This page is designed for a browser configured with tabbed browsing (Mozilla: Edit-Preferences-TabbedBrowsing, check last 3 boxes) so that you load each link into a tab rather than a new window. I started the effort by writing up a simple project plan: 10gRACprojectPlan.txt Next, I located the suitable installation document: http://download-west.oracle.com/docs/html/B10766_08/toc.htm Some other interesting documents: http://tahiti.oracle.com http://download-west.oracle.com/docs/cd/B14117_01/rac.101/b10765/toc.htm http://download-west.oracle.com/docs/cd/B14117_01/rac.101/b10768/toc.htm http://download-west.oracle.com/docs/html/B14406_01/toc.htm This was my second try at a 10g RAC installation. My first try (several months ago) was with a set of low price commodity hardware. Each component (hosts, interface cards, storage, OS) was from a different vendor. I was unable to get the storage to adequately communicate with the hosts through fiber channel. My first try at 10g RAC failed. My second try succeeded due to the simplified nature of my hardware setup. Everything came from Sun (hosts, interface cards, storage, and OS). Sun had engineered all this stuff to work together and that made my life a lot simpler. So I had Oracle installing on top of Sun and the installation went smooth as silk. After I was done with the 10g RAC installation, I used an ssh tunnel to attach a browser outside the datacenter to port 5500 on one of the RAC nodes. The RAC installer activates that port for a mini application server known as: Enterprise Manager Database Control. Any DBA who needs to administer 10g RAC will be dependent on Enterprise Manager Database Control. Suppose you have this setup: browserHost ---- host1 ------- host2 ------- racnode1 To establish the tunnel you first issue a command from host2: ssh racnode1 -L 5500:racnode1:5500 This will place 5500 of racnode1 on 5500 of host2's localhost. You test the connection by running this command on host2: telnet localhost 5500 You should see something like this: telnet localhost 5500 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. You continue construction of the tunnel by issuing a command from host1 to host2: ssh host2 -L 5500:localhost:5500 Then you use telnet to test the tunnel again. If you can then see 5500, issue a command from the host of your browser: ssh host1 -L 5500:localhost:5500 Then you use telnet to test the tunnel again. If that works, type this URL into your browser: http://localhost:5500/em/ A recap: ssh racnode1 -L 5500:racnode1:5500 ssh host2 -L 5500:localhost:5500 ssh host1 -L 5500:localhost:5500 http://localhost:5500/em/ The above URL showed me a login screen: p10.jpg Home Page: p11.jpg p12.jpg p13.jpg Info in the above pages: Name of the DB Names of the instances Status of the instances DB version Some Environment Variables (ORACLE_HOME, etc, ...) Performance Tab: p14.jpg Display of cluster overhead: p15.jpg Drill down into... Cluster Cache Coherency GES = Global Enqueue Service p16.jpg p17.jpg http://www.google.com/search?hl=en&q=10g+rac+cluster+cache+coherency&btnG=Google+Search Administration Tab: p18.jpg Initialization Parameters: p19.jpg Notice the +DATA in the control_files parameter above. That is a clue that we are using ASM to manage the storage of this database. Sort by category to see Cluster related parameters: p20.jpg ref: http://download-west.oracle.com/docs/html/B10766_08/params.htm#i3001 http://download-west.oracle.com/docs/cd/B14117_01/rac.101/b10765/dbinstmgt.htm#CIHDDAGG Notice the handy info links in the page: p21.jpg p22.jpg p23.jpg p24.jpg p25.jpg p26.jpg p27.jpg p28.jpg Storage: p29.jpg Control Files: (Notice they are stored on ASM) p30.jpg p31.jpg p32.jpg Tablespace: p33.jpg Drill down to file. Again, on ASM: p34.jpg Datafiles: p35.jpg Other objects: p36.jpg p37.jpg p38.jpg p39.jpg Cluster Managed Database Services which have been enhanced in 10g so you may pool one or more instances into a service: p40.jpg p41.jpg p42.jpg p43.jpg p44.jpg p45.jpg Notice that the above pages have no method for creating a service; for that, we have DBCA (hopefully you can run X traffic between your desk and your datacenter): p46.jpg p47.jpg p48.jpg p49.jpg p50.jpg p51.jpg p52.jpg p53.jpg p54.jpg p55.jpg Maintenance Tab: p56.jpg Although the Maintenance Tab is full of interesting information, very little of it was 10g RAC specific. A comprehensive document which discusses the Maintenance Tab (and much more) may be found embedded within the context sensitive help system. If you return to the home page, near the stop light, you will find an interesting link next to the Cluster label: p57.jpg A click on the 'crs' link reveals a little world related to the Oracle clustering technology: p58.jpg p59.jpg The page is full of numerous links leading to abundant information about the underlying hardware and operating systems: p60.jpg p61.jpg p62.jpg p63.jpg p64.jpg p65.jpg p66.jpg p67.jpg p68.jpg p69.jpg p70.jpg p71.jpg p72.jpg Next, I took a side trip into the land of ASM which is Oracle technology to manage database access to LUNs supplied by the storage array. ASM offers some of the functionality provided by volume manager software: p73.jpg The above page connects to a tiny Oracle instance built specifically to provide a datastore to ASM. I logged in as 'SYS': p74.jpg p75.jpg p76.jpg p77.jpg More information about ASM may be found in Chap. 12 of the 10g Database Administrator's Guide: http://download-west.oracle.com/docs/cd/B14117_01/server.101/b10739/storeman.htm#i1021337 In addition to using EM DB control to interact with the RAC database, the DBA is free to use the srvctl command line utility which is documented in Appendix B of the 10g Real Application Clusters Administrator's Guide: http://download-west.oracle.com/docs/cd/B14117_01/rac.101/b10765/srvctladmin.htm#CDCGICIF A screen dump of the running of some srvctl commands is displayed below: srvctlSD.txt |