DoubleDBDeep

[ORACLE] 19c Grid Silent Mode 설치 | gridSetup response file + ASM DISKGROUP 생성 본문

ORACLE/INSTALL

[ORACLE] 19c Grid Silent Mode 설치 | gridSetup response file + ASM DISKGROUP 생성

DBCAMI 2023. 4. 26. 08:18
OS / ORACLE ENVIRONMENT
EDITION EE
RAC RAC 2 NODE
VERSION Oracle Database19c
SERVER Linux 7.9 (5.4.17-2102.201.3.el7uek.x86_64)

 

GI_HOME /u01/app/19c/grid
ORACLE_SID rac1, rac2
ORACLE_BASE /u01/app/oracle
ORACLE_HOME /u01/app/oracle/product/19.0.0/dbhome_1
oraInventory /u01/app/oraInventory

1. media file 준비 및 GI_HOME 경로에 압축해제

  • /media/engine 경로에 19.3.0.0.0 grid_home 압축파일을 준비해둔다.
  • grid 계정으로 접속

 

압축 해제

[+ASM1|grid:/media]> cd /media/engine/
[+ASM1|grid:/media/engine]> ls -al
total 5809468
drwxr-xr-x. 2 grid oinstall         80 Apr 25 13:09 .
drwxr-xr-x. 5 grid oinstall         44 Apr 25 13:08 ..
-rw-r--r--. 1 grid oinstall 3059705302 Apr 25 13:11 LINUX.X64_193000_db_home.zip
-rw-r--r--. 1 grid oinstall 2889184573 Apr 25 13:11 LINUX.X64_193000_grid_home.zip

[+ASM1|grid:/media/engine]> unzip LINUX.X64_193000_grid_home.zip -d $GI_HOME

 

2. 사전작업

  • gridSetup 전 cvuqdisk package 설치 - root
cd $GI_HOME/cv/rpm
rpm -ivh cvuqdisk-*.rpm
scp cvuqdisk-*.rpm rac2:/tmp
ssh root@rac2
cd /tmp
rpm -ivh cvuqdisk-*.rpm
exit
더보기

[rac1|root:/media/engine]> cd $GI_HOME/cv/rpm
[rac1|root:/u01/app/19c/grid/cv/rpm]> rpm -ivh cvuqdisk-*.rpm
Preparing...                          ################################# [100%]
package cvuqdisk-1.0.10-1.x86_64 is already installed
[rac1|root:/u01/app/19c/grid/cv/rpm]> scp cvuqdisk-*.rpm rac2:/tmp
root@rac2's password: 
cvuqdisk-1.0.10-1.rpm                                                100%   11KB   6.3MB/s   00:00    
[rac1|root:/u01/app/19c/grid/cv/rpm]> ssh root@rac2
root@rac2's password: 
Permission denied, please try again.
root@rac2's password: 
Last failed login: Tue Apr 25 15:37:41 KST 2023 from rac1 on ssh:notty
There was 1 failed login attempt since the last successful login.
Last login: Tue Apr 25 14:31:10 2023 from rac1
[rac2|root:/root]> cd /tmp
[rac2|root:/tmp]> rpm -ivh cvuqdisk-*.rpm
Preparing...                          ################################# [100%]
package cvuqdisk-1.0.10-1.x86_64 is already installed
[rac2|root:/tmp]> exit
logout
Connection to rac2 closed.

  • 노드간 비밀번호 없는 SSH 접속 설정 - grid
cd $GI_HOME/oui/prov/resources/scripts
./sshUserSetup.sh -user oracle -hosts "rac1 rac2" -noPromptPassphrase -advanced

 

더보기

[+ASM1|grid:/media/engine]> cd $GI_HOME/oui/prov/resources/scripts
[+ASM1|grid:/u01/app/19c/grid/oui/prov/resources/scripts]> ./sshUserSetup.sh -user oracle -hosts "rac1 rac2" -noPromptPassphrase -advanced
The output of this script is also logged into /tmp/sshUserSetup_2023-04-25-15-41-42.log
Hosts are rac1 rac2
user is oracle
Platform:- Linux 
Checking if the remote hosts are reachable
PING rac1 (10.0.5.101) 56(84) bytes of data.
64 bytes from rac1 (10.0.5.101): icmp_seq=1 ttl=64 time=0.018 ms
64 bytes from rac1 (10.0.5.101): icmp_seq=2 ttl=64 time=0.049 ms
64 bytes from rac1 (10.0.5.101): icmp_seq=3 ttl=64 time=0.035 ms
64 bytes from rac1 (10.0.5.101): icmp_seq=4 ttl=64 time=0.043 ms
64 bytes from rac1 (10.0.5.101): icmp_seq=5 ttl=64 time=0.045 ms

--- rac1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4078ms
rtt min/avg/max/mdev = 0.018/0.038/0.049/0.011 ms
PING rac2 (10.0.5.102) 56(84) bytes of data.
64 bytes from rac2 (10.0.5.102): icmp_seq=1 ttl=64 time=0.655 ms
64 bytes from rac2 (10.0.5.102): icmp_seq=2 ttl=64 time=0.427 ms
64 bytes from rac2 (10.0.5.102): icmp_seq=3 ttl=64 time=0.535 ms
64 bytes from rac2 (10.0.5.102): icmp_seq=4 ttl=64 time=0.921 ms
64 bytes from rac2 (10.0.5.102): icmp_seq=5 ttl=64 time=0.561 ms

--- rac2 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4092ms
rtt min/avg/max/mdev = 0.427/0.619/0.921/0.170 ms
Remote host reachability check succeeded.
The following hosts are reachable: rac1 rac2.
The following hosts are not reachable: .
All hosts are reachable. Proceeding further...
firsthost rac1
numhosts 2
The script will setup SSH connectivity from the host rac1 to all
the remote hosts. After the script is executed, the user can use SSH to run
commands on the remote hosts or copy files between this host rac1
and the remote hosts without being prompted for passwords or confirmations.

NOTE 1:
As part of the setup procedure, this script will use ssh and scp to copy
files between the local host and the remote hosts. Since the script does not
store passwords, you may be prompted for the passwords during the execution of
the script whenever ssh or scp is invoked.

NOTE 2:
AS PER SSH REQUIREMENTS, THIS SCRIPT WILL SECURE THE USER HOME DIRECTORY
AND THE .ssh DIRECTORY BY REVOKING GROUP AND WORLD WRITE PRIVILEGES TO THESE
directories.

Do you want to continue and let the script make the above mentioned changes (yes/no)?
yes

The user chose yes
User chose to skip passphrase related questions.
Creating .ssh directory on local host, if not present already
Creating authorized_keys file on local host
Changing permissions on authorized_keys to 644 on local host
Creating known_hosts file on local host
Changing permissions on known_hosts to 644 on local host
Creating config file on local host
If a config file exists already at /home/grid/.ssh/config, it would be backed up to /home/grid/.ssh/config.backup.
Creating .ssh directory and setting permissions on remote host rac1
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS FOR group AND others ON THE HOME DIRECTORY FOR oracle. THIS IS AN SSH REQUIREMENT.
The script would create ~oracle/.ssh/config file on remote host rac1. If a config file exists already at ~oracle/.ssh/config, it would be backed up to ~oracle/.ssh/config.backup.
The user may be prompted for a password here since the script would be running SSH on host rac1.
Warning: Permanently added 'rac1,10.0.5.101' (ECDSA) to the list of known hosts.
oracle@rac1's password: 
Done with creating .ssh directory and setting permissions on remote host rac1.
Creating .ssh directory and setting permissions on remote host rac2
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS FOR group AND others ON THE HOME DIRECTORY FOR oracle. THIS IS AN SSH REQUIREMENT.
The script would create ~oracle/.ssh/config file on remote host rac2. If a config file exists already at ~oracle/.ssh/config, it would be backed up to ~oracle/.ssh/config.backup.
The user may be prompted for a password here since the script would be running SSH on host rac2.
Warning: Permanently added 'rac2,10.0.5.102' (ECDSA) to the list of known hosts.
oracle@rac2's password: 
Done with creating .ssh directory and setting permissions on remote host rac2.
Copying local host public key to the remote host rac1
The user may be prompted for a password or passphrase here since the script would be using SCP for host rac1.
oracle@rac1's password: 
Done copying local host public key to the remote host rac1
Copying local host public key to the remote host rac2
The user may be prompted for a password or passphrase here since the script would be using SCP for host rac2.
oracle@rac2's password: 
Done copying local host public key to the remote host rac2
Creating keys on remote host rac1 if they do not exist already. This is required to setup SSH on host rac1.

Creating keys on remote host rac2 if they do not exist already. This is required to setup SSH on host rac2.

Updating authorized_keys file on remote host rac1
Updating known_hosts file on remote host rac1
Updating authorized_keys file on remote host rac2
Updating known_hosts file on remote host rac2
SSH setup is complete.

------------------------------------------------------------------------
Verifying SSH setup
===================
The script will now run the date command on the remote nodes using ssh
to verify if ssh is setup correctly. IF THE SETUP IS CORRECTLY SETUP,
THERE SHOULD BE NO OUTPUT OTHER THAN THE DATE AND SSH SHOULD NOT ASK FOR
PASSWORDS. If you see any output other than date or are prompted for the
password, ssh is not setup correctly and you will need to resolve the
issue and set up ssh again.
The possible causes for failure could be:
1. The server settings in /etc/ssh/sshd_config file do not allow ssh
for user oracle.
2. The server may have disabled public key based authentication.
3. The client public key on the server may be outdated.
4. ~oracle or ~oracle/.ssh on the remote host may not be owned by oracle.
5. User may not have passed -shared option for shared remote users or
may be passing the -shared option for non-shared remote users.
6. If there is output in addition to the date, but no password is asked,
it may be a security alert shown as part of company policy. Append the
additional text to the <OMS HOME>/sysman/prov/resources/ignoreMessages.txt file.
------------------------------------------------------------------------
--rac1:--
Running /usr/bin/ssh -x -l oracle rac1 date to verify SSH connectivity has been setup from local host to rac1.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may be OK but being prompted for a password is ERROR.
Tue Apr 25 15:42:04 KST 2023
------------------------------------------------------------------------
--rac2:--
Running /usr/bin/ssh -x -l oracle rac2 date to verify SSH connectivity has been setup from local host to rac2.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may be OK but being prompted for a password is ERROR.
Tue Apr 25 15:42:04 KST 2023
------------------------------------------------------------------------
------------------------------------------------------------------------
Verifying SSH connectivity has been setup from rac1 to rac1
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL.
Tue Apr 25 15:42:04 KST 2023
------------------------------------------------------------------------
------------------------------------------------------------------------
Verifying SSH connectivity has been setup from rac1 to rac2
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL.
Tue Apr 25 15:42:05 KST 2023
------------------------------------------------------------------------
-Verification from complete-
SSH verification complete.

  • 사전 클러스터 환경 검증 - grid
cd $GI_HOME
./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -osdba dba -orainv oinstall -fixup -method root -networks enp0s3/enp0s8 -verbose
더보기

[rac1|root:/root]> cd $GI_HOME
[rac1|root:/u01/app/19c/grid]> ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -osdba dba -orainv oinstall -fixup -method root -networks enp0s3/enp0s8 -verbose

ERROR: You must not be logged in as root to run this tool.
[rac1|root:/u01/app/19c/grid]> asm
Last login: Tue Apr 25 15:40:19 KST 2023 on pts/0
[+ASM1|grid:/home/grid]> oh
[+ASM1|grid:/u01/app/19c/grid]> ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -osdba dba -orainv oinstall -fixup -method root -networks enp0s3/enp0s8 -verbose
Enter "ROOT" password:

Verifying Physical Memory ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          7.767GB (8144292.0KB)     8GB (8388608.0KB)         passed    
  rac1          7.767GB (8144292.0KB)     8GB (8388608.0KB)         passed    
Verifying Physical Memory ...PASSED
Verifying Available Physical Memory ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          7.0484GB (7390784.0KB)    50MB (51200.0KB)          passed    
  rac1          7.166GB (7514112.0KB)     50MB (51200.0KB)          passed    
Verifying Available Physical Memory ...PASSED
Verifying Swap Size ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          8GB (8388604.0KB)         7.767GB (8144292.0KB)     passed    
  rac1          8GB (8388604.0KB)         7.767GB (8144292.0KB)     passed    
Verifying Swap Size ...PASSED
Verifying Free Space: rac2:/usr,rac2:/var,rac2:/etc,rac2:/sbin,rac2:/tmp ...
  Path              Node Name     Mount point   Available     Required      Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  /usr              rac2          /             88.583GB      25MB          passed      
  /var              rac2          /             88.583GB      5MB           passed      
  /etc              rac2          /             88.583GB      25MB          passed      
  /sbin             rac2          /             88.583GB      10MB          passed      
  /tmp              rac2          /             88.583GB      1GB           passed      
Verifying Free Space: rac2:/usr,rac2:/var,rac2:/etc,rac2:/sbin,rac2:/tmp ...PASSED
Verifying Free Space: rac1:/usr,rac1:/var,rac1:/etc,rac1:/sbin,rac1:/tmp ...
  Path              Node Name     Mount point   Available     Required      Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  /usr              rac1          /             76.5322GB     25MB          passed      
  /var              rac1          /             76.5322GB     5MB           passed      
  /etc              rac1          /             76.5322GB     25MB          passed      
  /sbin             rac1          /             76.5322GB     10MB          passed      
  /tmp              rac1          /             76.5322GB     1GB           passed      
Verifying Free Space: rac1:/usr,rac1:/var,rac1:/etc,rac1:/sbin,rac1:/tmp ...PASSED
Verifying User Existence: grid ...
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  rac2          passed                    exists(54322)           
  rac1          passed                    exists(54322)           

  Verifying Users With Same UID: 54322 ...PASSED
Verifying User Existence: grid ...PASSED
Verifying Group Existence: asmadmin ...
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  rac2          passed                    exists                  
  rac1          passed                    exists                  
Verifying Group Existence: asmadmin ...PASSED
Verifying Group Existence: dba ...
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  rac2          passed                    exists                  
  rac1          passed                    exists                  
Verifying Group Existence: dba ...PASSED
Verifying Group Existence: oinstall ...
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  rac2          passed                    exists                  
  rac1          passed                    exists                  
Verifying Group Existence: oinstall ...PASSED
Verifying Group Membership: dba ...
  Node Name         User Exists   Group Exists  User in Group  Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              yes           yes           yes           passed          
  rac1              yes           yes           yes           passed          
Verifying Group Membership: dba ...PASSED
Verifying Group Membership: asmadmin ...
  Node Name         User Exists   Group Exists  User in Group  Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              yes           yes           yes           passed          
  rac1              yes           yes           yes           passed          
Verifying Group Membership: asmadmin ...PASSED
Verifying Group Membership: oinstall(Primary) ...
  Node Name         User Exists   Group Exists  User in Group  Primary       Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac2              yes           yes           yes           yes           passed      
  rac1              yes           yes           yes           yes           passed      
Verifying Group Membership: oinstall(Primary) ...PASSED
Verifying Run Level ...
  Node Name     run level                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          5                         3,5                       passed    
  rac1          5                         3,5                       passed    
Verifying Run Level ...PASSED
Verifying Hard Limit: maximum open file descriptors ...
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              hard          4096          65536         failed          
  rac1              hard          65536         65536         passed          
Verifying Hard Limit: maximum open file descriptors ...FAILED (PRVG-0446)
Verifying Soft Limit: maximum open file descriptors ...
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              soft          1024          1024          passed          
  rac1              soft          1024          1024          passed          
Verifying Soft Limit: maximum open file descriptors ...PASSED
Verifying Hard Limit: maximum user processes ...
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              hard          31661         16384         passed          
  rac1              hard          31661         16384         passed          
Verifying Hard Limit: maximum user processes ...PASSED
Verifying Soft Limit: maximum user processes ...
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              soft          4096          2047          passed          
  rac1              soft          4096          2047          passed          
Verifying Soft Limit: maximum user processes ...PASSED
Verifying Soft Limit: maximum stack size ...
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              soft          8192          10240         failed          
  rac1              soft          10240         10240         passed          
Verifying Soft Limit: maximum stack size ...FAILED (PRVG-0449)
Verifying Architecture ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          x86_64                    x86_64                    passed    
  rac1          x86_64                    x86_64                    passed    
Verifying Architecture ...PASSED
Verifying OS Kernel Version ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          5.4.17-2102.201.3.el7uek.x86_64  4.1.12                    passed    
  rac1          5.4.17-2102.201.3.el7uek.x86_64  4.1.12                    passed    
Verifying OS Kernel Version ...PASSED
Verifying OS Kernel Parameter: semmsl ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              250           250           250           passed          
  rac2              250           250           250           passed          
Verifying OS Kernel Parameter: semmsl ...PASSED
Verifying OS Kernel Parameter: semmns ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              32000         32000         32000         passed          
  rac2              32000         32000         32000         passed          
Verifying OS Kernel Parameter: semmns ...PASSED
Verifying OS Kernel Parameter: semopm ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              100           100           100           passed          
  rac2              100           100           100           passed          
Verifying OS Kernel Parameter: semopm ...PASSED
Verifying OS Kernel Parameter: semmni ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              128           128           128           passed          
  rac2              128           128           128           passed          
Verifying OS Kernel Parameter: semmni ...PASSED
Verifying OS Kernel Parameter: shmmax ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              4398046511104  4398046511104  4169877504    passed          
  rac2              4398046511104  4398046511104  4169877504    passed          
Verifying OS Kernel Parameter: shmmax ...PASSED
Verifying OS Kernel Parameter: shmmni ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              4096          4096          4096          passed          
  rac2              4096          4096          4096          passed          
Verifying OS Kernel Parameter: shmmni ...PASSED
Verifying OS Kernel Parameter: shmall ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              1073741824    1073741824    1073741824    passed          
  rac2              1073741824    1073741824    1073741824    passed          
Verifying OS Kernel Parameter: shmall ...PASSED
Verifying OS Kernel Parameter: file-max ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              6815744       6815744       6815744       passed          
  rac2              6815744       6815744       6815744       passed          
Verifying OS Kernel Parameter: file-max ...PASSED
Verifying OS Kernel Parameter: ip_local_port_range ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              between 9000 & 65500  between 9000 & 65500  between 9000 & 65535  passed          
  rac2              between 9000 & 65500  between 9000 & 65500  between 9000 & 65535  passed          
Verifying OS Kernel Parameter: ip_local_port_range ...PASSED
Verifying OS Kernel Parameter: rmem_default ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              262144        262144        262144        passed          
  rac2              262144        262144        262144        passed          
Verifying OS Kernel Parameter: rmem_default ...PASSED
Verifying OS Kernel Parameter: rmem_max ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              4194304       4194304       4194304       passed          
  rac2              4194304       4194304       4194304       passed          
Verifying OS Kernel Parameter: rmem_max ...PASSED
Verifying OS Kernel Parameter: wmem_default ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              262144        262144        262144        passed          
  rac2              262144        262144        262144        passed          
Verifying OS Kernel Parameter: wmem_default ...PASSED
Verifying OS Kernel Parameter: wmem_max ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              1048576       1048576       1048576       passed          
  rac2              1048576       1048576       1048576       passed          
Verifying OS Kernel Parameter: wmem_max ...PASSED
Verifying OS Kernel Parameter: aio-max-nr ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              1048576       1048576       1048576       passed          
  rac2              1048576       1048576       1048576       passed          
Verifying OS Kernel Parameter: aio-max-nr ...PASSED
Verifying OS Kernel Parameter: panic_on_oops ...
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  rac1              1             1             1             passed          
  rac2              1             1             1             passed          
Verifying OS Kernel Parameter: panic_on_oops ...PASSED
Verifying Package: kmod-20-21 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          kmod(x86_64)-20-28.0.3.el7  kmod(x86_64)-20-21        passed    
  rac1          kmod(x86_64)-20-28.0.3.el7  kmod(x86_64)-20-21        passed    
Verifying Package: kmod-20-21 (x86_64) ...PASSED
Verifying Package: kmod-libs-20-21 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          kmod-libs(x86_64)-20-28.0.3.el7  kmod-libs(x86_64)-20-21   passed    
  rac1          kmod-libs(x86_64)-20-28.0.3.el7  kmod-libs(x86_64)-20-21   passed    
Verifying Package: kmod-libs-20-21 (x86_64) ...PASSED
Verifying Package: binutils-2.23.52.0.1 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          binutils-2.27-44.base.0.1.el7  binutils-2.23.52.0.1      passed    
  rac1          binutils-2.27-44.base.0.1.el7  binutils-2.23.52.0.1      passed    
Verifying Package: binutils-2.23.52.0.1 ...PASSED
Verifying Package: compat-libcap1-1.10 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          compat-libcap1-1.10-7.el7  compat-libcap1-1.10       passed    
  rac1          compat-libcap1-1.10-7.el7  compat-libcap1-1.10       passed    
Verifying Package: compat-libcap1-1.10 ...PASSED
Verifying Package: libgcc-4.8.2 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          libgcc(x86_64)-4.8.5-44.0.3.el7  libgcc(x86_64)-4.8.2      passed    
  rac1          libgcc(x86_64)-4.8.5-44.0.3.el7  libgcc(x86_64)-4.8.2      passed    
Verifying Package: libgcc-4.8.2 (x86_64) ...PASSED
Verifying Package: libstdc++-4.8.2 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          libstdc++(x86_64)-4.8.5-44.0.3.el7  libstdc++(x86_64)-4.8.2   passed    
  rac1          libstdc++(x86_64)-4.8.5-44.0.3.el7  libstdc++(x86_64)-4.8.2   passed    
Verifying Package: libstdc++-4.8.2 (x86_64) ...PASSED
Verifying Package: libstdc++-devel-4.8.2 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          libstdc++-devel(x86_64)-4.8.5-44.0.3.el7  libstdc++-devel(x86_64)-4.8.2  passed    
  rac1          libstdc++-devel(x86_64)-4.8.5-44.0.3.el7  libstdc++-devel(x86_64)-4.8.2  passed    
Verifying Package: libstdc++-devel-4.8.2 (x86_64) ...PASSED
Verifying Package: sysstat-10.1.5 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          sysstat-10.1.5-19.el7     sysstat-10.1.5            passed    
  rac1          sysstat-10.1.5-19.el7     sysstat-10.1.5            passed    
Verifying Package: sysstat-10.1.5 ...PASSED
Verifying Package: ksh ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          ksh                       ksh                       passed    
  rac1          ksh                       ksh                       passed    
Verifying Package: ksh ...PASSED
Verifying Package: make-3.82 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          make-3.82-24.el7          make-3.82                 passed    
  rac1          make-3.82-24.el7          make-3.82                 passed    
Verifying Package: make-3.82 ...PASSED
Verifying Package: glibc-2.17 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          glibc(x86_64)-2.17-317.0.1.el7  glibc(x86_64)-2.17        passed    
  rac1          glibc(x86_64)-2.17-317.0.1.el7  glibc(x86_64)-2.17        passed    
Verifying Package: glibc-2.17 (x86_64) ...PASSED
Verifying Package: glibc-devel-2.17 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          glibc-devel(x86_64)-2.17-317.0.1.el7  glibc-devel(x86_64)-2.17  passed    
  rac1          glibc-devel(x86_64)-2.17-317.0.1.el7  glibc-devel(x86_64)-2.17  passed    
Verifying Package: glibc-devel-2.17 (x86_64) ...PASSED
Verifying Package: libaio-0.3.109 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          libaio(x86_64)-0.3.109-13.el7  libaio(x86_64)-0.3.109    passed    
  rac1          libaio(x86_64)-0.3.109-13.el7  libaio(x86_64)-0.3.109    passed    
Verifying Package: libaio-0.3.109 (x86_64) ...PASSED
Verifying Package: libaio-devel-0.3.109 (x86_64) ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          libaio-devel(x86_64)-0.3.109-13.el7  libaio-devel(x86_64)-0.3.109  passed    
  rac1          libaio-devel(x86_64)-0.3.109-13.el7  libaio-devel(x86_64)-0.3.109  passed    
Verifying Package: libaio-devel-0.3.109 (x86_64) ...PASSED
Verifying Package: nfs-utils-1.2.3-15 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          nfs-utils-1.3.0-0.68.0.1.el7  nfs-utils-1.2.3-15        passed    
  rac1          nfs-utils-1.3.0-0.68.0.1.el7  nfs-utils-1.2.3-15        passed    
Verifying Package: nfs-utils-1.2.3-15 ...PASSED
Verifying Package: smartmontools-6.2-4 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          smartmontools-7.0-2.el7   smartmontools-6.2-4       passed    
  rac1          smartmontools-7.0-2.el7   smartmontools-6.2-4       passed    
Verifying Package: smartmontools-6.2-4 ...PASSED
Verifying Package: net-tools-2.0-0.17 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          net-tools-2.0-0.25.20131004git.el7  net-tools-2.0-0.17        passed    
  rac1          net-tools-2.0-0.25.20131004git.el7  net-tools-2.0-0.17        passed    
Verifying Package: net-tools-2.0-0.17 ...PASSED
Verifying Port Availability for component "Oracle Notification Service (ONS)" ...
  Node Name         Port Number   Protocol      Available     Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              6200          TCP           yes           successful      
  rac1              6200          TCP           yes           successful      
  rac2              6100          TCP           yes           successful      
  rac1              6100          TCP           yes           successful      
Verifying Port Availability for component "Oracle Notification Service (ONS)" ...PASSED
Verifying Port Availability for component "Oracle Cluster Synchronization Services (CSSD)" ...
  Node Name         Port Number   Protocol      Available     Status          
  ----------------  ------------  ------------  ------------  ----------------
  rac2              42424         TCP           yes           successful      
  rac1              42424         TCP           yes           successful      
Verifying Port Availability for component "Oracle Cluster Synchronization Services (CSSD)" ...PASSED
Verifying Users With Same UID: 0 ...PASSED
Verifying Current Group ID ...PASSED
Verifying Root user consistency ...
  Node Name                             Status                  
  ------------------------------------  ------------------------
  rac2                                  passed                  
  rac1                                  passed                  
Verifying Root user consistency ...PASSED
Verifying Package: cvuqdisk-1.0.10-1 ...
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          cvuqdisk-1.0.10-1         cvuqdisk-1.0.10-1         passed    
  rac1          cvuqdisk-1.0.10-1         cvuqdisk-1.0.10-1         passed    
Verifying Package: cvuqdisk-1.0.10-1 ...PASSED
Verifying Host name ...PASSED
Verifying Node Connectivity ...
  Verifying Hosts File ...
  Node Name                             Status                  
  ------------------------------------  ------------------------
  rac1                                  passed                  
  rac2                                  passed                  
  Verifying Hosts File ...PASSED

Interface information for node "rac1"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
 ------ --------------- --------------- --------------- --------------- ----------------- ------
 enp0s3 10.0.5.101      10.0.5.0        0.0.0.0         10.0.5.1        08:00:27:6C:79:12 1500  
 enp0s8 10.0.1.101      10.0.1.0        0.0.0.0         10.0.5.1        08:00:27:78:11:43 1500  

Interface information for node "rac2"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
 ------ --------------- --------------- --------------- --------------- ----------------- ------
 enp0s3 10.0.5.102      10.0.5.0        0.0.0.0         192.168.0.1     08:00:27:4F:EF:D4 1500  
 enp0s8 10.0.1.102      10.0.1.0        0.0.0.0         192.168.0.1     08:00:27:8D:25:91 1500  

Check: MTU consistency of the subnet "10.0.5.0".

  Node              Name          IP Address    Subnet        MTU             
  ----------------  ------------  ------------  ------------  ----------------
  rac1              enp0s3        10.0.5.101    10.0.5.0      1500            
  rac2              enp0s3        10.0.5.102    10.0.5.0      1500            

Check: MTU consistency of the subnet "10.0.1.0".

  Node              Name          IP Address    Subnet        MTU             
  ----------------  ------------  ------------  ------------  ----------------
  rac1              enp0s8        10.0.1.101    10.0.1.0      1500            
  rac2              enp0s8        10.0.1.102    10.0.1.0      1500            

  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  rac1[enp0s3:10.0.5.101]         rac2[enp0s3:10.0.5.102]         yes             

  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  rac1[enp0s8:10.0.1.101]         rac2[enp0s8:10.0.1.102]         yes             
  Verifying Check that maximum (MTU) size packet goes through subnet ...PASSED
  Verifying subnet mask consistency for subnet "10.0.5.0" ...PASSED
  Verifying subnet mask consistency for subnet "10.0.1.0" ...PASSED
Verifying Node Connectivity ...PASSED
Verifying Multicast or broadcast check ...
Checking subnet "10.0.5.0" for multicast communication with multicast group "224.0.0.251"
Verifying Multicast or broadcast check ...PASSED
Verifying ASMLib installation and configuration verification. ...
  Verifying '/etc/init.d/oracleasm' ...PASSED
  Verifying '/dev/oracleasm' ...PASSED
  Verifying '/etc/sysconfig/oracleasm' ...PASSED

  Node Name                             Status                  
  ------------------------------------  ------------------------
  rac1                                  passed                  
  rac2                                  passed                  
Verifying ASMLib installation and configuration verification. ...PASSED
Verifying Network Time Protocol (NTP) ...PASSED
Verifying Same core file name pattern ...PASSED
Verifying User Mask ...
  Node Name     Available                 Required                  Comment   
  ------------  ------------------------  ------------------------  ----------
  rac2          0022                      0022                      passed    
  rac1          0022                      0022                      passed    
Verifying User Mask ...PASSED
Verifying User Not In Group "root": grid ...
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  rac2          passed                    does not exist          
  rac1          passed                    does not exist          
Verifying User Not In Group "root": grid ...PASSED
Verifying Time zone consistency ...PASSED
Verifying Time offset between nodes ...PASSED
Verifying resolv.conf Integrity ...
  Node Name                             Status                  
  ------------------------------------  ------------------------
  rac1                                  failed                  
  rac2                                  failed                  

checking response for name "rac1" from each of the name servers specified in
"/etc/resolv.conf"

  Node Name     Source                    Comment                   Status    
  ------------  ------------------------  ------------------------  ----------
  rac1          127.0.0.1                 IPv4                      passed    

checking response for name "rac2" from each of the name servers specified in
"/etc/resolv.conf"

  Node Name     Source                    Comment                   Status    
  ------------  ------------------------  ------------------------  ----------
  rac2          127.0.0.1                 IPv4                      passed    
  rac2          164.124.101.2             IPv4                      passed    
  rac2          168.126.63.1              IPv4                      passed    
Verifying resolv.conf Integrity ...FAILED (PRVF-5636)
Verifying DNS/NIS name service ...PASSED
Verifying Domain Sockets ...PASSED
Verifying /boot mount ...PASSED
Verifying Daemon "avahi-daemon" not configured and running ...
  Node Name     Configured                Status                  
  ------------  ------------------------  ------------------------
  rac2          no                        passed                  
  rac1          no                        passed                  

  Node Name     Running?                  Status                  
  ------------  ------------------------  ------------------------
  rac2          no                        passed                  
  rac1          no                        passed                  
Verifying Daemon "avahi-daemon" not configured and running ...PASSED
Verifying Daemon "proxyt" not configured and running ...
  Node Name     Configured                Status                  
  ------------  ------------------------  ------------------------
  rac2          no                        passed                  
  rac1          no                        passed                  

  Node Name     Running?                  Status                  
  ------------  ------------------------  ------------------------
  rac2          no                        passed                  
  rac1          no                        passed                  
Verifying Daemon "proxyt" not configured and running ...PASSED
Verifying loopback network interface address ...PASSED
Verifying User Equivalence ...PASSED
Verifying RPM Package Manager database ...PASSED
Verifying /dev/shm mounted as temporary file system ...PASSED
Verifying File system mount options for path /var ...PASSED
Verifying DefaultTasksMax parameter ...PASSED
Verifying zeroconf check ...PASSED
Verifying ASM Filter Driver configuration ...PASSED
Verifying Systemd login manager IPC parameter ...PASSED

Pre-check for cluster services setup was unsuccessful on all the nodes. 


Failures were encountered during execution of CVU verification request "stage -pre crsinst".

Verifying Hard Limit: maximum open file descriptors ...FAILED
rac2: PRVG-0446 : Proper hard limit for maximum open file descriptors was not
      found on node "rac2" [Expected >= "65536" ; Found = "4096"].

Verifying Soft Limit: maximum stack size ...FAILED
rac2: PRVG-0449 : Proper soft limit for maximum stack size was not found on
      node "rac2" [Expected >= "10240" ; Found = "8192"].

Verifying resolv.conf Integrity ...FAILED
rac2: PRVF-5636 : The DNS response time for an unreachable node exceeded
      "15000" ms on following nodes: rac1,rac2

rac1: PRVF-5636 : The DNS response time for an unreachable node exceeded
      "15000" ms on following nodes: rac1,rac2


CVU operation performed:      stage -pre crsinst
Date:                         Apr 25, 2023 3:43:03 PM
CVU home:                     /u01/app/19c/grid/
User:                         grid
******************************************************************************************
Following is the list of fixable prerequisites selected to fix in this session
******************************************************************************************
--------------                ---------------     -------------  -------------  
                                                  ---            -----          
Check failed.                 Failed on nodes     Reboot         Re-Login       
                                                  required?      required?      
--------------                ---------------     -------------  -------------  
                                                  ---            -----          
Hard Limit: maximum open      rac2                no             yes            
file descriptors                                                                
Soft Limit: maximum stack     rac2                no             yes            
size                                                                            


Fix: Hard Limit: maximum open file descriptors 

  Node Name                             Status                  
  ------------------------------------  ------------------------
  rac2                                  successful              
Result: 
"Hard Limit: maximum open file descriptors" was successfully fixed on all the applicable nodes

Fix: Soft Limit: maximum stack size 

  Node Name                             Status                  
  ------------------------------------  ------------------------
  rac2                                  successful              
Result: 
"Soft Limit: maximum stack size" was successfully fixed on all the applicable nodes

Fix up operations were successfully completed on all the applicable nodes

 

3. rsp 파일 생성

vi /media/engine/grid_engine.rsp
-----------------------------------------------------------------------------------------------
oracle.install.responseFileVersion=/oracle/install/rspfmt_crsinstall_response_schema_v19.0.0
INVENTORY_LOCATION=/u01/app/oraInventory
oracle.install.option=CRS_CONFIG
ORACLE_BASE=/u01/app/oracle
oracle.install.asm.OSDBA=asmdba
oracle.install.asm.OSOPER=asmoper
oracle.install.asm.OSASM=asmadmin
oracle.install.crs.config.scanType=LOCAL_SCAN
oracle.install.crs.config.gpnp.scanName=rac-scan
oracle.install.crs.config.gpnp.scanPort=1521
oracle.install.crs.config.ClusterConfiguration=STANDALONE
oracle.install.crs.config.configureAsExtendedCluster=false
oracle.install.crs.config.clusterName=rac
oracle.install.crs.config.gpnp.configureGNS=false
oracle.install.crs.config.autoConfigureClusterNodeVIP=false
oracle.install.crs.config.clusterNodes=rac1:rac1-vip,rac2:rac2-vip
oracle.install.crs.config.networkInterfaceList=enp0s3:10.0.5.0:1,enp0s8:10.0.1.0:5
oracle.install.crs.configureGIMR=false
oracle.install.asm.configureGIMRDataDG=false
oracle.install.crs.config.storageOption=FLEX_ASM_STORAGE
oracle.install.crs.config.useIPMI=false
oracle.install.asm.diskGroup.name=CRS
oracle.install.asm.diskGroup.redundancy=EXTERNAL
oracle.install.asm.diskGroup.AUSize=4
oracle.install.asm.diskGroup.disksWithFailureGroupNames=/dev/oracleasm/disks/CRS2,,/dev/oracleasm/disks/CRS1,,/dev/oracleasm/disks/CRS3,
oracle.install.asm.diskGroup.disks=/dev/oracleasm/disks/CRS2,/dev/oracleasm/disks/CRS1,/dev/oracleasm/disks/CRS3
oracle.install.asm.diskGroup.diskDiscoveryString=/dev/oracleasm/disks/*
oracle.install.asm.gimrDG.AUSize=1
oracle.install.asm.configureAFD=false
oracle.install.asm.monitorPassword=oracle
oracle.install.asm.SYSASMPassword=oracle
oracle.install.crs.configureRHPS=false
oracle.install.crs.config.ignoreDownNodes=false
oracle.install.config.managementOption=NONE
oracle.install.config.omsPort=0
oracle.install.crs.rootconfig.executeRootScript=false
-----------------------------------------------------------------------------------------------

 

4. 설치

cd $GI_HOME
./gridSetup.sh -silent -responseFile /media/engine/grid_engine.rsp -ignorePrereqFailure

 

더보기

[+ASM1|grid:/u01/app/19c/grid]> ./gridSetup.sh -silent -responseFile /media/engine/grid_engine.rsp -ignorePrereqFailure
Launching Oracle Grid Infrastructure Setup Wizard...

[WARNING] [INS-30011] The SYS password entered does not conform to the Oracle recommended standards.
   CAUSE: Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
   ACTION: Provide a password that conforms to the Oracle recommended standards.
[WARNING] [INS-30011] The ASMSNMP password entered does not conform to the Oracle recommended standards.
   CAUSE: Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
   ACTION: Provide a password that conforms to the Oracle recommended standards.
[WARNING] [INS-40109] The specified Oracle Base location is not empty on this server.
   ACTION: Specify an empty location for Oracle Base.
[WARNING] [INS-32047] The location (/u01/app/oraInventory) specified for the central inventory is not empty.
   ACTION: It is recommended to provide an empty location for the inventory.
[WARNING] [INS-13013] Target environment does not meet some mandatory requirements.
   CAUSE: Some of the mandatory prerequisites are not met. See logs for details. /tmp/GridSetupActions2023-04-26_07-42-11AM/gridSetupActions2023-04-26_07-42-11AM.log
   ACTION: Identify the list of failed prerequisite checks from the log: /tmp/GridSetupActions2023-04-26_07-42-11AM/gridSetupActions2023-04-26_07-42-11AM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.
The response file for this session can be found at:
 /u01/app/19c/grid/install/response/grid_2023-04-26_07-42-11AM.rsp

You can find the log of this install session at:
 /tmp/GridSetupActions2023-04-26_07-42-11AM/gridSetupActions2023-04-26_07-42-11AM.log

As a root user, execute the following script(s):
1. /u01/app/oraInventory/orainstRoot.sh
2. /u01/app/19c/grid/root.sh

Execute /u01/app/oraInventory/orainstRoot.sh on the following nodes: 
[rac1, rac2]
Execute /u01/app/19c/grid/root.sh on the following nodes: 
[rac1, rac2]

Run the script on the local node first. After successful completion, you can start the script in parallel on all other nodes.

Successfully Setup Software with warning(s).
As install user, execute the following command to complete the configuration.
/u01/app/19c/grid/gridSetup.sh -executeConfigTools -responseFile /media/engine/grid_engine.rsp [-silent]


Moved the install session logs to:
 /u01/app/oraInventory/logs/GridSetupActions2023-04-26_07-42-11AM

 

 

 

[rac1|root:/root]> /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.

 

 

[rac2|root:/u01/app/19c]> /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.

 

[rac1|root:/root]> /u01/app/19c/grid/root.sh
Check /u01/app/19c/grid/install/root_rac1_2023-04-26_07-51-30-760646309.log for the output of root script

Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/19c/grid
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19c/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/oracle/crsdata/rac1/crsconfig/rootcrs_rac1_2023-04-26_07-51-37AM.log
2023/04/26 07:51:43 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2023/04/26 07:51:43 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2023/04/26 07:51:44 CLSRSC-363: User ignored prerequisites during installation
2023/04/26 07:51:44 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2023/04/26 07:51:45 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2023/04/26 07:51:46 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2023/04/26 07:51:46 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2023/04/26 07:51:46 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2023/04/26 07:52:03 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2023/04/26 07:52:08 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2023/04/26 07:52:09 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2023/04/26 07:52:21 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2023/04/26 07:52:21 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2023/04/26 07:52:25 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2023/04/26 07:52:25 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2023/04/26 07:52:46 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2023/04/26 07:52:50 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2023/04/26 07:52:54 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2023/04/26 07:52:58 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.

 

ASM has been created and started successfully.

[DBT-30001] Disk groups created successfully. Check /u01/app/oracle/cfgtoollogs/asmca/asmca-230426AM075327.log for details.

2023/04/26 07:54:17 CLSRSC-482: Running command: '/u01/app/19c/grid/bin/ocrconfig -upgrade grid oinstall'
CRS-4256: Updating the profile
Successful addition of voting disk 14d2dd3844884f8ebf81156321e3cecd.
Successfully replaced voting disk group with +CRS.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   14d2dd3844884f8ebf81156321e3cecd (/dev/oracleasm/disks/CRS2) [CRS]
Located 1 voting disk(s).
2023/04/26 07:55:35 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2023/04/26 07:56:40 CLSRSC-343: Successfully started Oracle Clusterware stack
2023/04/26 07:56:40 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2023/04/26 07:58:43 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2023/04/26 07:59:20 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

 

[rac2|root:/u01/app/19c]> /u01/app/19c/grid/root.sh
Check /u01/app/19c/grid/install/root_rac2_2023-04-26_08-02-36-204680389.log for the output of root script

Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/19c/grid
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19c/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/oracle/crsdata/rac2/crsconfig/rootcrs_rac2_2023-04-26_08-02-55AM.log
2023/04/26 08:03:03 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2023/04/26 08:03:04 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2023/04/26 08:03:04 CLSRSC-363: User ignored prerequisites during installation
2023/04/26 08:03:04 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2023/04/26 08:03:06 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2023/04/26 08:03:06 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2023/04/26 08:03:07 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2023/04/26 08:03:08 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2023/04/26 08:03:11 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2023/04/26 08:03:11 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2023/04/26 08:03:23 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2023/04/26 08:03:23 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2023/04/26 08:03:26 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2023/04/26 08:03:26 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2023/04/26 08:03:43 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2023/04/26 08:03:57 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2023/04/26 08:04:00 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2023/04/26 08:04:04 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2023/04/26 08:04:07 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2023/04/26 08:04:27 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.

2023/04/26 08:06:29 CLSRSC-343: Successfully started Oracle Clusterware stack
2023/04/26 08:06:30 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2023/04/26 08:07:32 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2023/04/26 08:08:02 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

 

[+ASM1|grid:/u01/app/19c/grid]> /u01/app/19c/grid/gridSetup.sh -executeConfigTools -responseFile /media/engine/grid_engine.rsp
Launching Oracle Grid Infrastructure Setup Wizard...

You can find the logs of this session at:
/u01/app/oraInventory/logs/GridSetupActions2023-04-26_08-09-00AM

You can find the log of this install session at:
 /u01/app/oraInventory/logs/UpdateNodeList2023-04-26_08-09-00AM.log
[WARNING] [INS-43080] Some of the configuration assistants failed, were cancelled or skipped.
   ACTION: Refer to the logs or contact Oracle Support Services.

 

5. 확인

  • 클러스터 확인
[+ASM1|grid:/u01/app/19c/grid]> crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.chad
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.net1.network
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.ons
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.CRS.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       rac2                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       rac1                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       rac1                     STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     Started,STABLE
      2        ONLINE  ONLINE       rac2                     Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       rac1                     STABLE
ora.qosmserver
      1        ONLINE  ONLINE       rac1                     STABLE
ora.rac1.vip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.rac2.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       rac1                     STABLE
--------------------------------------------------------------------------------
  • 리스너 확인
[+ASM1|grid:/u01/app/19c/grid]> lsnrctl status

LSNRCTL for Linux: Version 19.0.0.0.0 - Production on 26-APR-2023 08:13:41

Copyright (c) 1991, 2019, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 19.0.0.0.0 - Production
Start Date                26-APR-2023 07:58:57
Uptime                    0 days 0 hr. 14 min. 44 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /u01/app/19c/grid/network/admin/listener.ora
Listener Log File         /u01/app/oracle/diag/tnslsnr/rac1/listener/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.0.5.101)(PORT=1521)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.0.5.201)(PORT=1521)))
Services Summary...
Service "+ASM" has 1 instance(s).
  Instance "+ASM1", status READY, has 1 handler(s) for this service...
Service "+ASM_CRS" has 1 instance(s).
  Instance "+ASM1", status READY, has 1 handler(s) for this service...
The command completed successfully

6. ASM DISKGROUP 생성

asmca

DISKGROUP CREATE 선택
DISKGROUP NAME 작성 후 OK

간단간단

생성확인

[+ASM1|grid:/u01/app/19c/grid]> crsctl stat res -t
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.CRS.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.DATA.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        ONLINE  OFFLINE                               STABLE
ora.FRA.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        ONLINE  OFFLINE                               STABLE
728x90