TNS-12555: TNS:permission denied | TNS-12560: TNS:protocol adapter error | TNS-00525: Insufficient privilege for operation | Linux Error: 1: Operation not permitted

Issue: while starting the listener we were getting the below error.

[oracle@linux01 ~]$ lsnrctl start

LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 11-NOV-2013 01:53:59

Copyright (c) 1991, 2009, Oracle.  All rights reserved.

Starting /app/oracle/product/11.2.0/dbhome_1/bin/tnslsnr: please wait...

TNSLSNR for Linux: Version 11.2.0.1.0 - Production
System parameter file is /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
Log messages written to /app/oracle/diag/tnslsnr/linux01/listener/alert/log.xml
Error listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC1521)))
TNS-12555: TNS:permission denied
 TNS-12560: TNS:protocol adapter error
  TNS-00525: Insufficient privilege for operation
   Linux Error: 1: Operation not permitted

Listener failed to start. See the error message(s) above...

The contents of the listener.ora file

[oracle@linux01 ~]$ cd $ORACLE_HOME
[oracle@linux01 admin]$ cat listener.ora
# listener.ora Network Configuration File: /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
# Generated by Oracle configuration tools.

LISTENER =
  (DESCRIPTION_LIST =
    (DESCRIPTION =
      (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = linux01)(PORT = 1521))
    )
  )

Solution 1: Recreate the directory /var/tmp/.oracle as mentioned below & then start the listener.

[oracle@slc00ryy ~]# cd /var/tmp
[oracle@slc00ryy tmp]# ls -la
drwxrwxrwt   2 root     oinstall  4096 Nov 11 02:00 .oracle

[oracle@slc00ryy tmp]# mv .oracle .oracle.orig
[oracle@slc00ryy tmp]# mkdir .oracle
[oracle@slc00ryy tmp]# chmod 01777 .oracle
[oracle@slc00ryy tmp]# chown -R root:oinstall .oracle
[oracle@slc00ryy tmp]# chgrp root .oracle
  
Solution 2: Change the KEY in the listener.ora file to EXTPROC0 (changed 1521 to 0 (zero)) and started the listener. It worked.

[oracle@linux01 admin]$ vi listener.ora
[oracle@linux01 admin]$ cat listener.ora
# listener.ora Network Configuration File: /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
# Generated by Oracle configuration tools.
LISTENER =
  (DESCRIPTION_LIST =
    (DESCRIPTION =
      (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC0))
      (ADDRESS = (PROTOCOL = TCP)(HOST = linux01)(PORT = 1521))
    )
  )

[oracle@linux01 admin]$ lsnrctl start

LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 11-NOV-2013 01:56:15
Copyright (c) 1991, 2009, Oracle.  All rights reserved.
Starting /app/oracle/product/11.2.0/dbhome_1/bin/tnslsnr: please wait...
TNSLSNR for Linux: Version 11.2.0.1.0 - Production
System parameter file is /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
Log messages written to /app/oracle/diag/tnslsnr/linux01/listener/alert/log.xml
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC0)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=linux01)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC0)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 11.2.0.1.0 - Production
Start Date                11-NOV-2013 01:56:15
Uptime                    0 days 0 hr. 0 min. 0 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
Listener Log File         /app/oracle/diag/tnslsnr/linux01/listener/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC0)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=linux01)(PORT=1521)))
The listener supports no services
The command completed successfully

ORA-01102: cannot mount database in EXCLUSIVE mode

Environment Details:
OS: Linux Server 5.8 64bit
Version: 11.2.0.3.0
Software Installation location: /u01/app/oracle/product/112030
Database Name: testdb
Datafile's Location: /u01/oradata/testdb

Issue: While starting the database we were getting the error "ORA-01102: cannot mount database in EXCLUSIVE mode".

Error Message:
oracle@linux01=> sqlplus sys as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Wed Nov 6 04:02:10 2013
Copyright (c) 1982, 2011, Oracle.  All rights reserved.
Enter password: 
Connected to an idle instance.

SQL> startup

ORACLE instance started.

Total System Global Area  680607744 bytes
Fixed Size                  2231472 bytes
Variable Size             507511632 bytes
Database Buffers          163577856 bytes
Redo Buffers                7286784 bytes
ORA-01102: cannot mount database in EXCLUSIVE mode

Excerpt from the Alert log file
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
starting up 1 shared server(s) ...
ORACLE_BASE from environment = /u01/app/oracle
Wed Nov 06 04:02:44 2013
ALTER DATABASE   MOUNT
sculkget: failed to lock /u01/app/oracle/product/112030/dbs/lkTESTDB exclusive
sculkget: lock held by PID: 64
ORA-09968: unable to lock file
Linux-x86_64 Error: 11: Resource temporarily unavailable
Additional information: 64
ORA-1102 signalled during: ALTER DATABASE   MOUNT...

Solution:

• Shutdown the database which is started(it will be in NOMOUNT Mode)
• Check if any other process is running for that database, if yes kill those processes.
• Copy the directory containing the datafiles to a different location.
• Rename the directory to a different name and move the copied directory back to the same name.
• Now go to $ORACLE_HOME/dbs and delete the file lkTESTDB
• Start the database

89-oracle@linux01=> sqlplus sys as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Wed Nov 6 06:13:15 2013
Copyright (c) 1982, 2011, Oracle.  All rights reserved.

Enter password: 

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL> shutdown immediate 
ORA-01507: database not mounted


ORACLE instance shut down.
SQL> exit

oracle@linux01=> ps -ef|grep testdb
oracle     974  6086  0 00:09 pts/1    00:00:00 grep testdb

oracle@linux01=> cd /u01/oradata
oracle@linux01=> cp -r testdb testdb.1
oracle@linux01=> mv -r testdb testdb.old
oracle@linux01=> mv testdb.1 testdb
oracle@linux01=> cd $ORACLE_HOME/dbs
oracle@linux01=> rm lkTESTDB

oracle@linux01=> sqlplus sys as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Wed Nov 6 04:25:12 2013
Copyright (c) 1982, 2011, Oracle.  All rights reserved.
Enter password: 
Connected to an idle instance.

SQL> startup
ORACLE instance started.

Total System Global Area  680607744 bytes
Fixed Size                  2231472 bytes
Variable Size             507511632 bytes
Database Buffers          163577856 bytes
Redo Buffers                7286784 bytes
Database mounted.
Database opened.
SQL> exit

Node Manager associated with machine is not reachable | Weblogic

Environment Details:
OS: Linux Server 5.8 64bit
Version: Weblogic Server 12.1.2
Installation location: /u01/app/oracle/product/fmw
DOMAIN_HOME: /u01/app/oracle/product/fmw/user_projects/domains/base_domain

Issue: After starting up the Oracle WebLogic 12c AdminServer server, when trying to start any of our managed servers from console page, we were getting the below error. Verified that the node manager was running but still we were encountering this issue.

<Oct 16, 2013 7:26:10 AM GMT> <WARNING> <Configuration error while reading domain directory>
weblogic.nodemanager.common.ConfigException: The domain 'base_domain' at 'null' was not registered in the nodemanager.domains file and
ic domain registration is not supported. Please register the domain in the nodemanager.domains file.
        at weblogic.nodemanager.server.NMServer.getDomainManager(NMServer.java:285)
        at weblogic.nodemanager.server.Handler.handleDomain(Handler.java:277)
        at weblogic.nodemanager.server.Handler.handleCommand(Handler.java:131)
        at weblogic.nodemanager.server.Handler.run(Handler.java:81)
        at java.lang.Thread.run(Thread.java:724)

Solution: Manually edit the nodemanager.domains and add a domain in that.

Weblogic 12.1.2 | Node Manager Startup Issues

Environment Details:
OS: Linux Server 5.8 64bit
Version: Weblogic Server 12.1.2
Installation location: /u01/app/oracle/product/fmw

Issue: Node Manager was throwing error when we invoked the script startNodeManager.sh script from $WLS_HOME/server/bin

[oraem@linux01 bin]$ pwd
[oraem@linux01 bin]$ /u01/app/oracle/product/fmw/wlserver/server/bin
[oraem@linux01 bin]$ ./startNodeManager.sh 
+ CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..
+ '[' '!' -z '' ']'
+ '[' '!' -z '' ']'
+ export CLASSPATH
+ export PATH
+ cd /u01/app/oracle/product/fmw/wlserver/../oracle_common/common/nodemanager
+ set -x
+ '[' '' '!=' '' ']'
+ '[' '' '!=' '' ']'
+ /u01/app/oracle/product/jdk1.7.0_40/bin/java -client -Xms32m -Xmx200m -XX:MaxPermSize=128m -Dcoherence.home=/u01/app/oracle/product/fmw/wlserver/../coherence -Dbea.home=/u01/app/oracle/product/fmw/wlserver/.. -Xverify:none -Djava.endorsed.dirs=/u01/app/oracle/product/jdk1.7.0_40/jre/lib/endorsed:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/endorsed -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/u01/app/oracle/product/jdk1.7.0_40 weblogic.NodeManager -v
<Oct 16, 2013 4:29:07 AM GMT> <INFO> <Loading domains file: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/nodemanager.domains>
<Oct 16, 2013 4:29:07 AM GMT> <WARNING> <Domains file not found: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/nodemanager.domains>
<Oct 16, 2013 4:29:08 AM GMT> <INFO> <Loading identity key store: FileName=/u01/app/oracle/product/fmw/oracle_common/common/nodemanager/security/DemoIdentity.jks, Type=jks, PassPhraseUsed=true>
<Oct 16, 2013 4:29:08 AM GMT> <SEVERE> <Fatal error in NodeManager server>
weblogic.nodemanager.common.ConfigException: Identity key store file not found: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/security/DemoIdentity.jks
        at weblogic.nodemanager.server.SSLConfig.loadKeyStoreConfig(SSLConfig.java:170)
        at weblogic.nodemanager.server.SSLConfig.access$000(SSLConfig.java:32)
        at weblogic.nodemanager.server.SSLConfig$1.run(SSLConfig.java:111)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.nodemanager.server.SSLConfig.<init>(SSLConfig.java:108)
        at weblogic.nodemanager.server.NMServer.<init>(NMServer.java:121)
        at weblogic.nodemanager.server.NMServer.main(NMServer.java:383)
        at weblogic.NodeManager.main(NodeManager.java:31)

+ set +x


Solution: In Weblogic 12.1.2, we have to start the node manager from DOMAIN_HOME/bin using the startNodeManager.sh script

[oraem@linux01 bin]$ pwd
[oraem@linux01 bin]$ /u01/app/oracle/product/fmw/user_projects/domains/base_domain/bin
[oraem@linux01 bin]$ ./startNodeManager.sh CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..
+ '[' '!' -z '' ']'
+ '[' '!' -z /u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/oracle.jps_12.1.2/jps-manifest.jar ']'
+ CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/oracle.jps_12.1.2/jps-manifest.jar
+ export CLASSPATH
+ export PATH
+ cd /u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager
+ set -x
+ '[' '' '!=' '' ']'
+ '[' '' '!=' '' ']'
+ /u01/app/oracle/product/jdk1.7.0_40/bin/java -client -Xms32m -Xmx200m -XX:MaxPermSize=128m -Dcoherence.home=/u01/app/oracle/product/fmw/wlserver/../coherence -Dbea.home=/u01/app/oracle/product/fmw/wlserver/.. -Doracle.security.jps.config=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/config/fmwconfig/jps-config-jse.xml -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dcommon.components.home=/u01/app/oracle/product/fmw/oracle_common -Dopss.version=12.1.2 -Dweblogic.RootDirectory=/u01/app/oracle/product/fmw/user_projects/domains/base_domain -Xverify:none -Djava.endorsed.dirs=/u01/app/oracle/product/jdk1.7.0_40/jre/lib/endorsed:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/endorsed -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/u01/app/oracle/product/jdk1.7.0_40 weblogic.NodeManager -v
<Oct 16, 2013 7:48:02 AM UTC> <INFO> <Loading domains file: /u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.domains>
<Oct 16, 2013 7:48:03 AM UTC> <INFO> <Loading identity key store: FileName=kss://system/demoidentity, Type=kss, PassPhraseUsed=true>
Oct 16, 2013 7:48:05 AM org.hibernate.validator.util.Version <clinit>
INFO: Hibernate Validator 12.1.2.0.0
Oct 16, 2013 7:48:05 AM org.hibernate.validator.engine.resolver.DefaultTraversableResolver detectJPA
INFO: Instantiated an instance of org.hibernate.validator.engine.resolver.JPATraversableResolver.
Oct 16, 2013 7:48:10 AM oracle.security.jps.internal.idstore.util.LibOvdUtil pushLdapNamesToLibOvd
INFO: Pushed ldap name and types info to libOvd. Ldaps : u01apporacleproductfmwuser_projectsdomainsbase_domainconfigfmwconfigsystem-jazn-data.xmlidstore.xml.provideridstore.xml.
<Oct 16, 2013 7:48:16 AM UTC> <INFO> <Loaded NodeManager configuration properties from '/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.properties'>
Node manager v12.1.2

Configuration settings:

NodeManagerHome=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager
ListenAddress=linux01.us.oracle.com
ListenPort=5556
ListenBacklog=50
SecureListener=true
AuthenticationEnabled=true
NativeVersionEnabled=true
CrashRecoveryEnabled=false
JavaHome=/u01/app/oracle/product/jdk1.7.0_40
StartScriptEnabled=true
StopScriptEnabled=false
StartScriptName=startWebLogic.sh
StopScriptName=
CoherenceStartScriptEnabled=false
CoherenceStartScriptName=null
LogFile=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.log
LogLevel=INFO
LogLimit=0
LogCount=1
LogAppend=true
LogToStderr=true
LogFormatter=weblogic.nodemanager.server.LogFormatter
DomainsFile=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.domains
DomainsFileEnabled=true
StateCheckInterval=500
UseMACBroadcast=false
DomainRegistrationEnabled=false
DomainsDirRemoteSharingEnabled=false
RotatedFileCount=7
FileSizeKB=500
NumberOfFilesLimited=false
RotationTimeStart=00:00
RotationType=bySize
FileTimeSpan=24
FileTimeSpanFactor=3600000
ProcessDestroyTimeout=20000
Domain name mappings:

base_domain -> /u01/app/oracle/product/fmw/user_projects/domains/base_domain

<Oct 16, 2013 7:48:16 AM UTC> <INFO> <WebLogic Server 12.1.2.0.0  Fri Jun 7 15:16:15 PDT 2013 1530982 WLS_12.1.2.0.0_GENERIC_130607.1100>
<Oct 16, 2013 7:48:16 AM UTC> <INFO> <base_domain> <ManagedServer_2> <Startup configuration properties loaded from "/u01/app/oracle/product/fmw/user_projects/domains/base_domain/servers/ManagedServer_2/data/nodemanager/startup.properties">

<Oct 16, 2013 7:48:16 AM UTC> <INFO> <Secure socket listener started on port 5556, host linux01.us.oracle.com/10.11.12.21>

Oracle RAC 11gR2 Deinstallation Steps

Environment Details:
OS: Linux 5.8
User: oracle
Two Node RAC: linux01, linux02
Database Version: 11.2.0.3.0
Oracle Home: /u01/app/oracle/product/11.2.0/dbhome_1
Grid Home: /u01/app/11.2.0/grid

Steps to be followed to deinstall Oracle RAC
Step 1: Drop the database using the dbca
Step 2: Deinstall the oracle Home using deinstall from $ORACLE_HOME/deinstall
Step 3: Deinstall the Clusterware Software using the deinstall from $GRID_HOME/deinstall
Step 3.a: Run the command which are given at the end of the above Step 3. on all the node and then on the last node from the root


The log output of Step 2:
[oracle@linux01 /u01/app/oracle/product/11.2.0/dbhome_1/deinstall]$ ./deinstall
Checking for required files and bootstrapping ...
Please wait ...
Location of logs /u01/app/oraInventory/logs/

############ ORACLE DEINSTALL & DECONFIG TOOL START ############


######################### CHECK OPERATION START #########################
## [START] Install check configuration ##


Checking for existence of the Oracle home location /u01/app/oracle/product/11.2.0/dbhome_1
Oracle Home type selected for deinstall is: Oracle Real Application Cluster Database
Oracle Base selected for deinstall is: /u01/app/oracle
Checking for existence of central inventory location /u01/app/oraInventory
Checking for existence of the Oracle Grid Infrastructure home /u01/app/11.2.0/grid
The following nodes are part of this cluster: linux01,linux02
Checking for sufficient temp space availability on node(s) : 'linux01,linux02'

## [END] Install check configuration ##


Network Configuration check config START

Network de-configuration trace file location: /u01/app/oraInventory/logs/netdc_check2013-10-10_12-08-34-AM.log

Network Configuration check config END

Database Check Configuration START

Database de-configuration trace file location: /u01/app/oraInventory/logs/databasedc_check2013-10-10_12-08-37-AM.log

Use comma as separator when specifying list of values as input

Specify the list of database names that are configured in this Oracle home []: 
Database Check Configuration END

Enterprise Manager Configuration Assistant START

EMCA de-configuration trace file location: /u01/app/oraInventory/logs/emcadc_check2013-10-10_12-08-41-AM.log 

Enterprise Manager Configuration Assistant END
Oracle Configuration Manager check START
OCM check log file location : /u01/app/oraInventory/logs//ocm_check8922.log
Oracle Configuration Manager check END

######################### CHECK OPERATION END #########################


####################### CHECK OPERATION SUMMARY #######################
Oracle Grid Infrastructure Home is: /u01/app/11.2.0/grid
The cluster node(s) on which the Oracle home deinstallation will be performed are:linux01,linux02
Oracle Home selected for deinstall is: /u01/app/oracle/product/11.2.0/dbhome_1
Inventory Location where the Oracle home registered is: /u01/app/oraInventory
No Enterprise Manager configuration to be updated for any database(s)
No Enterprise Manager ASM targets to update
No Enterprise Manager listener targets to migrate
Checking the config status for CCR
linux01 : Oracle Home exists with CCR directory, but CCR is not configured
linux02 : Oracle Home exists with CCR directory, but CCR is not configured
CCR check is finished
Do you want to continue (y - yes, n - no)? [n]: y
A log of this session will be written to: '/u01/app/oraInventory/logs/deinstall_deconfig2013-10-10_12-08-25-AM.out'
Any error messages from this session will be written to: '/u01/app/oraInventory/logs/deinstall_deconfig2013-10-10_12-08-25-AM.err'

######################## CLEAN OPERATION START ########################

Enterprise Manager Configuration Assistant START

EMCA de-configuration trace file location: /u01/app/oraInventory/logs/emcadc_clean2013-10-10_12-08-41-AM.log 

Updating Enterprise Manager ASM targets (if any)
Updating Enterprise Manager listener targets (if any)
Enterprise Manager Configuration Assistant END
Database de-configuration trace file location: /u01/app/oraInventory/logs/databasedc_clean2013-10-10_12-09-21-AM.log

Network Configuration clean config START

Network de-configuration trace file location: /u01/app/oraInventory/logs/netdc_clean2013-10-10_12-09-21-AM.log

De-configuring Listener configuration file on all nodes...
Listener configuration file de-configured successfully.

De-configuring Naming Methods configuration file on all nodes...
Naming Methods configuration file de-configured successfully.

De-configuring Local Net Service Names configuration file on all nodes...
Local Net Service Names configuration file de-configured successfully.

De-configuring Directory Usage configuration file on all nodes...
Directory Usage configuration file de-configured successfully.

De-configuring backup files on all nodes...
Backup files de-configured successfully.

The network configuration has been cleaned up successfully.

Network Configuration clean config END

Oracle Configuration Manager clean START
OCM clean log file location : /u01/app/oraInventory/logs//ocm_clean8922.log
Oracle Configuration Manager clean END
Setting the force flag to false
Setting the force flag to cleanup the Oracle Base
Oracle Universal Installer clean START

Detach Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the local node : Done

Delete directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the local node : Done

The Oracle Base directory '/u01/app/oracle' will not be removed on local node. The directory is not empty.

Detach Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the remote nodes 'linux02' : Done

Delete directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the remote nodes 'linux02' : Done

The Oracle Base directory '/u01/app/oracle' will not be removed on node 'linux02'. The directory is not empty.

Oracle Universal Installer cleanup was successful.

Oracle Universal Installer clean END


## [START] Oracle install clean ##

Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_00-08-03AM' on node 'linux01'
Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_00-08-03AM' on node 'linux02'

## [END] Oracle install clean ##


######################### CLEAN OPERATION END #########################


####################### CLEAN OPERATION SUMMARY #######################
Cleaning the config for CCR
As CCR is not configured, so skipping the cleaning of CCR configuration
CCR clean is finished
Successfully detached Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the local node.
Successfully deleted directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the local node.
Successfully detached Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the remote nodes 'linux02'.
Oracle Universal Installer cleanup was successful.

Oracle deinstall tool successfully cleaned up temporary directories.
#######################################################################


############# ORACLE DEINSTALL & DECONFIG TOOL END #############


The log output of Step 3:
[oracle@linux01 /u01/app/11.2.0/grid/deinstall]$ ./deinstall
Checking for required files and bootstrapping ...
Please wait ...
Location of logs /tmp/deinstall2013-10-10_02-32-31AM/logs/

############ ORACLE DEINSTALL & DECONFIG TOOL START ############


######################### CHECK OPERATION START #########################
## [START] Install check configuration ##


Checking for existence of the Oracle home location /u01/app/11.2.0/grid
Oracle Home type selected for deinstall is: Oracle Grid Infrastructure for a Cluster
Oracle Base selected for deinstall is: /u01/app/grid
Checking for existence of central inventory location /u01/app/oraInventory
Checking for existence of the Oracle Grid Infrastructure home /u01/app/11.2.0/grid
The following nodes are part of this cluster: linux01,linux02
Checking for sufficient temp space availability on node(s) : 'linux01,linux02'

## [END] Install check configuration ##

Traces log file: /tmp/deinstall2013-10-10_02-32-31AM/logs//crsdc.log

Network Configuration check config START

Network de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/netdc_check2013-10-10_02-33-02-AM.log

Specify all RAC listeners (do not include SCAN listener) that are to be de-configured [LISTENER]:

Network Configuration check config END

Asm Check Configuration START

ASM de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_check2013-10-10_02-33-06-AM.log

Automatic Storage Management (ASM) instance is detected in this Oracle home /u01/app/11.2.0/grid.
ASM Diagnostic Destination : /u01/app/grid
ASM Diskgroups : +DATA
ASM diskstring : <Default>
Diskgroups will be dropped
De-configuring ASM will drop all the diskgroups and it's contents at cleanup time. This will affect all of the databases and ACFS that use this ASM instance(s).
 If you want to retain the existing diskgroups or if any of the information detected is incorrect, you can modify by entering 'y'. Do you  want to modify above information (y|n) [n]: y
Specify the ASM Diagnostic Destination [/u01/app/grid]: 
Specify the diskstring []: 
Specify the diskgroups that are managed by this ASM instance [+DATA]: 

De-configuring ASM will drop the diskgroups at cleanup time. Do you want deconfig tool to drop the diskgroups y|n [y]: y


######################### CHECK OPERATION END #########################


####################### CHECK OPERATION SUMMARY #######################
Oracle Grid Infrastructure Home is: /u01/app/11.2.0/grid
The cluster node(s) on which the Oracle home deinstallation will be performed are:linux01,linux02
Oracle Home selected for deinstall is: /u01/app/11.2.0/grid
Inventory Location where the Oracle home registered is: /u01/app/oraInventory
Following RAC listener(s) will be de-configured: LISTENER
ASM instance will be de-configured from this Oracle home
Do you want to continue (y - yes, n - no)? [n]: y
A log of this session will be written to: '/tmp/deinstall2013-10-10_02-32-31AM/logs/deinstall_deconfig2013-10-10_02-32-50-AM.out'
Any error messages from this session will be written to: '/tmp/deinstall2013-10-10_02-32-31AM/logs/deinstall_deconfig2013-10-10_02-32-50-AM.err'

######################## CLEAN OPERATION START ########################
ASM de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_clean2013-10-10_02-34-13-AM.log
ASM Clean Configuration START
ASM Clean Configuration END

Network Configuration clean config START

Network de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/netdc_clean2013-10-10_02-35-55-AM.log

De-configuring RAC listener(s): LISTENER

De-configuring listener: LISTENER
    Stopping listener: LISTENER
    Listener stopped successfully.
    Unregistering listener: LISTENER
    Listener unregistered successfully.
Listener de-configured successfully.

De-configuring Naming Methods configuration file on all nodes...
Naming Methods configuration file de-configured successfully.

De-configuring Local Net Service Names configuration file on all nodes...
Local Net Service Names configuration file de-configured successfully.

De-configuring Directory Usage configuration file on all nodes...
Directory Usage configuration file de-configured successfully.

De-configuring backup files on all nodes...
Backup files de-configured successfully.

The network configuration has been cleaned up successfully.

Network Configuration clean config END


---------------------------------------->

The deconfig command below can be executed in parallel on all the remote nodes. Execute the command on  the local node after the execution completes on all the remote nodes.

Run the following command as the root user or the administrator on node "linux02".

/tmp/deinstall2013-10-10_02-32-31AM/perl/bin/perl -I/tmp/deinstall2013-10-10_02-32-31AM/perl/lib -I/tmp/deinstall2013-10-10_02-32-31AM/crs/install /tmp/deinstall2013-10-10_02-32-31AM/crs/install/rootcrs.pl -force  -deconfig -paramfile "/tmp/deinstall2013-10-10_02-32-31AM/response/deinstall_Ora11g_gridinfrahome1.rsp"

Run the following command as the root user or the administrator on node "linux01".

/tmp/deinstall2013-10-10_02-32-31AM/perl/bin/perl -I/tmp/deinstall2013-10-10_02-32-31AM/perl/lib -I/tmp/deinstall2013-10-10_02-32-31AM/crs/install /tmp/deinstall2013-10-10_02-32-31AM/crs/install/rootcrs.pl -force  -deconfig -paramfile "/tmp/deinstall2013-10-10_02-32-31AM/response/deinstall_Ora11g_gridinfrahome1.rsp" -lastnode

Press Enter after you finish running the above commands

<----------------------------------------

Setting the force flag to false
Setting the force flag to cleanup the Oracle Base
Oracle Universal Installer clean START

Detach Oracle home '/u01/app/11.2.0/grid' from the central inventory on the local node : Done

Delete directory '/u01/app/11.2.0/grid' on the local node : Done

Delete directory '/u01/app/oraInventory' on the local node : Done

Delete directory '/u01/app/grid' on the local node : Done

Detach Oracle home '/u01/app/11.2.0/grid' from the central inventory on the remote nodes 'linux02' : Done

Delete directory '/u01/app/11.2.0/grid' on the remote nodes 'linux02' : Done

Delete directory '/u01/app/oraInventory' on the remote nodes 'linux02' : Done

Delete directory '/u01/app/grid' on the remote nodes 'linux02' : Done

Oracle Universal Installer cleanup was successful.

Oracle Universal Installer clean END


## [START] Oracle install clean ##

Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_02-32-31AM' on node 'linux01'
Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_02-32-31AM' on node 'linux02'

## [END] Oracle install clean ##


######################### CLEAN OPERATION END #########################


####################### CLEAN OPERATION SUMMARY #######################
ASM instance was de-configured successfully from the Oracle home
Following RAC listener(s) were de-configured successfully: LISTENER
Oracle Clusterware is stopped and successfully de-configured on node "linux01"
Oracle Clusterware is stopped and successfully de-configured on node "linux02"
Oracle Clusterware is stopped and de-configured successfully.
Successfully detached Oracle home '/u01/app/11.2.0/grid' from the central inventory on the local node.
Successfully deleted directory '/u01/app/11.2.0/grid' on the local node.
Successfully deleted directory '/u01/app/oraInventory' on the local node.
Successfully deleted directory '/u01/app/grid' on the local node.
Successfully detached Oracle home '/u01/app/11.2.0/grid' from the central inventory on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/11.2.0/grid' on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/oraInventory' on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/grid' on the remote nodes 'linux02'.
Oracle Universal Installer cleanup was successful.


Run 'rm -rf /etc/oraInst.loc' as root on node(s) 'linux01,linux02' at the end of the session.

Run 'rm -rf /opt/ORCLfmap' as root on node(s) 'linux01,linux02' at the end of the session.
Oracle deinstall tool successfully cleaned up temporary directories.
#######################################################################


############# ORACLE DEINSTALL & DECONFIG TOOL END #############

The log output of Step 3.a for the last node:

[root@linux01 ~]# /tmp/deinstall2013-10-10_02-32-31AM/perl/bin/perl -I/tmp/deinstall2013-10-10_02-32-31AM/perl/lib -I/tmp/deinstall2013-10-10_02-32-31AM/crs/install /tmp/deinstall2013-10-10_02-32-31AM/crs/install/rootcrs.pl -force  -deconfig -paramfile "/tmp/deinstall2013-10-10_02-32-31AM/response/deinstall_Ora11g_gridinfrahome1.rsp" -lastnode
Using configuration parameter file: /tmp/deinstall2013-10-10_02-32-31AM/response /deinstall_Ora11g_gridinfrahome1.rsp
Network exists: 1/10.11.32.0/255.255.248.0/eth0, type static
VIP exists: /linux02-v/10.11.37.64/10.11.32.0/255.255.248.0/eth0, hosting node linux02
VIP exists: /linux01-v/10.11.37.66/10.11.32.0/255.255.248.0/eth0, hosting node linux01
GSD exists
ONS exists: Local port 6100, remote port 6200, EM port 2016
CRS-2673: Attempting to stop 'ora.crsd' on 'linux01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'linux01'
CRS-2673: Attempting to stop 'ora.oc4j' on 'linux01'
CRS-2673: Attempting to stop 'ora.asm' on 'linux01'
CRS-2677: Stop of 'ora.asm' on 'linux01' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'linux01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'linux01' has completed
CRS-2677: Stop of 'ora.crsd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'linux01'
CRS-2673: Attempting to stop 'ora.evmd' on 'linux01'
CRS-2673: Attempting to stop 'ora.asm' on 'linux01'
CRS-2677: Stop of 'ora.evmd' on 'linux01' succeeded
CRS-2677: Stop of 'ora.asm' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'linux01'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'linux01' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'linux01'
CRS-2677: Stop of 'ora.cssd' on 'linux01' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'linux01'
CRS-2676: Start of 'ora.cssdmonitor' on 'linux01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'linux01'
CRS-2672: Attempting to start 'ora.diskmon' on 'linux01'
CRS-2676: Start of 'ora.diskmon' on 'linux01' succeeded
CRS-2676: Start of 'ora.cssd' on 'linux01' succeeded
CRS-4611: Successful deletion of voting disk +DATA.
ASM de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_clean2013-10-10_02-41-58-AM.log
ASM Clean Configuration START
ASM Clean Configuration END

ASM with SID +ASM1 deleted successfully. Check /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_clean2013-10-10_02-41-58-AM.log for details.

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'linux01'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'linux01'
CRS-2673: Attempting to stop 'ora.crf' on 'linux01'
CRS-2673: Attempting to stop 'ora.ctssd' on 'linux01'
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'linux01'
CRS-2677: Stop of 'ora.mdnsd' on 'linux01' succeeded
CRS-2677: Stop of 'ora.crf' on 'linux01' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'linux01' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'linux01'
CRS-2677: Stop of 'ora.cssd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'linux01'
CRS-2677: Stop of 'ora.gipcd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'linux01'
CRS-2677: Stop of 'ora.gpnpd' on 'linux01' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'linux01' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully deconfigured Oracle clusterware stack on this node