The patch directory doesn't match the patch id | Oracle Forms

Issues: While applying the patch 17459191, we were getting the below mentioned error:

The patch directory 17459191 doesn't match the patch id. 
ERROR: OPatch failed during pre-reqs check. 
OPatch returns with error code = 150 

Solution:
One of the prerequisite mentioned in the patch was missing and has not been taken care 
i.e. Upgrade to the latest OUI 10.1 by downloading and installing the same from bug 6640838

One important note while upgrading the OUI is go for the custom install and then Expand All and select the "Installer SDK Component 10.1.0.6.0"

Once I upgraded the OUI the error was resolved while applying the patch

BEA-149205 Failed to initialize the application 'em' due to error java.lang.ClassNotFoundException: javax.faces.application.ProjectStage

Issue: After the upgrade of ADF from 11.1.1.6 to 11.1.2.2(by applying Patch 13656372 & 13656274), when we tried to access the weblogic EM page it was not coming up and throwing some error. In the logfile the below mentioned logs were present:

<Error> <Deployer> <BEA-149205> <Failed to initialize the application 'em' due to error java.lang.ClassNotFoundException: javax.faces.application.ProjectStage.
java.lang.ClassNotFoundException: javax.faces.application.ProjectStage
        at weblogic.utils.classloaders.GenericClassLoader.findLocalClass(GenericClassLoader.java:297)
        at weblogic.utils.classloaders.GenericClassLoader.findClass(GenericClassLoader.java:270)
        at weblogic.utils.classloaders.ChangeAwareClassLoader.findClass(ChangeAwareClassLoader.java:64)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)

Web Page:

Solution: After applying the patches we need to Upgrade the ADF component of the domain which was missed.

Follow the below steps to Upgrade the ADF component in domain.

1. Go to location  MW_HOME/oracle_common/common/bin
2. Invoke wlst.sh
3. Execute the command
upgradeADF('/u01/app/oracle/product/Middleware/user_projects/domains/<your_domain_name>') 

ORA-39127: unexpected error from call to "EXFSYS"."DBMS_EXPFIL_DEPASEXP" | while using expdp or exp

Issue: During a full database export using the utilities exp or expdp we see the below error.

ORA-39127: unexpected error from call to "EXFSYS"."DBMS_EXPFIL_DEPASEXP" 

Datapump Export log(expdp)

ORA-39127: unexpected error from call to "EXFSYS"."DBMS_EXPFIL_DEPASEXP"."SYSTEM_INFO_EXP"
ORA-44002: invalid object name
ORA-06512: at "SYS.DBMS_ASSERT", line 316
ORA-06512: at "SYS.DBMS_METADATA", line 9263
Processing object type DATABASE_EXPORT/SYSTEM_PROCOBJACT/PRE_SYSTEM_ACTIONS/PROCACT_SYSTEM
Processing object type DATABASE_EXPORT/SYSTEM_PROCOBJACT/PROCOBJ
ORA-39127: unexpected error from call to "EXFSYS"."DBMS_EXPFIL_DEPASEXP"."SYSTEM_INFO_EXP"
ORA-44002: invalid object name
ORA-06512: at "SYS.DBMS_ASSERT", line 316

Conventional Export log(exp)

EXP-00008: ORACLE error 6550 encountered
ORA-06550: line 1, column 14:
PLS-00201: identifier 'EXFSYS.DBMS_EXPFIL_DEPASEXP' must be declared
ORA-06550: line 1, column 7:
PL/SQL: Statement ignored
EXP-00083: The previous problem occurred when calling EXFSYS.DBMS_EXPFIL_DEPASEXP.schema_info_exp

Solution:

The account used internally to access the EXFSYS schema, which is associated with the Rules Manager and Expression Filter feature. This feature enables the building of complex PL/SQL rules and expressions. The EXFSYS schema contains the Rules Manager and Expression Filter DDL, DML, and associated metadata. EXFSYS schema is missing in the database. To install the EXFSYS schema execute the script "catexf.sql" as SYS user.

connect as sysdba and execute the below script

@?/rdbms/admin/catexf.sql

ORA-00119: invalid specification for system parameter LOCAL_LISTENER

Issue: ORA-00119: invalid specification for system parameter LOCAL_LISTENER
ORA-00132: syntax error or unresolved network name 'LISTENER_ORCL'

Solution: There are two methods by which this error can be removed.

Method 1:

Step 1: Make a entry in the tnsnames.ora as mentioned below
LISTENER_ORCL =
  (ADDRESS = (PROTOCOL = TCP)(HOST = linux01.com)(PORT = 1521))

Where LISTENER_ORCL is the parameter value for LOCAL_LISTENER which is mentioned in pfile/spfile
PORT is the listener port you are using.
Also there is no need to modify the pfile/spfile.


Step 2: start the database

Method 2:

Step 1: If you are using a spfile for starting up your database, create a pfile from it.

Step 2: Edit the pfile and remove the parameter LOCAL_LISTENER

Step 3: Create spfile from the pfile and start the database

ORA-12641: Authentication service failed to initialize

Issue:
[oracle@linux01 ~]$ sqlplus system@orcldb

SQL*Plus: Release 11.2.0.3.0 Production on Fri Nov 15 06:44:44 2013

Copyright (c) 1982, 2011, Oracle.  All rights reserved.

Enter password:
ERROR:
ORA-12641: Authentication service failed to initialize

Solution:
Step 1: Open the sqlnet.ora file present at $ORACLE_HOME/network/admin location 
Step 2: Check the value for parameter SQLNET.AUTHENTICATION_SERVICES
Step 3: If the value for SQLNET.AUTHENTICATION_SERVICES is ALL 

The contents of sqlnet.ora are as mentioned below
[oracle@linux01 admin]$ cat sqlnet.ora
# sqlnet.ora Network Configuration File: /u01/app/oracle/product/112030/network/admin/sqlnet.ora
# Generated by Oracle configuration tools.

# This file is actually generated by netca. But if customers choose to
# install "Software Only", this file wont exist and without the native
# authentication, they will not be able to connect to the database on NT.

SQLNET.AUTHENTICATION_SERVICES= (ALL)

Step 4: Change the value for SQLNET.AUTHENTICATION_SERVICES to NONE

SQLNET.AUTHENTICATION_SERVICES= (NONE)

TNS-12555: TNS:permission denied | TNS-12560: TNS:protocol adapter error | TNS-00525: Insufficient privilege for operation | Linux Error: 1: Operation not permitted

Issue: while starting the listener we were getting the below error.

[oracle@linux01 ~]$ lsnrctl start

LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 11-NOV-2013 01:53:59

Copyright (c) 1991, 2009, Oracle.  All rights reserved.

Starting /app/oracle/product/11.2.0/dbhome_1/bin/tnslsnr: please wait...

TNSLSNR for Linux: Version 11.2.0.1.0 - Production
System parameter file is /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
Log messages written to /app/oracle/diag/tnslsnr/linux01/listener/alert/log.xml
Error listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC1521)))
TNS-12555: TNS:permission denied
 TNS-12560: TNS:protocol adapter error
  TNS-00525: Insufficient privilege for operation
   Linux Error: 1: Operation not permitted

Listener failed to start. See the error message(s) above...

The contents of the listener.ora file

[oracle@linux01 ~]$ cd $ORACLE_HOME
[oracle@linux01 admin]$ cat listener.ora
# listener.ora Network Configuration File: /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
# Generated by Oracle configuration tools.

LISTENER =
  (DESCRIPTION_LIST =
    (DESCRIPTION =
      (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = linux01)(PORT = 1521))
    )
  )

Solution 1: Recreate the directory /var/tmp/.oracle as mentioned below & then start the listener.

[oracle@slc00ryy ~]# cd /var/tmp
[oracle@slc00ryy tmp]# ls -la
drwxrwxrwt   2 root     oinstall  4096 Nov 11 02:00 .oracle

[oracle@slc00ryy tmp]# mv .oracle .oracle.orig
[oracle@slc00ryy tmp]# mkdir .oracle
[oracle@slc00ryy tmp]# chmod 01777 .oracle
[oracle@slc00ryy tmp]# chown -R root:oinstall .oracle
[oracle@slc00ryy tmp]# chgrp root .oracle
  
Solution 2: Change the KEY in the listener.ora file to EXTPROC0 (changed 1521 to 0 (zero)) and started the listener. It worked.

[oracle@linux01 admin]$ vi listener.ora
[oracle@linux01 admin]$ cat listener.ora
# listener.ora Network Configuration File: /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
# Generated by Oracle configuration tools.
LISTENER =
  (DESCRIPTION_LIST =
    (DESCRIPTION =
      (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC0))
      (ADDRESS = (PROTOCOL = TCP)(HOST = linux01)(PORT = 1521))
    )
  )

[oracle@linux01 admin]$ lsnrctl start

LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 11-NOV-2013 01:56:15
Copyright (c) 1991, 2009, Oracle.  All rights reserved.
Starting /app/oracle/product/11.2.0/dbhome_1/bin/tnslsnr: please wait...
TNSLSNR for Linux: Version 11.2.0.1.0 - Production
System parameter file is /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
Log messages written to /app/oracle/diag/tnslsnr/linux01/listener/alert/log.xml
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC0)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=linux01)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC0)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 11.2.0.1.0 - Production
Start Date                11-NOV-2013 01:56:15
Uptime                    0 days 0 hr. 0 min. 0 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
Listener Log File         /app/oracle/diag/tnslsnr/linux01/listener/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC0)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=linux01)(PORT=1521)))
The listener supports no services
The command completed successfully

ORA-01102: cannot mount database in EXCLUSIVE mode

Environment Details:
OS: Linux Server 5.8 64bit
Version: 11.2.0.3.0
Software Installation location: /u01/app/oracle/product/112030
Database Name: testdb
Datafile's Location: /u01/oradata/testdb

Issue: While starting the database we were getting the error "ORA-01102: cannot mount database in EXCLUSIVE mode".

Error Message:
oracle@linux01=> sqlplus sys as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Wed Nov 6 04:02:10 2013
Copyright (c) 1982, 2011, Oracle.  All rights reserved.
Enter password: 
Connected to an idle instance.

SQL> startup

ORACLE instance started.

Total System Global Area  680607744 bytes
Fixed Size                  2231472 bytes
Variable Size             507511632 bytes
Database Buffers          163577856 bytes
Redo Buffers                7286784 bytes
ORA-01102: cannot mount database in EXCLUSIVE mode

Excerpt from the Alert log file
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
starting up 1 shared server(s) ...
ORACLE_BASE from environment = /u01/app/oracle
Wed Nov 06 04:02:44 2013
ALTER DATABASE   MOUNT
sculkget: failed to lock /u01/app/oracle/product/112030/dbs/lkTESTDB exclusive
sculkget: lock held by PID: 64
ORA-09968: unable to lock file
Linux-x86_64 Error: 11: Resource temporarily unavailable
Additional information: 64
ORA-1102 signalled during: ALTER DATABASE   MOUNT...

Solution:

• Shutdown the database which is started(it will be in NOMOUNT Mode)
• Check if any other process is running for that database, if yes kill those processes.
• Copy the directory containing the datafiles to a different location.
• Rename the directory to a different name and move the copied directory back to the same name.
• Now go to $ORACLE_HOME/dbs and delete the file lkTESTDB
• Start the database

89-oracle@linux01=> sqlplus sys as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Wed Nov 6 06:13:15 2013
Copyright (c) 1982, 2011, Oracle.  All rights reserved.

Enter password: 

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL> shutdown immediate 
ORA-01507: database not mounted


ORACLE instance shut down.
SQL> exit

oracle@linux01=> ps -ef|grep testdb
oracle     974  6086  0 00:09 pts/1    00:00:00 grep testdb

oracle@linux01=> cd /u01/oradata
oracle@linux01=> cp -r testdb testdb.1
oracle@linux01=> mv -r testdb testdb.old
oracle@linux01=> mv testdb.1 testdb
oracle@linux01=> cd $ORACLE_HOME/dbs
oracle@linux01=> rm lkTESTDB

oracle@linux01=> sqlplus sys as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Wed Nov 6 04:25:12 2013
Copyright (c) 1982, 2011, Oracle.  All rights reserved.
Enter password: 
Connected to an idle instance.

SQL> startup
ORACLE instance started.

Total System Global Area  680607744 bytes
Fixed Size                  2231472 bytes
Variable Size             507511632 bytes
Database Buffers          163577856 bytes
Redo Buffers                7286784 bytes
Database mounted.
Database opened.
SQL> exit

Node Manager associated with machine is not reachable | Weblogic

Environment Details:
OS: Linux Server 5.8 64bit
Version: Weblogic Server 12.1.2
Installation location: /u01/app/oracle/product/fmw
DOMAIN_HOME: /u01/app/oracle/product/fmw/user_projects/domains/base_domain

Issue: After starting up the Oracle WebLogic 12c AdminServer server, when trying to start any of our managed servers from console page, we were getting the below error. Verified that the node manager was running but still we were encountering this issue.

<Oct 16, 2013 7:26:10 AM GMT> <WARNING> <Configuration error while reading domain directory>
weblogic.nodemanager.common.ConfigException: The domain 'base_domain' at 'null' was not registered in the nodemanager.domains file and
ic domain registration is not supported. Please register the domain in the nodemanager.domains file.
        at weblogic.nodemanager.server.NMServer.getDomainManager(NMServer.java:285)
        at weblogic.nodemanager.server.Handler.handleDomain(Handler.java:277)
        at weblogic.nodemanager.server.Handler.handleCommand(Handler.java:131)
        at weblogic.nodemanager.server.Handler.run(Handler.java:81)
        at java.lang.Thread.run(Thread.java:724)

Solution: Manually edit the nodemanager.domains and add a domain in that.

Weblogic 12.1.2 | Node Manager Startup Issues

Environment Details:
OS: Linux Server 5.8 64bit
Version: Weblogic Server 12.1.2
Installation location: /u01/app/oracle/product/fmw

Issue: Node Manager was throwing error when we invoked the script startNodeManager.sh script from $WLS_HOME/server/bin

[oraem@linux01 bin]$ pwd
[oraem@linux01 bin]$ /u01/app/oracle/product/fmw/wlserver/server/bin
[oraem@linux01 bin]$ ./startNodeManager.sh 
+ CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..
+ '[' '!' -z '' ']'
+ '[' '!' -z '' ']'
+ export CLASSPATH
+ export PATH
+ cd /u01/app/oracle/product/fmw/wlserver/../oracle_common/common/nodemanager
+ set -x
+ '[' '' '!=' '' ']'
+ '[' '' '!=' '' ']'
+ /u01/app/oracle/product/jdk1.7.0_40/bin/java -client -Xms32m -Xmx200m -XX:MaxPermSize=128m -Dcoherence.home=/u01/app/oracle/product/fmw/wlserver/../coherence -Dbea.home=/u01/app/oracle/product/fmw/wlserver/.. -Xverify:none -Djava.endorsed.dirs=/u01/app/oracle/product/jdk1.7.0_40/jre/lib/endorsed:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/endorsed -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/u01/app/oracle/product/jdk1.7.0_40 weblogic.NodeManager -v
<Oct 16, 2013 4:29:07 AM GMT> <INFO> <Loading domains file: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/nodemanager.domains>
<Oct 16, 2013 4:29:07 AM GMT> <WARNING> <Domains file not found: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/nodemanager.domains>
<Oct 16, 2013 4:29:08 AM GMT> <INFO> <Loading identity key store: FileName=/u01/app/oracle/product/fmw/oracle_common/common/nodemanager/security/DemoIdentity.jks, Type=jks, PassPhraseUsed=true>
<Oct 16, 2013 4:29:08 AM GMT> <SEVERE> <Fatal error in NodeManager server>
weblogic.nodemanager.common.ConfigException: Identity key store file not found: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/security/DemoIdentity.jks
        at weblogic.nodemanager.server.SSLConfig.loadKeyStoreConfig(SSLConfig.java:170)
        at weblogic.nodemanager.server.SSLConfig.access$000(SSLConfig.java:32)
        at weblogic.nodemanager.server.SSLConfig$1.run(SSLConfig.java:111)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.nodemanager.server.SSLConfig.<init>(SSLConfig.java:108)
        at weblogic.nodemanager.server.NMServer.<init>(NMServer.java:121)
        at weblogic.nodemanager.server.NMServer.main(NMServer.java:383)
        at weblogic.NodeManager.main(NodeManager.java:31)

+ set +x


Solution: In Weblogic 12.1.2, we have to start the node manager from DOMAIN_HOME/bin using the startNodeManager.sh script

[oraem@linux01 bin]$ pwd
[oraem@linux01 bin]$ /u01/app/oracle/product/fmw/user_projects/domains/base_domain/bin
[oraem@linux01 bin]$ ./startNodeManager.sh CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..
+ '[' '!' -z '' ']'
+ '[' '!' -z /u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/oracle.jps_12.1.2/jps-manifest.jar ']'
+ CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/oracle.jps_12.1.2/jps-manifest.jar
+ export CLASSPATH
+ export PATH
+ cd /u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager
+ set -x
+ '[' '' '!=' '' ']'
+ '[' '' '!=' '' ']'
+ /u01/app/oracle/product/jdk1.7.0_40/bin/java -client -Xms32m -Xmx200m -XX:MaxPermSize=128m -Dcoherence.home=/u01/app/oracle/product/fmw/wlserver/../coherence -Dbea.home=/u01/app/oracle/product/fmw/wlserver/.. -Doracle.security.jps.config=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/config/fmwconfig/jps-config-jse.xml -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dcommon.components.home=/u01/app/oracle/product/fmw/oracle_common -Dopss.version=12.1.2 -Dweblogic.RootDirectory=/u01/app/oracle/product/fmw/user_projects/domains/base_domain -Xverify:none -Djava.endorsed.dirs=/u01/app/oracle/product/jdk1.7.0_40/jre/lib/endorsed:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/endorsed -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/u01/app/oracle/product/jdk1.7.0_40 weblogic.NodeManager -v
<Oct 16, 2013 7:48:02 AM UTC> <INFO> <Loading domains file: /u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.domains>
<Oct 16, 2013 7:48:03 AM UTC> <INFO> <Loading identity key store: FileName=kss://system/demoidentity, Type=kss, PassPhraseUsed=true>
Oct 16, 2013 7:48:05 AM org.hibernate.validator.util.Version <clinit>
INFO: Hibernate Validator 12.1.2.0.0
Oct 16, 2013 7:48:05 AM org.hibernate.validator.engine.resolver.DefaultTraversableResolver detectJPA
INFO: Instantiated an instance of org.hibernate.validator.engine.resolver.JPATraversableResolver.
Oct 16, 2013 7:48:10 AM oracle.security.jps.internal.idstore.util.LibOvdUtil pushLdapNamesToLibOvd
INFO: Pushed ldap name and types info to libOvd. Ldaps : u01apporacleproductfmwuser_projectsdomainsbase_domainconfigfmwconfigsystem-jazn-data.xmlidstore.xml.provideridstore.xml.
<Oct 16, 2013 7:48:16 AM UTC> <INFO> <Loaded NodeManager configuration properties from '/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.properties'>
Node manager v12.1.2

Configuration settings:

NodeManagerHome=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager
ListenAddress=linux01.us.oracle.com
ListenPort=5556
ListenBacklog=50
SecureListener=true
AuthenticationEnabled=true
NativeVersionEnabled=true
CrashRecoveryEnabled=false
JavaHome=/u01/app/oracle/product/jdk1.7.0_40
StartScriptEnabled=true
StopScriptEnabled=false
StartScriptName=startWebLogic.sh
StopScriptName=
CoherenceStartScriptEnabled=false
CoherenceStartScriptName=null
LogFile=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.log
LogLevel=INFO
LogLimit=0
LogCount=1
LogAppend=true
LogToStderr=true
LogFormatter=weblogic.nodemanager.server.LogFormatter
DomainsFile=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.domains
DomainsFileEnabled=true
StateCheckInterval=500
UseMACBroadcast=false
DomainRegistrationEnabled=false
DomainsDirRemoteSharingEnabled=false
RotatedFileCount=7
FileSizeKB=500
NumberOfFilesLimited=false
RotationTimeStart=00:00
RotationType=bySize
FileTimeSpan=24
FileTimeSpanFactor=3600000
ProcessDestroyTimeout=20000
Domain name mappings:

base_domain -> /u01/app/oracle/product/fmw/user_projects/domains/base_domain

<Oct 16, 2013 7:48:16 AM UTC> <INFO> <WebLogic Server 12.1.2.0.0  Fri Jun 7 15:16:15 PDT 2013 1530982 WLS_12.1.2.0.0_GENERIC_130607.1100>
<Oct 16, 2013 7:48:16 AM UTC> <INFO> <base_domain> <ManagedServer_2> <Startup configuration properties loaded from "/u01/app/oracle/product/fmw/user_projects/domains/base_domain/servers/ManagedServer_2/data/nodemanager/startup.properties">

<Oct 16, 2013 7:48:16 AM UTC> <INFO> <Secure socket listener started on port 5556, host linux01.us.oracle.com/10.11.12.21>

Oracle RAC 11gR2 Deinstallation Steps

Environment Details:
OS: Linux 5.8
User: oracle
Two Node RAC: linux01, linux02
Database Version: 11.2.0.3.0
Oracle Home: /u01/app/oracle/product/11.2.0/dbhome_1
Grid Home: /u01/app/11.2.0/grid

Steps to be followed to deinstall Oracle RAC
Step 1: Drop the database using the dbca
Step 2: Deinstall the oracle Home using deinstall from $ORACLE_HOME/deinstall
Step 3: Deinstall the Clusterware Software using the deinstall from $GRID_HOME/deinstall
Step 3.a: Run the command which are given at the end of the above Step 3. on all the node and then on the last node from the root


The log output of Step 2:
[oracle@linux01 /u01/app/oracle/product/11.2.0/dbhome_1/deinstall]$ ./deinstall
Checking for required files and bootstrapping ...
Please wait ...
Location of logs /u01/app/oraInventory/logs/

############ ORACLE DEINSTALL & DECONFIG TOOL START ############


######################### CHECK OPERATION START #########################
## [START] Install check configuration ##


Checking for existence of the Oracle home location /u01/app/oracle/product/11.2.0/dbhome_1
Oracle Home type selected for deinstall is: Oracle Real Application Cluster Database
Oracle Base selected for deinstall is: /u01/app/oracle
Checking for existence of central inventory location /u01/app/oraInventory
Checking for existence of the Oracle Grid Infrastructure home /u01/app/11.2.0/grid
The following nodes are part of this cluster: linux01,linux02
Checking for sufficient temp space availability on node(s) : 'linux01,linux02'

## [END] Install check configuration ##


Network Configuration check config START

Network de-configuration trace file location: /u01/app/oraInventory/logs/netdc_check2013-10-10_12-08-34-AM.log

Network Configuration check config END

Database Check Configuration START

Database de-configuration trace file location: /u01/app/oraInventory/logs/databasedc_check2013-10-10_12-08-37-AM.log

Use comma as separator when specifying list of values as input

Specify the list of database names that are configured in this Oracle home []: 
Database Check Configuration END

Enterprise Manager Configuration Assistant START

EMCA de-configuration trace file location: /u01/app/oraInventory/logs/emcadc_check2013-10-10_12-08-41-AM.log 

Enterprise Manager Configuration Assistant END
Oracle Configuration Manager check START
OCM check log file location : /u01/app/oraInventory/logs//ocm_check8922.log
Oracle Configuration Manager check END

######################### CHECK OPERATION END #########################


####################### CHECK OPERATION SUMMARY #######################
Oracle Grid Infrastructure Home is: /u01/app/11.2.0/grid
The cluster node(s) on which the Oracle home deinstallation will be performed are:linux01,linux02
Oracle Home selected for deinstall is: /u01/app/oracle/product/11.2.0/dbhome_1
Inventory Location where the Oracle home registered is: /u01/app/oraInventory
No Enterprise Manager configuration to be updated for any database(s)
No Enterprise Manager ASM targets to update
No Enterprise Manager listener targets to migrate
Checking the config status for CCR
linux01 : Oracle Home exists with CCR directory, but CCR is not configured
linux02 : Oracle Home exists with CCR directory, but CCR is not configured
CCR check is finished
Do you want to continue (y - yes, n - no)? [n]: y
A log of this session will be written to: '/u01/app/oraInventory/logs/deinstall_deconfig2013-10-10_12-08-25-AM.out'
Any error messages from this session will be written to: '/u01/app/oraInventory/logs/deinstall_deconfig2013-10-10_12-08-25-AM.err'

######################## CLEAN OPERATION START ########################

Enterprise Manager Configuration Assistant START

EMCA de-configuration trace file location: /u01/app/oraInventory/logs/emcadc_clean2013-10-10_12-08-41-AM.log 

Updating Enterprise Manager ASM targets (if any)
Updating Enterprise Manager listener targets (if any)
Enterprise Manager Configuration Assistant END
Database de-configuration trace file location: /u01/app/oraInventory/logs/databasedc_clean2013-10-10_12-09-21-AM.log

Network Configuration clean config START

Network de-configuration trace file location: /u01/app/oraInventory/logs/netdc_clean2013-10-10_12-09-21-AM.log

De-configuring Listener configuration file on all nodes...
Listener configuration file de-configured successfully.

De-configuring Naming Methods configuration file on all nodes...
Naming Methods configuration file de-configured successfully.

De-configuring Local Net Service Names configuration file on all nodes...
Local Net Service Names configuration file de-configured successfully.

De-configuring Directory Usage configuration file on all nodes...
Directory Usage configuration file de-configured successfully.

De-configuring backup files on all nodes...
Backup files de-configured successfully.

The network configuration has been cleaned up successfully.

Network Configuration clean config END

Oracle Configuration Manager clean START
OCM clean log file location : /u01/app/oraInventory/logs//ocm_clean8922.log
Oracle Configuration Manager clean END
Setting the force flag to false
Setting the force flag to cleanup the Oracle Base
Oracle Universal Installer clean START

Detach Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the local node : Done

Delete directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the local node : Done

The Oracle Base directory '/u01/app/oracle' will not be removed on local node. The directory is not empty.

Detach Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the remote nodes 'linux02' : Done

Delete directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the remote nodes 'linux02' : Done

The Oracle Base directory '/u01/app/oracle' will not be removed on node 'linux02'. The directory is not empty.

Oracle Universal Installer cleanup was successful.

Oracle Universal Installer clean END


## [START] Oracle install clean ##

Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_00-08-03AM' on node 'linux01'
Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_00-08-03AM' on node 'linux02'

## [END] Oracle install clean ##


######################### CLEAN OPERATION END #########################


####################### CLEAN OPERATION SUMMARY #######################
Cleaning the config for CCR
As CCR is not configured, so skipping the cleaning of CCR configuration
CCR clean is finished
Successfully detached Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the local node.
Successfully deleted directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the local node.
Successfully detached Oracle home '/u01/app/oracle/product/11.2.0/dbhome_1' from the central inventory on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/oracle/product/11.2.0/dbhome_1' on the remote nodes 'linux02'.
Oracle Universal Installer cleanup was successful.

Oracle deinstall tool successfully cleaned up temporary directories.
#######################################################################


############# ORACLE DEINSTALL & DECONFIG TOOL END #############


The log output of Step 3:
[oracle@linux01 /u01/app/11.2.0/grid/deinstall]$ ./deinstall
Checking for required files and bootstrapping ...
Please wait ...
Location of logs /tmp/deinstall2013-10-10_02-32-31AM/logs/

############ ORACLE DEINSTALL & DECONFIG TOOL START ############


######################### CHECK OPERATION START #########################
## [START] Install check configuration ##


Checking for existence of the Oracle home location /u01/app/11.2.0/grid
Oracle Home type selected for deinstall is: Oracle Grid Infrastructure for a Cluster
Oracle Base selected for deinstall is: /u01/app/grid
Checking for existence of central inventory location /u01/app/oraInventory
Checking for existence of the Oracle Grid Infrastructure home /u01/app/11.2.0/grid
The following nodes are part of this cluster: linux01,linux02
Checking for sufficient temp space availability on node(s) : 'linux01,linux02'

## [END] Install check configuration ##

Traces log file: /tmp/deinstall2013-10-10_02-32-31AM/logs//crsdc.log

Network Configuration check config START

Network de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/netdc_check2013-10-10_02-33-02-AM.log

Specify all RAC listeners (do not include SCAN listener) that are to be de-configured [LISTENER]:

Network Configuration check config END

Asm Check Configuration START

ASM de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_check2013-10-10_02-33-06-AM.log

Automatic Storage Management (ASM) instance is detected in this Oracle home /u01/app/11.2.0/grid.
ASM Diagnostic Destination : /u01/app/grid
ASM Diskgroups : +DATA
ASM diskstring : <Default>
Diskgroups will be dropped
De-configuring ASM will drop all the diskgroups and it's contents at cleanup time. This will affect all of the databases and ACFS that use this ASM instance(s).
 If you want to retain the existing diskgroups or if any of the information detected is incorrect, you can modify by entering 'y'. Do you  want to modify above information (y|n) [n]: y
Specify the ASM Diagnostic Destination [/u01/app/grid]: 
Specify the diskstring []: 
Specify the diskgroups that are managed by this ASM instance [+DATA]: 

De-configuring ASM will drop the diskgroups at cleanup time. Do you want deconfig tool to drop the diskgroups y|n [y]: y


######################### CHECK OPERATION END #########################


####################### CHECK OPERATION SUMMARY #######################
Oracle Grid Infrastructure Home is: /u01/app/11.2.0/grid
The cluster node(s) on which the Oracle home deinstallation will be performed are:linux01,linux02
Oracle Home selected for deinstall is: /u01/app/11.2.0/grid
Inventory Location where the Oracle home registered is: /u01/app/oraInventory
Following RAC listener(s) will be de-configured: LISTENER
ASM instance will be de-configured from this Oracle home
Do you want to continue (y - yes, n - no)? [n]: y
A log of this session will be written to: '/tmp/deinstall2013-10-10_02-32-31AM/logs/deinstall_deconfig2013-10-10_02-32-50-AM.out'
Any error messages from this session will be written to: '/tmp/deinstall2013-10-10_02-32-31AM/logs/deinstall_deconfig2013-10-10_02-32-50-AM.err'

######################## CLEAN OPERATION START ########################
ASM de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_clean2013-10-10_02-34-13-AM.log
ASM Clean Configuration START
ASM Clean Configuration END

Network Configuration clean config START

Network de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/netdc_clean2013-10-10_02-35-55-AM.log

De-configuring RAC listener(s): LISTENER

De-configuring listener: LISTENER
    Stopping listener: LISTENER
    Listener stopped successfully.
    Unregistering listener: LISTENER
    Listener unregistered successfully.
Listener de-configured successfully.

De-configuring Naming Methods configuration file on all nodes...
Naming Methods configuration file de-configured successfully.

De-configuring Local Net Service Names configuration file on all nodes...
Local Net Service Names configuration file de-configured successfully.

De-configuring Directory Usage configuration file on all nodes...
Directory Usage configuration file de-configured successfully.

De-configuring backup files on all nodes...
Backup files de-configured successfully.

The network configuration has been cleaned up successfully.

Network Configuration clean config END


---------------------------------------->

The deconfig command below can be executed in parallel on all the remote nodes. Execute the command on  the local node after the execution completes on all the remote nodes.

Run the following command as the root user or the administrator on node "linux02".

/tmp/deinstall2013-10-10_02-32-31AM/perl/bin/perl -I/tmp/deinstall2013-10-10_02-32-31AM/perl/lib -I/tmp/deinstall2013-10-10_02-32-31AM/crs/install /tmp/deinstall2013-10-10_02-32-31AM/crs/install/rootcrs.pl -force  -deconfig -paramfile "/tmp/deinstall2013-10-10_02-32-31AM/response/deinstall_Ora11g_gridinfrahome1.rsp"

Run the following command as the root user or the administrator on node "linux01".

/tmp/deinstall2013-10-10_02-32-31AM/perl/bin/perl -I/tmp/deinstall2013-10-10_02-32-31AM/perl/lib -I/tmp/deinstall2013-10-10_02-32-31AM/crs/install /tmp/deinstall2013-10-10_02-32-31AM/crs/install/rootcrs.pl -force  -deconfig -paramfile "/tmp/deinstall2013-10-10_02-32-31AM/response/deinstall_Ora11g_gridinfrahome1.rsp" -lastnode

Press Enter after you finish running the above commands

<----------------------------------------

Setting the force flag to false
Setting the force flag to cleanup the Oracle Base
Oracle Universal Installer clean START

Detach Oracle home '/u01/app/11.2.0/grid' from the central inventory on the local node : Done

Delete directory '/u01/app/11.2.0/grid' on the local node : Done

Delete directory '/u01/app/oraInventory' on the local node : Done

Delete directory '/u01/app/grid' on the local node : Done

Detach Oracle home '/u01/app/11.2.0/grid' from the central inventory on the remote nodes 'linux02' : Done

Delete directory '/u01/app/11.2.0/grid' on the remote nodes 'linux02' : Done

Delete directory '/u01/app/oraInventory' on the remote nodes 'linux02' : Done

Delete directory '/u01/app/grid' on the remote nodes 'linux02' : Done

Oracle Universal Installer cleanup was successful.

Oracle Universal Installer clean END


## [START] Oracle install clean ##

Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_02-32-31AM' on node 'linux01'
Clean install operation removing temporary directory '/tmp/deinstall2013-10-10_02-32-31AM' on node 'linux02'

## [END] Oracle install clean ##


######################### CLEAN OPERATION END #########################


####################### CLEAN OPERATION SUMMARY #######################
ASM instance was de-configured successfully from the Oracle home
Following RAC listener(s) were de-configured successfully: LISTENER
Oracle Clusterware is stopped and successfully de-configured on node "linux01"
Oracle Clusterware is stopped and successfully de-configured on node "linux02"
Oracle Clusterware is stopped and de-configured successfully.
Successfully detached Oracle home '/u01/app/11.2.0/grid' from the central inventory on the local node.
Successfully deleted directory '/u01/app/11.2.0/grid' on the local node.
Successfully deleted directory '/u01/app/oraInventory' on the local node.
Successfully deleted directory '/u01/app/grid' on the local node.
Successfully detached Oracle home '/u01/app/11.2.0/grid' from the central inventory on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/11.2.0/grid' on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/oraInventory' on the remote nodes 'linux02'.
Successfully deleted directory '/u01/app/grid' on the remote nodes 'linux02'.
Oracle Universal Installer cleanup was successful.


Run 'rm -rf /etc/oraInst.loc' as root on node(s) 'linux01,linux02' at the end of the session.

Run 'rm -rf /opt/ORCLfmap' as root on node(s) 'linux01,linux02' at the end of the session.
Oracle deinstall tool successfully cleaned up temporary directories.
#######################################################################


############# ORACLE DEINSTALL & DECONFIG TOOL END #############

The log output of Step 3.a for the last node:

[root@linux01 ~]# /tmp/deinstall2013-10-10_02-32-31AM/perl/bin/perl -I/tmp/deinstall2013-10-10_02-32-31AM/perl/lib -I/tmp/deinstall2013-10-10_02-32-31AM/crs/install /tmp/deinstall2013-10-10_02-32-31AM/crs/install/rootcrs.pl -force  -deconfig -paramfile "/tmp/deinstall2013-10-10_02-32-31AM/response/deinstall_Ora11g_gridinfrahome1.rsp" -lastnode
Using configuration parameter file: /tmp/deinstall2013-10-10_02-32-31AM/response /deinstall_Ora11g_gridinfrahome1.rsp
Network exists: 1/10.11.32.0/255.255.248.0/eth0, type static
VIP exists: /linux02-v/10.11.37.64/10.11.32.0/255.255.248.0/eth0, hosting node linux02
VIP exists: /linux01-v/10.11.37.66/10.11.32.0/255.255.248.0/eth0, hosting node linux01
GSD exists
ONS exists: Local port 6100, remote port 6200, EM port 2016
CRS-2673: Attempting to stop 'ora.crsd' on 'linux01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'linux01'
CRS-2673: Attempting to stop 'ora.oc4j' on 'linux01'
CRS-2673: Attempting to stop 'ora.asm' on 'linux01'
CRS-2677: Stop of 'ora.asm' on 'linux01' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'linux01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'linux01' has completed
CRS-2677: Stop of 'ora.crsd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'linux01'
CRS-2673: Attempting to stop 'ora.evmd' on 'linux01'
CRS-2673: Attempting to stop 'ora.asm' on 'linux01'
CRS-2677: Stop of 'ora.evmd' on 'linux01' succeeded
CRS-2677: Stop of 'ora.asm' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'linux01'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'linux01' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'linux01'
CRS-2677: Stop of 'ora.cssd' on 'linux01' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'linux01'
CRS-2676: Start of 'ora.cssdmonitor' on 'linux01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'linux01'
CRS-2672: Attempting to start 'ora.diskmon' on 'linux01'
CRS-2676: Start of 'ora.diskmon' on 'linux01' succeeded
CRS-2676: Start of 'ora.cssd' on 'linux01' succeeded
CRS-4611: Successful deletion of voting disk +DATA.
ASM de-configuration trace file location: /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_clean2013-10-10_02-41-58-AM.log
ASM Clean Configuration START
ASM Clean Configuration END

ASM with SID +ASM1 deleted successfully. Check /tmp/deinstall2013-10-10_02-32-31AM/logs/asmcadc_clean2013-10-10_02-41-58-AM.log for details.

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'linux01'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'linux01'
CRS-2673: Attempting to stop 'ora.crf' on 'linux01'
CRS-2673: Attempting to stop 'ora.ctssd' on 'linux01'
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'linux01'
CRS-2677: Stop of 'ora.mdnsd' on 'linux01' succeeded
CRS-2677: Stop of 'ora.crf' on 'linux01' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'linux01' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'linux01'
CRS-2677: Stop of 'ora.cssd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'linux01'
CRS-2677: Stop of 'ora.gipcd' on 'linux01' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'linux01'
CRS-2677: Stop of 'ora.gpnpd' on 'linux01' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'linux01' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully deconfigured Oracle clusterware stack on this node