Weblogic 12.1.2 | Node Manager Startup Issues

Environment Details:
OS: Linux Server 5.8 64bit
Version: Weblogic Server 12.1.2
Installation location: /u01/app/oracle/product/fmw

Issue: Node Manager was throwing error when we invoked the script startNodeManager.sh script from $WLS_HOME/server/bin

[oraem@linux01 bin]$ pwd
[oraem@linux01 bin]$ /u01/app/oracle/product/fmw/wlserver/server/bin
[oraem@linux01 bin]$ ./startNodeManager.sh 
+ CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..
+ '[' '!' -z '' ']'
+ '[' '!' -z '' ']'
+ export CLASSPATH
+ export PATH
+ cd /u01/app/oracle/product/fmw/wlserver/../oracle_common/common/nodemanager
+ set -x
+ '[' '' '!=' '' ']'
+ '[' '' '!=' '' ']'
+ /u01/app/oracle/product/jdk1.7.0_40/bin/java -client -Xms32m -Xmx200m -XX:MaxPermSize=128m -Dcoherence.home=/u01/app/oracle/product/fmw/wlserver/../coherence -Dbea.home=/u01/app/oracle/product/fmw/wlserver/.. -Xverify:none -Djava.endorsed.dirs=/u01/app/oracle/product/jdk1.7.0_40/jre/lib/endorsed:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/endorsed -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/u01/app/oracle/product/jdk1.7.0_40 weblogic.NodeManager -v
<Oct 16, 2013 4:29:07 AM GMT> <INFO> <Loading domains file: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/nodemanager.domains>
<Oct 16, 2013 4:29:07 AM GMT> <WARNING> <Domains file not found: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/nodemanager.domains>
<Oct 16, 2013 4:29:08 AM GMT> <INFO> <Loading identity key store: FileName=/u01/app/oracle/product/fmw/oracle_common/common/nodemanager/security/DemoIdentity.jks, Type=jks, PassPhraseUsed=true>
<Oct 16, 2013 4:29:08 AM GMT> <SEVERE> <Fatal error in NodeManager server>
weblogic.nodemanager.common.ConfigException: Identity key store file not found: /u01/app/oracle/product/fmw/oracle_common/common/nodemanager/security/DemoIdentity.jks
        at weblogic.nodemanager.server.SSLConfig.loadKeyStoreConfig(SSLConfig.java:170)
        at weblogic.nodemanager.server.SSLConfig.access$000(SSLConfig.java:32)
        at weblogic.nodemanager.server.SSLConfig$1.run(SSLConfig.java:111)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.nodemanager.server.SSLConfig.<init>(SSLConfig.java:108)
        at weblogic.nodemanager.server.NMServer.<init>(NMServer.java:121)
        at weblogic.nodemanager.server.NMServer.main(NMServer.java:383)
        at weblogic.NodeManager.main(NodeManager.java:31)

+ set +x


Solution: In Weblogic 12.1.2, we have to start the node manager from DOMAIN_HOME/bin using the startNodeManager.sh script

[oraem@linux01 bin]$ pwd
[oraem@linux01 bin]$ /u01/app/oracle/product/fmw/user_projects/domains/base_domain/bin
[oraem@linux01 bin]$ ./startNodeManager.sh CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..
+ '[' '!' -z '' ']'
+ '[' '!' -z /u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/oracle.jps_12.1.2/jps-manifest.jar ']'
+ CLASSPATH=/u01/app/oracle/product/jdk1.7.0_40/lib/tools.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic_sp.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.jar:/u01/app/oracle/product/fmw/wlserver/server/lib/webservices.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/app/oracle/product/fmw/wlserver/modules/features/oracle.wls.common.nodemanager_1.0.0.0.jar::/u01/app/oracle/product/fmw/wlserver/..:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/oracle.jps_12.1.2/jps-manifest.jar
+ export CLASSPATH
+ export PATH
+ cd /u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager
+ set -x
+ '[' '' '!=' '' ']'
+ '[' '' '!=' '' ']'
+ /u01/app/oracle/product/jdk1.7.0_40/bin/java -client -Xms32m -Xmx200m -XX:MaxPermSize=128m -Dcoherence.home=/u01/app/oracle/product/fmw/wlserver/../coherence -Dbea.home=/u01/app/oracle/product/fmw/wlserver/.. -Doracle.security.jps.config=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/config/fmwconfig/jps-config-jse.xml -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dcommon.components.home=/u01/app/oracle/product/fmw/oracle_common -Dopss.version=12.1.2 -Dweblogic.RootDirectory=/u01/app/oracle/product/fmw/user_projects/domains/base_domain -Xverify:none -Djava.endorsed.dirs=/u01/app/oracle/product/jdk1.7.0_40/jre/lib/endorsed:/u01/app/oracle/product/fmw/wlserver/../oracle_common/modules/endorsed -Djava.security.policy=/u01/app/oracle/product/fmw/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/u01/app/oracle/product/jdk1.7.0_40 weblogic.NodeManager -v
<Oct 16, 2013 7:48:02 AM UTC> <INFO> <Loading domains file: /u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.domains>
<Oct 16, 2013 7:48:03 AM UTC> <INFO> <Loading identity key store: FileName=kss://system/demoidentity, Type=kss, PassPhraseUsed=true>
Oct 16, 2013 7:48:05 AM org.hibernate.validator.util.Version <clinit>
INFO: Hibernate Validator 12.1.2.0.0
Oct 16, 2013 7:48:05 AM org.hibernate.validator.engine.resolver.DefaultTraversableResolver detectJPA
INFO: Instantiated an instance of org.hibernate.validator.engine.resolver.JPATraversableResolver.
Oct 16, 2013 7:48:10 AM oracle.security.jps.internal.idstore.util.LibOvdUtil pushLdapNamesToLibOvd
INFO: Pushed ldap name and types info to libOvd. Ldaps : u01apporacleproductfmwuser_projectsdomainsbase_domainconfigfmwconfigsystem-jazn-data.xmlidstore.xml.provideridstore.xml.
<Oct 16, 2013 7:48:16 AM UTC> <INFO> <Loaded NodeManager configuration properties from '/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.properties'>
Node manager v12.1.2

Configuration settings:

NodeManagerHome=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager
ListenAddress=linux01.us.oracle.com
ListenPort=5556
ListenBacklog=50
SecureListener=true
AuthenticationEnabled=true
NativeVersionEnabled=true
CrashRecoveryEnabled=false
JavaHome=/u01/app/oracle/product/jdk1.7.0_40
StartScriptEnabled=true
StopScriptEnabled=false
StartScriptName=startWebLogic.sh
StopScriptName=
CoherenceStartScriptEnabled=false
CoherenceStartScriptName=null
LogFile=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.log
LogLevel=INFO
LogLimit=0
LogCount=1
LogAppend=true
LogToStderr=true
LogFormatter=weblogic.nodemanager.server.LogFormatter
DomainsFile=/u01/app/oracle/product/fmw/user_projects/domains/base_domain/nodemanager/nodemanager.domains
DomainsFileEnabled=true
StateCheckInterval=500
UseMACBroadcast=false
DomainRegistrationEnabled=false
DomainsDirRemoteSharingEnabled=false
RotatedFileCount=7
FileSizeKB=500
NumberOfFilesLimited=false
RotationTimeStart=00:00
RotationType=bySize
FileTimeSpan=24
FileTimeSpanFactor=3600000
ProcessDestroyTimeout=20000
Domain name mappings:

base_domain -> /u01/app/oracle/product/fmw/user_projects/domains/base_domain

<Oct 16, 2013 7:48:16 AM UTC> <INFO> <WebLogic Server 12.1.2.0.0  Fri Jun 7 15:16:15 PDT 2013 1530982 WLS_12.1.2.0.0_GENERIC_130607.1100>
<Oct 16, 2013 7:48:16 AM UTC> <INFO> <base_domain> <ManagedServer_2> <Startup configuration properties loaded from "/u01/app/oracle/product/fmw/user_projects/domains/base_domain/servers/ManagedServer_2/data/nodemanager/startup.properties">

<Oct 16, 2013 7:48:16 AM UTC> <INFO> <Secure socket listener started on port 5556, host linux01.us.oracle.com/10.11.12.21>

Weblogic Installation

Simple Weblogic Installation

Environment Details:
OS: Linux Server 5.8 64bit
Version: Weblogic Server 10.3.6
Installation location: /u01/app/oracle/product/fmw
User: oraem(We can have any user)

Steps to be executed as oraem user:

Step 1: First install 64 bit java of the desired version, here in our installation we are using Java 6u32 64 bit

execute the command ./jdk-6u32-linux-x64.bin, it will install the java in the particular directory 

Step 2: Invoke the command java -jar -d64 wls1036_generic.jar (here -d64 option installs 64bit version of weblogic)

Step 3: Click Next on the "Welcome Screen"

Step 4: Give the complete location where we are going to install the weblogic server and click Next

Step 5: In these screen the installer asks for the Oracle Support username password, which can be skipped by un checking the box and confirming to remained uninformed of critical issues by clicking Yes. Then click Next

Step 6: Click Custom and click Next

Step 7: This screen shows what all components we are going to install. Click Next

Step 8: Select the Java Home which we installed and uncheck the other java which was mentioned, and click Next

Step 9: Choose the Product Installation Directory, we can keep them as default and click Next

Step 10: Review the Installation Summary and click Next

Step 11: Installation Progress Screen

Step 12: The installation is over, uncheck the Run Quickstart box and click Done.

Note: After the installation is over the base domain can be created by invoking the config.sh script from location /u01/app/oracle/product/fmw/wlserver_10.3/common/bin.

Installation Issues/Error:

1. Sometime if there is a space issue on the server we may get the below mentioned error 

Fatal error encountered during self-extraction.[No space left on device]

To Resolve this we need to find a mount point where there is space available and then use the -Djava.io.tmpdiroption while doing the installation

[oraem@Linux1 stage]$ java -d64 -Djava.io.tmpdir=/u03/stage/temp -jar wls1036_generic.jar

2. In windows machine the -d64 option doesn't work and we may get the error: Could not create the Java virtual machine.

Simply invoke the installer by omitting that option(-d64)