Error while bringing up the server after changing the repository schema password in 12c 

Hello Viewer,

In my case business requires the Metadata Repository schema passwords to be changed on a regular basis.
I changed the password for all the repository schema but after changing the password as soon as i started the managed and Admin server , it was failing to restart.

Below was the error in logs:

Error Code: 28000 Mar 20, 2016 2:48:19 AM oracle.security.jps.internal.common.config.AbstractSecurityStore getSecurityStoreVersion WARNING: Unable to get the Version from Store returning the default oracle.security.jps.service.policystore.PolicyStoreException: javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException Internal Exception: java.sql.SQLException: ORA-28000: the account is locked

After checking with the database team MFT_OPSS account was getting locked.
Although I checked that except datasource we are not using the MFT_OPSS user anywhere else. But still again and again it was getting locked. From SQL developer also we were able to connect successfully and the same password was updated in datasource as well.

Cause:

A 12c Infrastructure uses a Java Platform Security (JPS) credential store. If the credentials in the JPS store do not match with OPSS schema credentials in the Metadata Repository, AdminServer and Managed server will fail to start.

Note: Above error applies to Oracle Fusion Middleware - Version 12.1.2.0.0 and later

Solution:

It was resolved after following the below steps:

1) I asked the database team to unlock the account and change the password for this user,

2)  Encrypted the password using below steps and updated the opss-datasource-jdbc.xml
         a) cd $DOMAIN_HOME/bin
             . ./setDomainEnv.sh

         b) java weblogic.security.Encrypt newpassword

3) $ORACLE_HOME/oracle_common/common/bin/wlst.sh

wls:/offline>modifyBootStrapCredential(jpsConfigFile='$DOMAIN_HOME/config/fmwconfig/jps-config.xml',username='MFT_OPSS',password='newpassword')

4) Try to bring up the Admin server and Managed server. Hopefully it will start without any error this time.

Thanks a lot for your patience!!!

Regards
-Ashish

[12.2.1.0.0]Health status showing as blank for JMS servers in clustered environment

Hello to viewer,
After creating the weblogic 12c[12.2.1.0.0] environment , we encountered an issue where active destinations were not showing under jmsserver monitoring tab.

When viewing the Summary of JMS Servers in Weblogic Console the Health status was showing as blank for managed servers even though the managed servers were running and health was OK on summary of servers page.

After going through the oracle notes, we came to know that the issue is actually a bug in new weblogic upgraded version(12.2.1.0.0) which is not there in earlier versions.

As a solution oracle has provided a Patch 21830665 for weblogic version 12.2.1.0.0

This bug has been fixed in next version : 12.2.2.0.0

Note: Issue exist only for clustered environment and not for stand alone server.

Thanks for you patience!!

Thanks and Regards

Ashish Kumar Gupta

 

Script to target/untarget multiple datasource to/from the   cluster

Hello to Viewers,
This script will help in performing the target and untarget operation on multiple datasource in one go. You don't need to go to the console and do the same task manually which is of-course time taking and error prone.

FLOW:

shell script ---> python --> wlst command.

Here shell script will call python script and in python we have mentioned few relevant wlst command that perform the actual task.

Follow the below steps:

1) Create a shell script under below directory: QueueOperation.sh

I have taken the directory structure as below:

/opt/soauser/automation/SOADataSourceOperation/


DataSourceOperation.sh

----------------------------------------------------------------------------------------------

#!/bin/sh

export LOGFILE="/opt/soauser/automation/SOADataSourceOperation/DataSource.log"

if [ -f $LOGFILE ]; then

  rm -f $LOGFILE

fi

rm -rf /opt/soauser/automation/SOADataSourceOperation/DataSource.log

WL_HOME="/xxxxxx/xxxx/xxx/wlserver_10.3"

export WL_HOME

echo "Please enter target to Target and untarget to Untarget the Datasources:"

read PARAMETER1

cd /opt/soauser/automation/SOADataSourceOperation/

sh ${WL_HOME}/common/bin/wlst.sh /opt/soauser/automation/SOADataSourceOperation/DataSourceOperation.py $PARAMETER1 $1 >> /opt/soauser/automation/SOADataSourceOperation/DataSource.log

exit

------------------------------------------------------------------------------------------------

2) Create a text file in same directory that contains the datasource name:

Suppose you need to untarget the datasource related to SAP then name it as SAPdsList.txt(targetdsList.txt)

here target could be SAP or any end system to which datasources are related.

SAPdsList.txt

-----------------------------------------------------------------------------------------------------

DSNAME1
DSNAME2

------------------------------------------------------------------------------------------------------

3) Create a python file under the same directory: DataSourceOperation.py

Here i am assuming that 

datasources are targeted to only weblogic cluster.

DataSourceOperation.py

------------------------------------------------------------------------------------------------------

from java.io import FileInputStream

import java.lang

import os

import string

import sys , traceback

operation=sys.argv[1]

target=sys.argv[2]

def connectToServer():

        USERNAME = 'username'

        PASSWORD = 'password'

        URL='t3://AdminServerhost:AdminServerport'

        #Connect to the AdminServer

        print 'starting the script ....'

        connect(USERNAME,PASSWORD,URL)

def disconnectFromServer():

    print "Disconnecting from the Admin Server"

    disconnect()

    print "Exiting from the Admin Server"

    exit()

    print "Mission Accomplished"

def Target(DSName):

     try:

        print 'Entry point1...'

        edit()

        tgName = 'CLUSTER_NAME'

        startEdit()

        DSName = DSName.strip()

        print 'test0'

        cd ('/JDBCSystemResources/'+ DSName)

        print 'test1'

        set('Targets',jarray.array([ObjectName('com.bea:Name='+tgName+',Type=Cluster')], ObjectName))

        activate()

        print 'DataSource: "', DSName ,'" has been TARGETED TO CLUSTER Successfully'

     except :

        print 'Something went wrong...'

        exit()

def Untarget(DSName):

     try:

        print 'Entry point1...'

        edit()

        tgName = 'CLUSTER_NAME'

        startEdit()

        DSName = DSName.strip()

        print 'test0'

        cd ('/JDBCSystemResources/'+ DSName)

        print 'test1'

        set('Targets',jarray.array([], ObjectName))

        activate()

        print 'DataSource: "', DSName ,'" has been UNTARGETED FROM CLUSTER Successfully'

     except :

        print 'Something went wrong...'

        exit()

###############     Main Script   #####################################

#Conditionally import wlstModule only when script is executed with jython

if __name__ == '__main__':

    from wlstModule import *#@UnusedWildImport

print('This will enable you to perform operation on  datasource')

listName = target+'dsList.txt'

if operation=='target':

   f = open(listName,'r')

   out = f.readlines()

   for DSName in out:

     DSName.strip()

     print 'Trying to target  '+DSName

     connectToServer()

     Target(DSName)

     disconnect()

     print 'Target the '+DSName

else:

   f = open(listName,'r')

   out = f.readlines()

   for DSName in out:

     DSName.strip()

     print 'Trying to untarget '+DSName

     connectToServer()

     Untarget(DSName)

     disconnect()

     print 'Untargeted the '+DSName

disconnectFromServer()

-------------------------------------------------------------------------------------------------------

HOW TO RUN:

Simply run the shell script and provide the target system name as a parameter for ex:

cd /opt/soauser/automation/SOADataSourceOperation/

sh DataSourceOperation.sh SAP 

(here SAP is the target so python file will look for SAPdsList.txt)

then it will ask for the operation to be performed : Please enter target to Target and untarget to Untarget the Datasources

type the operation name and press "enter" and then verify the log file(DataSource.log) and queue status from console.

Thanks a lot for your patience !!!! 

Regards
-Ashish 

Script to Pause/Resume the multiple distributed queues at a time

Hello to Viewers,
This script will help in performing the pause and resume operation on multiple distributed queues in one go. You don't need to go to the console and do the same task manually which is of-course time
taking and error prone.

FLOW:

shell script ---> python --> wlst command.

Here shell script will call python script and in python we have mentioned few relevant wlst command that perform the actual task.

Follow the below steps:

1) Create a shell script under below directory: QueueOperation.sh

I have taken the directory structure as below:

/opt/soauser/automation/SOAQueueOperation/


QueueOperation.sh
---------------------------------------------------------------------------------------------------------------

#!/bin/sh

export LOGFILE="/opt/soauser/automation/SOAQueueOperation/Q_Pause_Resume.log"
if [ -f $LOGFILE ]; then
  rm -f $LOGFILE
fi
rm -rf /opt/soauser/automation/SOAQueueOperation/Q_Pause_Resume.log
WL_HOME="/xxxxxx/xxxx/xxx/wlserver_10.3"
export WL_HOME
echo "Please enter pause to PAUSE the queues or resume to RESUME the queues:"
read PARAMETER1
cd /opt/soauser/automation/SOAQueueOperation/
sh ${WL_HOME}/common/bin/wlst.sh /opt/soauser/automation/SOAQueueOperation/QueueOperation.py $PARAMETER1 $1 >> /opt/soauser/automation/SOAQueueOperation/Q_Pause_Resume.log
exit

--------------------------------------------------------------------------------------------------------------

2) Create a text file in same directory that contains the queue name:

Suppose you need to pause the queues related to SAP then name it as SAPQueueList.txt(targetQueueList.txt)

here target could be SAP or any end system to which queues are related.

SAPQueueList.txt

----------------------------------------------------------------------------------------------------------

QueueName1

QueueName2

----------------------------------------------------------------------------------------------------------

3) Create a python file under the same directory: QueueOperation.py

Here i am assuming that 

I  have 2 JMS servers : JMSSERVER1 and JMSSERVER2

My Managed servers name is MS1 and MS2

JMS module: JMSMODULE

QueueOperation.py

----------------------------------------------------------------------------------------------------------

from java.io import FileInputStream

import java.lang

import os

import string

import sys , traceback

operation=sys.argv[1]

target=sys.argv[2]

def connectToServerJMS1():

        USERNAME = 'username'

        PASSWORD = 'password'

        URL='t3://managedserver1host:managedserver1port'

        #Connect to the ManagedServer1

        print 'starting the script ....'

        connect(USERNAME,PASSWORD,URL)

def connectToServerJMS2():

        USERNAME = 'username'

        PASSWORD = 'password'

        URL='t3://managedserver2host:managedserver2port'

        #Connect to the ManagedServer2

        print 'starting the script ....'

        connect(USERNAME,PASSWORD,URL)

def disconnectFromServer():

    print "Disconnecting from the ManagedServer"

    disconnect()

    print "Exiting from the Managed Server"

    exit()

    print "Mission Accomplished"

def pauseQueueConsumptionJMS1(queueName):

     try:

        print 'Entry point1...'

        serverRuntime()

#       queueName = str(queueName.strip())

        queueName = queueName.strip()

        print 'test0'

        cd('/JMSRuntime/MS1.jms/JMSServers/JMSSERVER1/Destinations/JMSMODULE!JMSSERVER1@'+ queueName)

        print 'test1' 

        cmo.pauseConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION Paused ON JMS1 Successfully'

     except :

        print 'Something went wrong...'

        exit()

def pauseQueueConsumptionJMS2(queueName):

     try:

        print 'Entry point2...'

        serverRuntime()

        queueName = queueName.strip()

        print 'test2'

        cd('/JMSRuntime/MS2.jms/JMSServers/JMSSERVER2/Destinations/JMSMODULE!JMSSERVER2@'+ queueName)

        print 'test3'

        cmo.pauseConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION Paused ON JMS2 Successfully'

     except :

        print 'Something went wrong...'

        exit()

def resumeQueueConsumptionJMS1(queueName):

    try:

        print 'Entry point...'

        serverRuntime()

        queueName = queueName.strip()

        cd('JMSRuntime/MS1.jms/JMSServers/JMSSERVER1/Destinations/JMSMODULE!JMSSERVER1@'+ queueName)

        cmo.resumeConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION resumed Successfully'

    except :

        print 'Something went wrong...'

        exit()

def resumeQueueConsumptionJMS2(queueName):

    try:

        print 'Entry point...'

        serverRuntime()

        queueName = queueName.strip()

        cd('JMSRuntime/MS2.jms/JMSServers/JMSSERVER2/Destinations/JMSMODULE!JMSSERVER2@'+ queueName)

        cmo.resumeConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION resumed Successfully'

    except :

        print 'Something went wrong...'

        exit()

###############     Main Script   #####################################

#Conditionally import wlstModule only when script is executed with jython

if __name__ == '__main__':

    from wlstModule import *#@UnusedWildImport

print('This will enable you to perform operation on  distributed JMS Queues')

#connectToServer()

listName = target+'QueueList.txt'

if operation=='pause':

   f = open(listName,'r')

   out = f.readlines()

   for queueName in out:

     queueName.strip()

     print 'Trying Consumption Pause on '+queueName      

     connectToServerJMS1()

     pauseQueueConsumptionJMS1(queueName)

     disconnect()

     connectToServerJMS2()

     pauseQueueConsumptionJMS2(queueName)

     disconnect()

     print 'Consumption Paused on '+queueName

else:

   f = open(listName,'r')

   out = f.readlines()

   for queueName in out:

     queueName.strip()

     print 'Trying Consumption Resume on '+queueName

     connectToServerJMS1()

     resumeQueueConsumptionJMS1(queueName)

     disconnect()

     connectToServerJMS2()

     resumeQueueConsumptionJMS2(queueName)

     print 'Consumption Resumed on'+queueName

#exit()

disconnectFromServer()

#################################### 

---------------------------------------------------------------------------------------------------------

HOW TO RUN:

Simply run the shell script and provide the target system name as a parameter for ex:

cd /opt/soauser/automation/SOAQueueOperation/

sh QueueOperation.sh SAP 

(here SAP is the target so python file will look for SAPQueueList.txt)

then it will ask for the operation to be performed : Please enter pause to PAUSE the queues or resume to RESUME the queues

type the operation name and press "enter" and then verify the log file(Q_Pause_Resume.log) and queue status from console.

Thanks a lot for your patience !!!! 

Regards
-Ashish 

Script to List All the OSB projects, Business Services and Proxy Services deployed in sbconsole

Script to List All the OSB projects, Business Services and Proxy Services deployed in sbconsole.

Hello to viewer,

This script will provide you the list of all the OSB projects , business services and proxy services deployed in sbconsole in a .txt file.

Benefits: This is helpful for techies supporting non prod environment where lots of dummy projects are created by developers just for testing purpose. This script can help in performing the cleanup activity.It will provide the list of projects , BS and proxy services and later unused services and projects can be identified and deleted.

Here is the Flow :

Shell calls the python ---> python executes the wlst command.

Follow the below steps:

Step 1) : Create the directory structure as below:

cd /shared/fmw/build/script/List/


Step 2) : Under your current directory "List" create osbservices.py file with content below:

import sys
import os
import socket

connect('username', 'password', 't3://host:AdminPort')

from com.bea.wli.sb.management.configuration import ALSBConfigurationMBean
from com.bea.wli.config import Ref
from java.lang import String
from com.bea.wli.sb.util import Refs
from com.bea.wli.sb.management.configuration import CommonServiceConfigurationMBean
from com.bea.wli.sb.management.configuration import SessionManagementMBean
from com.bea.wli.sb.management.configuration import ProxyServiceConfigurationMBean
from com.bea.wli.monitoring import StatisticType
from com.bea.wli.monitoring import ServiceDomainMBean
from com.bea.wli.monitoring import ServiceResourceStatistic
from com.bea.wli.monitoring import StatisticValue
from com.bea.wli.monitoring import ServiceDomainMBean
from com.bea.wli.monitoring import ServiceResourceStatistic
from com.bea.wli.monitoring import StatisticValue
from com.bea.wli.monitoring import ResourceType

domainRuntime()

alsbCore = findService(ALSBConfigurationMBean.NAME, ALSBConfigurationMBean.TYPE)
refs = alsbCore.getRefs(Ref.DOMAIN)
it = refs.iterator()
print "List of Project in OSB"
while it.hasNext():
    r = it.next()
    if r.getTypeId() == Ref.PROJECT_REF:      
        print "Project Name : " + (r.getProjectName())

allRefs= alsbCore.getRefs(Ref.DOMAIN)
print "List of Proxy Service"
for ref in allRefs:  
  typeId = ref.getTypeId()
  if typeId == "ProxyService":    
     print "Proxy Service: " + ref.getFullName()
allRefs= alsbCore.getRefs(Ref.DOMAIN)
print "List of Business Service"
for ref in allRefs:
  typeId = ref.getTypeId()
  if typeId == "BusinessService":         
     print "Business Service: " + ref.getFullName()
disconnect()
exit()

Step 3)  : Under your current directory "List" create "osbservices.sh" with the content below :

#!/bin/sh
# set up WL_HOME and OSBHOME the root directory of your WebLogic installation
WL_HOME="WL_HOME Directory"
OSBHOME="OSB_HOME Directory"
rm output.txt
umask 027

# set up common environment
WLS_NOT_BRIEF_ENV=true
. "${WL_HOME}/server/bin/setWLSEnv.sh"


CLASSPATH="${CLASSPATH}${CLASSPATHSEP}${FMWLAUNCH_CLASSPATH}${CLASSPATHSEP}${DERBY_CLASSPATH}${CLASSPATHSEP}${DERBY_TOOLS}${CLASSPATHSEP}${POINTBASE_CLASSPATH}${CLASSPATHSEP}${POINTBASE_TOOLS}"

CLASSPATH=$CLASSPATH:$OSBHOME/modules/com.bea.common.configfwk_1.6.0.0.jar:$OSBHOME/lib/sb-kernel-api.jar:$OSBHOME/lib/sb-kernel-impl.jar:$WL_HOME/server/lib/weblogic.jar:$OSBHOME/lib/alsb.jar;
export CLASSPATH

if [ "${WLST_HOME}" != "" ] ; then
        WLST_PROPERTIES="-Dweblogic.wlstHome='${WLST_HOME}'${WLST_PROPERTIES}"
        export WLST_PROPERTIES
fi
JVM_ARGS="-Dprod.props.file='${WL_HOME}'/.product.properties ${WLST_PROPERTIES} ${JVM_D64} ${MEM_ARGS} ${CONFIG_JVM_ARGS}"

ORACLE_HOME/common/bin/wlst.sh osbservices.py  >> output.txt
date >> output.txt






Note : Change the value of wl_home, oracle_home, OSBHOME according to your environment.

After this you just need to run the shell script : sh osbservices.sh and you will get the output in output.txt file.

Thanks a lot for your patience !!!! 

Regards
-Ashish 

Shell script to get list of services along with there count having more than two version deployed in any domain.

Hello to viewer,

This shell script will provide you the list of services that are having more than two versions deployed in any domain along with there count and partition in which they are deployed.

Benefit: This is helpful for techies supporting non prod environment where there are many versions deployed in a domain for the same service. Since large number of versions creates confusion and leads to slowness of EM console.

Maintenance activity of any non prod environment includes undeploying older versions of the services and maintaining only one version that will respond to client request.Gathering the list of service having more versions ,manually is a time consuming process.This script will surely save your Time.

Here is the Flow :

Shell calls the python ---> python executes the wlst command.

Wlst command: It will list all the composites that are deployed in any domain.

sca_listDeployedComposites('host','manageserver_port','user','password')

Change the value of host,manageserver_port,user and password accrding to your environment.

Follow the below steps:

Step 1) : Create the directory structure as below:

cd /shared/fmw/build/script/versioncount

Step 2) : Under your current directory "versioncount " create serviceList.py file with content below:

import ConfigParser
def connectToServer():
        USERNAME = 'user'
        PASSWORD = 'password'
        URL='t3://host : adminport'
        #Connect to the Administration Server
        print 'starting the script ....'
        connect(USERNAME,PASSWORD,URL)

def disconnectFromServer():
    print "Disconnecting from the Admin Server"
    disconnect()
    print "Exiting from the Admin Server"
    exit()
    print "Mission Accomplished"

def readConfigurationFile():
    try:
        print 'Entry point...'
        sca_listDeployedComposites('host','manageserver_port','user','password')

    except :
        print 'Unable to find admin server...'
        exit()

    print 'Command executed successfully'

###############     Main Script   #####################################
#Conditionally import wlstModule only when script is executed with jython
if __name__ == '__main__':
    from wlstModule import *#@UnusedWildImport
print('This will enable you to create distributed JMS Queues')
connectToServer()
readConfigurationFile()
disconnectFromServer()
####################################     

Step 3)  : Under your current directory "yourscript " create serviceList.sh with the content below :

#!/bin/sh
# set up WL_HOME, the root directory of your WebLogic installation
WL_HOME="wl_home"

umask 027

cd /shared/fmw/build/script/versioncount

# set up common environment
WLS_NOT_BRIEF_ENV=true
. "${WL_HOME}/server/bin/setWLSEnv.sh"

#CLASSPATH="${CLASSPATH}${CLASSPATHSEP}${FMWLAUNCH_CLASSPATH}${CLASSPATHSEP}${DERBY_CLASSPATH}${CLASSPATHSEP}${DERBY_TOOLS}${CLASSPATHSEP}${POINTBASE_CLASSPATH}${CLASSP
ATHSEP}${POINTBASE_TOOLS}"

if [ "${WLST_HOME}" != "" ] ; then
        WLST_PROPERTIES="-Dweblogic.wlstHome='${WLST_HOME}' ${WLST_PROPERTIES}"
        export WLST_PROPERTIES
fi

#echo
#echo CLASSPATH=${CLASSPATH}

JVM_ARGS="-Dprod.props.file='${WL_HOME}'/.product.properties ${WLST_PROPERTIES} ${JVM_D64} ${MEM_ARGS} ${CONFIG_JVM_ARGS}"

sh ORACLE_HOME/common/bin/wlst.sh serviceList.py > output.out

grep -E "partition" output.out > final.out

cat final.out | sed -e 's/mode.*//' > a.out

cat a.out | sed -e 's/^[0-9]*. //g' | sed -e's/[0-9]*[.]*//g' | sed -e 's/\[//g' | sed -e 's/\]//g' | sed -e 's/, /,/' > b.out

N=0
while read LINE ; do
  var[$N]=$(echo $LINE)
  #echo {$var[$N]}
  N=$((N+1))
done < b.out
for i in ${var[*]};
do
   COUNT=0
   for j in ${var[*]};
   do
     if [ "$i" = "$j" ]; then
     COUNT=$((COUNT+1))
     fi
   done
   if [ "$COUNT" -gt 1 ]; then
   echo $i $COUNT >> result.txt

   fi
done
sort result.txt | uniq  > finalresult.txt
rm result.txt    

Note : Change the value of wl_home, oracle_home according to your environment.

After this you just need to run the shell script : sh serviceList.sh and you will get the output in finalresult.txt file like mentioned below:

service1,partition=partition_name, count 

Thanks a lot for your patience !!!! 

Regards
-Ashish 



 
 

Shell script to get Email Notification for every new occurence of java.lang.OutOfMemoryError in logs

Shell script to get Email Notification for every new occurrence of java.lang.OutOfMemoryError in logs

This script will send the Email Notification whenever there is new occurrence of java.lang.OutOfMemoryError in logs with latest Timestamp that will help you in diagnosing the issue.

Benefit: This script is helpful in monitoring the Environment and will let the administrator know about the issue ASAP so that he can perform the required solution and can prevent unbearable delay.As it sends the notification it also takes the backup of log file.

Below are steps you need to follow:

Step 1) Create the directory

cd /shared/fmw/build/myscript

Step 2) Create AutocheckOOM.sh file in the current directory with below content:

#!/bin/bash
##########
ENVNAME="Env:"
COUNTER="0"
WORKDIR="/shared/fmw/build/myscript"
msName="MngdSvr1"
Log_LOC="logfile_location"

LogFiles=( MngdSvr1.log )

# email notifications will be sent via mail
EMAIL="mail_id"
# CC list in the notification mail
CCList="ccmail_id"
# From email address in the notification Email
FromAdd="frommail_id"



#Functions

OOM() {
for logfile in ${LogFiles[@]} ;do
Count=`grep "java.lang.OutOfMemoryError" $Log_LOC/$logfile | wc -l`
COUNTER=$[$COUNTER + $Count]
export COUNTER
done
}


BackupLogs() {
for logfile in ${LogFiles[@]} ;do
if [ -f $Log_LOC/$logfile ]; then
tar -czf $Log_LOC/$logfile.tar.gz $Log_LOC/$logfile
fi
done
}

Main() {
OOM
#ProcCheck
if [[ "$COUNTER" != "0" ]] ; then
echo "`date` :Out Of Memory Condition Detected.."
echo "`date` :Backing up logs for future reference.."
BackupLogs
cat $Log_LOC/NGS_MngdSvr1.log | grep java.lang.OutOfMemoryError | grep "####<" > temp.txt
output=$(tail -1 temp.txt | awk -F'>' '{print $1}' | awk -F'<' '{print $2}')
echo ''>> a.txt
test=$(cat a.txt | grep "$output")
if [ "$test" == "" ]; then
echo $output >> a.txt
#echo $output
echo "$ENVNAME OutOfMemory Error Detected at $output" | mail -s "$(echo -e "Auto-Msg: $ENVNAME : OutOfMemory Error\nContent-Type: text/html")" $EMAIL $CCList
 $FromAdd
fi
#CleanLogs

else
echo "`date` :Exiting, No Out of Memory found...";
exit 0
fi
}
Main

Note : change the location of log according to your Env.
           change the email_id accordingly.
          change the name of managed server accordingly

After this you just need to run the shell script or better way is to set this as a job in cron.

sh AutocheckOOM.sh

Thanks a lot for your patience!!!!

Regards
-Ashish