[12.2.1.0.0] Failed to start the BAM Alert Engine

Hello Viewers,

I was trying to configure the BAM Alerts with Email Notification feature. I created the BAM alerts in BAM composer and configured the BAM properties and user messaging driver.


while deactivating the alert I was getting the pop up saying "unable to deactivate the alert" but actually it gets deactivate. same behavior when i was trying to activate it.
When i was trying to save the alert it is "showing unable to load the alert"

In logs i was getting the below error:

-------------------------------------------------------------------------------------------------------------------------------------------------------------
<Apr 3, 2016 1:54:44 AM EDT> <Warning> <oracle.beam.server> <BEA-000000> <BAM Alerts Engine Service failed to start. 
Exception: java.lang.StringIndexOutOfBoundsException: String index out of range: 4 
at java.lang.String.substring(String.java:1963) 
-------------------------------------------------------------------------------------------------------------------------------------------------------------

Applied all the mandatory patches for BAM and restarted the server after clearing tmp, cache and data folder but still got the same issue.

Solution :

1) Go to EM -> Navigate to Business Activity Monitoring -> BAMServer -> BAM Properties
2) Click on "More Advanced configuration
3) Search for ScheduledDataPurgeTimeForDataObject property, change its value from 1:0:0 to 01:00:00
4) Save your changes.
5) Restart the environment.

Thanks a lot for your patience!!!

Regards
-Ashish

Oracle Coherence GE 12.2.1.0.0 <D5> (thread=ReplicatedCache:SOAReplicatedCache, member=15): Member 13 joined Service SOAReplicatedCache with senior member 15> 

Hello Viewer,

I have 2 unix box on which  two TEST environment were built with SOA and OSB domain for each.

Taking reference of only SOA domain :

SOA_TEST1_DOMAIN:

Admin server(Machine1)

BAM server1(Machine1)

BAM server2(Machine2)

SOA_server1(Machine1)

SOA server2(Machine2)

SOA_CLUSTER: SOA_server1, SOA server2

BAM_CLUSTER: BAM server1,BAM server2

SOA_TEST2_DOMAIN:

Admin server(Machine1)

BAM server1(Machine1)

BAM server2(Machine2)

SOA_server1(Machine1)

SOA server2(Machine2)

SOA_CLUSTER: SOA_server1, SOA server2

BAM_CLUSTER: BAM server1,BAM server2

Note: cluster name in both the domain is same i.e SOA_CLUSTER and BAM_CLUSTER.

Issue:

===

--Whenever i was trying to deploy a service in TEST2 environment, I see errors in the TEST1 Env and the deployment hangs and/or timeouts with errors..

--When I shutdown TEST2 Env, than the Deployment goes through fine.

-- After bringing up the TEST2 environment again , already deployed composite becomes inaccessible in TEST1

Error in logs:

<Trace> <com.oracle.coherence> <soaXXXX.cos.XXXX.com> <soa_server1> <Logger@9215997 12.2.1.0.0> <<anonymous>> <> <a3379798-6804-442d-a3de-4a5576fc5975-00000004> <1458800884649> <[severity-value: 256] [rid: 0:6] [partition-id: 0] [partition-name: DOMAIN] > <BEA-000000> <[com.tangosol.coherence.component.util.logOutput.Jdk:log] 2016-03-24 02:28:04.649/212.173 Oracle Coherence GE 12.2.1.0.0 <D5> (thread=ReplicatedCache:SOAReplicatedCache, member=15): Member 13 joined Service SOAReplicatedCache with senior member 15>

After going through all the possible cause , we ended up on coherence factor.Actually whenever i was trying to bring up the servers in TEST2 environment , servers were getting registered as a member of already running SOA_CLUSTER i.e cluster of TEST1.

we tried to add the coherence parameter with different port in both the domains but still issue was occurring.

In 12c , while creating a domain we get a wizard to configure coherence cluster, by default weblogic provides us the coherence cluster named as defaultCoherenceCluster with all the Weblogic cluster(SOA_CLUSTER and BAM_CLUSTER) of the domain in its member list.

While creating the domain we accepted all the default setting for defaultCoherenceCluster, also name of the cluster in both the domain was same, so it seems it was not able to differentiate between weblogic clusters in both the domain and hence all the running servers were getting registered under only one cluster name SOA_CLUSTER.

Solution: 

we removed the SOA_CLUSTER and BAM_CLUSTER from the member list of defaultCoherenceCluster in one of the domain.

Alternatively other solution could be to create 2nd domain with different cluster name.

Although i am not sure if configuring defaultCoherenceCluster is mandatory or not :) 

since it resolved the issue for me , we accepted this solution.

Thanks a lot for your patience!!!

Regards
-Ashish

Error while bringing up the server after changing the repository schema password in 12c 

Hello Viewer,

In my case business requires the Metadata Repository schema passwords to be changed on a regular basis.
I changed the password for all the repository schema but after changing the password as soon as i started the managed and Admin server , it was failing to restart.

Below was the error in logs:

Error Code: 28000 Mar 20, 2016 2:48:19 AM oracle.security.jps.internal.common.config.AbstractSecurityStore getSecurityStoreVersion WARNING: Unable to get the Version from Store returning the default oracle.security.jps.service.policystore.PolicyStoreException: javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException Internal Exception: java.sql.SQLException: ORA-28000: the account is locked

After checking with the database team MFT_OPSS account was getting locked.
Although I checked that except datasource we are not using the MFT_OPSS user anywhere else. But still again and again it was getting locked. From SQL developer also we were able to connect successfully and the same password was updated in datasource as well.

Cause:

A 12c Infrastructure uses a Java Platform Security (JPS) credential store. If the credentials in the JPS store do not match with OPSS schema credentials in the Metadata Repository, AdminServer and Managed server will fail to start.

Note: Above error applies to Oracle Fusion Middleware - Version 12.1.2.0.0 and later

Solution:

It was resolved after following the below steps:

1) I asked the database team to unlock the account and change the password for this user,

2)  Encrypted the password using below steps and updated the opss-datasource-jdbc.xml
         a) cd $DOMAIN_HOME/bin
             . ./setDomainEnv.sh

         b) java weblogic.security.Encrypt newpassword

3) $ORACLE_HOME/oracle_common/common/bin/wlst.sh

wls:/offline>modifyBootStrapCredential(jpsConfigFile='$DOMAIN_HOME/config/fmwconfig/jps-config.xml',username='MFT_OPSS',password='newpassword')

4) Try to bring up the Admin server and Managed server. Hopefully it will start without any error this time.

Thanks a lot for your patience!!!

Regards
-Ashish

[12.2.1.0.0]Health status showing as blank for JMS servers in clustered environment

Hello to viewer,
After creating the weblogic 12c[12.2.1.0.0] environment , we encountered an issue where active destinations were not showing under jmsserver monitoring tab.

When viewing the Summary of JMS Servers in Weblogic Console the Health status was showing as blank for managed servers even though the managed servers were running and health was OK on summary of servers page.

After going through the oracle notes, we came to know that the issue is actually a bug in new weblogic upgraded version(12.2.1.0.0) which is not there in earlier versions.

As a solution oracle has provided a Patch 21830665 for weblogic version 12.2.1.0.0

This bug has been fixed in next version : 12.2.2.0.0

Note: Issue exist only for clustered environment and not for stand alone server.

Thanks for you patience!!

Thanks and Regards

Ashish Kumar Gupta

 

Script to target/untarget multiple datasource to/from the   cluster

Hello to Viewers,
This script will help in performing the target and untarget operation on multiple datasource in one go. You don't need to go to the console and do the same task manually which is of-course time taking and error prone.

FLOW:

shell script ---> python --> wlst command.

Here shell script will call python script and in python we have mentioned few relevant wlst command that perform the actual task.

Follow the below steps:

1) Create a shell script under below directory: QueueOperation.sh

I have taken the directory structure as below:

/opt/soauser/automation/SOADataSourceOperation/


DataSourceOperation.sh

----------------------------------------------------------------------------------------------

#!/bin/sh

export LOGFILE="/opt/soauser/automation/SOADataSourceOperation/DataSource.log"

if [ -f $LOGFILE ]; then

  rm -f $LOGFILE

fi

rm -rf /opt/soauser/automation/SOADataSourceOperation/DataSource.log

WL_HOME="/xxxxxx/xxxx/xxx/wlserver_10.3"

export WL_HOME

echo "Please enter target to Target and untarget to Untarget the Datasources:"

read PARAMETER1

cd /opt/soauser/automation/SOADataSourceOperation/

sh ${WL_HOME}/common/bin/wlst.sh /opt/soauser/automation/SOADataSourceOperation/DataSourceOperation.py $PARAMETER1 $1 >> /opt/soauser/automation/SOADataSourceOperation/DataSource.log

exit

------------------------------------------------------------------------------------------------

2) Create a text file in same directory that contains the datasource name:

Suppose you need to untarget the datasource related to SAP then name it as SAPdsList.txt(targetdsList.txt)

here target could be SAP or any end system to which datasources are related.

SAPdsList.txt

-----------------------------------------------------------------------------------------------------

DSNAME1
DSNAME2

------------------------------------------------------------------------------------------------------

3) Create a python file under the same directory: DataSourceOperation.py

Here i am assuming that 

datasources are targeted to only weblogic cluster.

DataSourceOperation.py

------------------------------------------------------------------------------------------------------

from java.io import FileInputStream

import java.lang

import os

import string

import sys , traceback

operation=sys.argv[1]

target=sys.argv[2]

def connectToServer():

        USERNAME = 'username'

        PASSWORD = 'password'

        URL='t3://AdminServerhost:AdminServerport'

        #Connect to the AdminServer

        print 'starting the script ....'

        connect(USERNAME,PASSWORD,URL)

def disconnectFromServer():

    print "Disconnecting from the Admin Server"

    disconnect()

    print "Exiting from the Admin Server"

    exit()

    print "Mission Accomplished"

def Target(DSName):

     try:

        print 'Entry point1...'

        edit()

        tgName = 'CLUSTER_NAME'

        startEdit()

        DSName = DSName.strip()

        print 'test0'

        cd ('/JDBCSystemResources/'+ DSName)

        print 'test1'

        set('Targets',jarray.array([ObjectName('com.bea:Name='+tgName+',Type=Cluster')], ObjectName))

        activate()

        print 'DataSource: "', DSName ,'" has been TARGETED TO CLUSTER Successfully'

     except :

        print 'Something went wrong...'

        exit()

def Untarget(DSName):

     try:

        print 'Entry point1...'

        edit()

        tgName = 'CLUSTER_NAME'

        startEdit()

        DSName = DSName.strip()

        print 'test0'

        cd ('/JDBCSystemResources/'+ DSName)

        print 'test1'

        set('Targets',jarray.array([], ObjectName))

        activate()

        print 'DataSource: "', DSName ,'" has been UNTARGETED FROM CLUSTER Successfully'

     except :

        print 'Something went wrong...'

        exit()

###############     Main Script   #####################################

#Conditionally import wlstModule only when script is executed with jython

if __name__ == '__main__':

    from wlstModule import *#@UnusedWildImport

print('This will enable you to perform operation on  datasource')

listName = target+'dsList.txt'

if operation=='target':

   f = open(listName,'r')

   out = f.readlines()

   for DSName in out:

     DSName.strip()

     print 'Trying to target  '+DSName

     connectToServer()

     Target(DSName)

     disconnect()

     print 'Target the '+DSName

else:

   f = open(listName,'r')

   out = f.readlines()

   for DSName in out:

     DSName.strip()

     print 'Trying to untarget '+DSName

     connectToServer()

     Untarget(DSName)

     disconnect()

     print 'Untargeted the '+DSName

disconnectFromServer()

-------------------------------------------------------------------------------------------------------

HOW TO RUN:

Simply run the shell script and provide the target system name as a parameter for ex:

cd /opt/soauser/automation/SOADataSourceOperation/

sh DataSourceOperation.sh SAP 

(here SAP is the target so python file will look for SAPdsList.txt)

then it will ask for the operation to be performed : Please enter target to Target and untarget to Untarget the Datasources

type the operation name and press "enter" and then verify the log file(DataSource.log) and queue status from console.

Thanks a lot for your patience !!!! 

Regards
-Ashish 

Script to Pause/Resume the multiple distributed queues at a time

Hello to Viewers,
This script will help in performing the pause and resume operation on multiple distributed queues in one go. You don't need to go to the console and do the same task manually which is of-course time
taking and error prone.

FLOW:

shell script ---> python --> wlst command.

Here shell script will call python script and in python we have mentioned few relevant wlst command that perform the actual task.

Follow the below steps:

1) Create a shell script under below directory: QueueOperation.sh

I have taken the directory structure as below:

/opt/soauser/automation/SOAQueueOperation/


QueueOperation.sh
---------------------------------------------------------------------------------------------------------------

#!/bin/sh

export LOGFILE="/opt/soauser/automation/SOAQueueOperation/Q_Pause_Resume.log"
if [ -f $LOGFILE ]; then
  rm -f $LOGFILE
fi
rm -rf /opt/soauser/automation/SOAQueueOperation/Q_Pause_Resume.log
WL_HOME="/xxxxxx/xxxx/xxx/wlserver_10.3"
export WL_HOME
echo "Please enter pause to PAUSE the queues or resume to RESUME the queues:"
read PARAMETER1
cd /opt/soauser/automation/SOAQueueOperation/
sh ${WL_HOME}/common/bin/wlst.sh /opt/soauser/automation/SOAQueueOperation/QueueOperation.py $PARAMETER1 $1 >> /opt/soauser/automation/SOAQueueOperation/Q_Pause_Resume.log
exit

--------------------------------------------------------------------------------------------------------------

2) Create a text file in same directory that contains the queue name:

Suppose you need to pause the queues related to SAP then name it as SAPQueueList.txt(targetQueueList.txt)

here target could be SAP or any end system to which queues are related.

SAPQueueList.txt

----------------------------------------------------------------------------------------------------------

QueueName1

QueueName2

----------------------------------------------------------------------------------------------------------

3) Create a python file under the same directory: QueueOperation.py

Here i am assuming that 

I  have 2 JMS servers : JMSSERVER1 and JMSSERVER2

My Managed servers name is MS1 and MS2

JMS module: JMSMODULE

QueueOperation.py

----------------------------------------------------------------------------------------------------------

from java.io import FileInputStream

import java.lang

import os

import string

import sys , traceback

operation=sys.argv[1]

target=sys.argv[2]

def connectToServerJMS1():

        USERNAME = 'username'

        PASSWORD = 'password'

        URL='t3://managedserver1host:managedserver1port'

        #Connect to the ManagedServer1

        print 'starting the script ....'

        connect(USERNAME,PASSWORD,URL)

def connectToServerJMS2():

        USERNAME = 'username'

        PASSWORD = 'password'

        URL='t3://managedserver2host:managedserver2port'

        #Connect to the ManagedServer2

        print 'starting the script ....'

        connect(USERNAME,PASSWORD,URL)

def disconnectFromServer():

    print "Disconnecting from the ManagedServer"

    disconnect()

    print "Exiting from the Managed Server"

    exit()

    print "Mission Accomplished"

def pauseQueueConsumptionJMS1(queueName):

     try:

        print 'Entry point1...'

        serverRuntime()

#       queueName = str(queueName.strip())

        queueName = queueName.strip()

        print 'test0'

        cd('/JMSRuntime/MS1.jms/JMSServers/JMSSERVER1/Destinations/JMSMODULE!JMSSERVER1@'+ queueName)

        print 'test1' 

        cmo.pauseConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION Paused ON JMS1 Successfully'

     except :

        print 'Something went wrong...'

        exit()

def pauseQueueConsumptionJMS2(queueName):

     try:

        print 'Entry point2...'

        serverRuntime()

        queueName = queueName.strip()

        print 'test2'

        cd('/JMSRuntime/MS2.jms/JMSServers/JMSSERVER2/Destinations/JMSMODULE!JMSSERVER2@'+ queueName)

        print 'test3'

        cmo.pauseConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION Paused ON JMS2 Successfully'

     except :

        print 'Something went wrong...'

        exit()

def resumeQueueConsumptionJMS1(queueName):

    try:

        print 'Entry point...'

        serverRuntime()

        queueName = queueName.strip()

        cd('JMSRuntime/MS1.jms/JMSServers/JMSSERVER1/Destinations/JMSMODULE!JMSSERVER1@'+ queueName)

        cmo.resumeConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION resumed Successfully'

    except :

        print 'Something went wrong...'

        exit()

def resumeQueueConsumptionJMS2(queueName):

    try:

        print 'Entry point...'

        serverRuntime()

        queueName = queueName.strip()

        cd('JMSRuntime/MS2.jms/JMSServers/JMSSERVER2/Destinations/JMSMODULE!JMSSERVER2@'+ queueName)

        cmo.resumeConsumption()

        print 'Queue: "', queueName ,'" has been CONSUMPTION resumed Successfully'

    except :

        print 'Something went wrong...'

        exit()

###############     Main Script   #####################################

#Conditionally import wlstModule only when script is executed with jython

if __name__ == '__main__':

    from wlstModule import *#@UnusedWildImport

print('This will enable you to perform operation on  distributed JMS Queues')

#connectToServer()

listName = target+'QueueList.txt'

if operation=='pause':

   f = open(listName,'r')

   out = f.readlines()

   for queueName in out:

     queueName.strip()

     print 'Trying Consumption Pause on '+queueName      

     connectToServerJMS1()

     pauseQueueConsumptionJMS1(queueName)

     disconnect()

     connectToServerJMS2()

     pauseQueueConsumptionJMS2(queueName)

     disconnect()

     print 'Consumption Paused on '+queueName

else:

   f = open(listName,'r')

   out = f.readlines()

   for queueName in out:

     queueName.strip()

     print 'Trying Consumption Resume on '+queueName

     connectToServerJMS1()

     resumeQueueConsumptionJMS1(queueName)

     disconnect()

     connectToServerJMS2()

     resumeQueueConsumptionJMS2(queueName)

     print 'Consumption Resumed on'+queueName

#exit()

disconnectFromServer()

#################################### 

---------------------------------------------------------------------------------------------------------

HOW TO RUN:

Simply run the shell script and provide the target system name as a parameter for ex:

cd /opt/soauser/automation/SOAQueueOperation/

sh QueueOperation.sh SAP 

(here SAP is the target so python file will look for SAPQueueList.txt)

then it will ask for the operation to be performed : Please enter pause to PAUSE the queues or resume to RESUME the queues

type the operation name and press "enter" and then verify the log file(Q_Pause_Resume.log) and queue status from console.

Thanks a lot for your patience !!!! 

Regards
-Ashish 

Script to List All the OSB projects, Business Services and Proxy Services deployed in sbconsole

Script to List All the OSB projects, Business Services and Proxy Services deployed in sbconsole.

Hello to viewer,

This script will provide you the list of all the OSB projects , business services and proxy services deployed in sbconsole in a .txt file.

Benefits: This is helpful for techies supporting non prod environment where lots of dummy projects are created by developers just for testing purpose. This script can help in performing the cleanup activity.It will provide the list of projects , BS and proxy services and later unused services and projects can be identified and deleted.

Here is the Flow :

Shell calls the python ---> python executes the wlst command.

Follow the below steps:

Step 1) : Create the directory structure as below:

cd /shared/fmw/build/script/List/


Step 2) : Under your current directory "List" create osbservices.py file with content below:

import sys
import os
import socket

connect('username', 'password', 't3://host:AdminPort')

from com.bea.wli.sb.management.configuration import ALSBConfigurationMBean
from com.bea.wli.config import Ref
from java.lang import String
from com.bea.wli.sb.util import Refs
from com.bea.wli.sb.management.configuration import CommonServiceConfigurationMBean
from com.bea.wli.sb.management.configuration import SessionManagementMBean
from com.bea.wli.sb.management.configuration import ProxyServiceConfigurationMBean
from com.bea.wli.monitoring import StatisticType
from com.bea.wli.monitoring import ServiceDomainMBean
from com.bea.wli.monitoring import ServiceResourceStatistic
from com.bea.wli.monitoring import StatisticValue
from com.bea.wli.monitoring import ServiceDomainMBean
from com.bea.wli.monitoring import ServiceResourceStatistic
from com.bea.wli.monitoring import StatisticValue
from com.bea.wli.monitoring import ResourceType

domainRuntime()

alsbCore = findService(ALSBConfigurationMBean.NAME, ALSBConfigurationMBean.TYPE)
refs = alsbCore.getRefs(Ref.DOMAIN)
it = refs.iterator()
print "List of Project in OSB"
while it.hasNext():
    r = it.next()
    if r.getTypeId() == Ref.PROJECT_REF:      
        print "Project Name : " + (r.getProjectName())

allRefs= alsbCore.getRefs(Ref.DOMAIN)
print "List of Proxy Service"
for ref in allRefs:  
  typeId = ref.getTypeId()
  if typeId == "ProxyService":    
     print "Proxy Service: " + ref.getFullName()
allRefs= alsbCore.getRefs(Ref.DOMAIN)
print "List of Business Service"
for ref in allRefs:
  typeId = ref.getTypeId()
  if typeId == "BusinessService":         
     print "Business Service: " + ref.getFullName()
disconnect()
exit()

Step 3)  : Under your current directory "List" create "osbservices.sh" with the content below :

#!/bin/sh
# set up WL_HOME and OSBHOME the root directory of your WebLogic installation
WL_HOME="WL_HOME Directory"
OSBHOME="OSB_HOME Directory"
rm output.txt
umask 027

# set up common environment
WLS_NOT_BRIEF_ENV=true
. "${WL_HOME}/server/bin/setWLSEnv.sh"


CLASSPATH="${CLASSPATH}${CLASSPATHSEP}${FMWLAUNCH_CLASSPATH}${CLASSPATHSEP}${DERBY_CLASSPATH}${CLASSPATHSEP}${DERBY_TOOLS}${CLASSPATHSEP}${POINTBASE_CLASSPATH}${CLASSPATHSEP}${POINTBASE_TOOLS}"

CLASSPATH=$CLASSPATH:$OSBHOME/modules/com.bea.common.configfwk_1.6.0.0.jar:$OSBHOME/lib/sb-kernel-api.jar:$OSBHOME/lib/sb-kernel-impl.jar:$WL_HOME/server/lib/weblogic.jar:$OSBHOME/lib/alsb.jar;
export CLASSPATH

if [ "${WLST_HOME}" != "" ] ; then
        WLST_PROPERTIES="-Dweblogic.wlstHome='${WLST_HOME}'${WLST_PROPERTIES}"
        export WLST_PROPERTIES
fi
JVM_ARGS="-Dprod.props.file='${WL_HOME}'/.product.properties ${WLST_PROPERTIES} ${JVM_D64} ${MEM_ARGS} ${CONFIG_JVM_ARGS}"

ORACLE_HOME/common/bin/wlst.sh osbservices.py  >> output.txt
date >> output.txt






Note : Change the value of wl_home, oracle_home, OSBHOME according to your environment.

After this you just need to run the shell script : sh osbservices.sh and you will get the output in output.txt file.

Thanks a lot for your patience !!!! 

Regards
-Ashish