Oracle E-Business Suite(R12.

2)
Troubleshooting

Amit Sharma
Apps DBA Expert

CORPORATE OFFICE US OFFICE INDIA OFFICE Email : contactus@k21technologies.com

8 Magnolia Place, 6515 E Union Ave, NS-24 Mianwali Nagar Phone : +1 408 627 8021
Harrow, London, UK Unit 451, Denver Paschim Vihar +91 959 905 6621
1
HA2 6DS CO 80237 New Delhi 110087
 Agenda
 ADOP Troubleshooting
 Logon Issues Troubleshooting
 Scalability

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

2
 Lesson-1
ADOP Troubleshooting

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

3
 ADOP Validate
• Part of ADOP utilit , alled e e uti g adop – alidate
• Located in $AD_TOP/bin
• Only available above AD-TXK 7
• Does a quick check on Online Patching Cycle and alerts of errors if any
• Usually one of the first step requested by Oracle Support.

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

4
Copyright © 2014, K21Technologies Ltd. All rights reserved 4
 EBS_LOGON Trigger
• Critical LOGON trigger owned by SYSTEM schema
• Should be explicitly disabled during autoconfig run on patch Filesystem and
should be immediately enabled
• Otherwise status should always be ENABLED
• Suggest a cron job is placed to check its status periodically

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

5
Copyright © 2014, K21Technologies Ltd. All rights reserved 5
 ADOPSCANLOG
• Key ADOP troubleshooting utility
• Located in $AD_TOP/bin
• Excellent utility to scan all your Online Patching logs with a single command
• Ability to selective reduce the amount of data that is displayed on screen
• Ability to scan even for past ADOP Sessions

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

6
Copyright © 2014, K21Technologies Ltd. All rights reserved 6
 ADOPREPORTS.SH
• Key ADOP Reporting Utility
• Located in $AD_TOP/bin
• Provides complete report on objects in each edition
• Provides space usage in key tablespaces
• Provides status of critical AD_ZD Objects

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

7
Copyright © 2014, K21Technologies Ltd. All rights reserved 7
 AD_ZD Objects
• All Objects starting with AD_ZD should be VALID
• If any becomes invalids then Online Patching cycle will fail
• Monitor and take corrective action immediately
• Suggest cron jobs are placed to verify status
• ADOPREPORTS.SH script can also be used to check the key object status

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

8
Copyright © 2014, K21Technologies Ltd. All rights reserved 8
 AD_ZD_LOGS Table
• Key ADOP table which contains all the log information
• Owned by APPLSYS Schema
• First place to look for detailed Online Patching Cycle messages
• Formatted concise output available through adopmon utility

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

9
Copyright © 2014, K21Technologies Ltd. All rights reserved 9
 ADOPMON
• Key ADOP Monitoring Utility, only available above AD-TXK 7
• Located in $AD_TOP/bin
• Formats the output of AD_ZD_LOGS table in a user friendly fashion
• Session keeps continuing to display new log information until closed.

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

10
Copyright © 2014, K21Technologies Ltd. All rights reserved 10
 Lesson- 2
Logon Issues
Troubleshooting

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

11
 Intermittent Logon Failures
• Ra do l users get Page a ot e Displa ed or I ter al “er er Error hile
trying to login
• Once login page is rendered, no failures
• Possible Cause
– Few OACORE Managed Servers have failed, check Server log and restart failed OACORE
Services
– If not solved, do complete Application Services Bounce

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

12
Copyright © 2014, K21Technologies Ltd. All rights reserved 12
 Logon Page Not Rendering
• No one is able to login to applications – Full Outage
• Possible Causes
– FMW Apache may have gone down – Check and restart Apache
– OACORE may have gone down – Restart OACORE Managed Servers
– Tablespaces might have got filled up – Check Database Alert log and take Corrective action
– Che k Profile I itializatio – “QL “tate e t Custo for a ju k alues
– ORA-00600 or ORA-07445 in alert log – Raise SR with Oracle and fix the error

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

13
Copyright © 2014, K21Technologies Ltd. All rights reserved 13
 General Troubleshooting
• Try the below URLs one after the other, one of it should tell you what the issue is
– http://<logon_url>/OA_HTML/ServletPing - Will error if OACORE is down
– http://<logon_url>/OA_HTML/OA.jsp?OAFunc=OAHOMEPAGE – Will error if OACORE has errors
– http://<logon_url>/OA_HTML/jsp/fnd/aoljtest.jsp – Will error if Database has connectivity issues
– http://<logon_url>/OA_MEDIA/FNDLOGOL.gif – Will error if you have issues with Media objects
– http://<logon_url>/forms/frmservlet - Will error if you have issues with Forms
– http://<logon_url>/OA_HTML/fndvald.jsp?username=sysadmin&password=<password> - Will give error stack if you
have a profile related issues.

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

14
Copyright © 2014, K21Technologies Ltd. All rights reserved 14
 Lesson-3
Scalability

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

15
 Add Managed Servers
Add Managed Server
perl $AD_TOP/patch/115/bin/adProvisionEBS.pl \
ebs-create-managedserver -contextfile=$CONTEXT_FILE \
-managedsrvname=oacore_server11 -servicetype=oacore \
-managedsrvport=7203 -logfile=$APPLRGF/TXK/addMS_oacore_server11.log <<EOF
<apps password>
<wls password>
EOF

Change Managed Server Property

perl $AD_TOP/patch/115/bin/adProvisionEBS.pl ebs-set-managedsrvproperty -contextfile=$CONTEXT_FILE -managedsrvname=oacore_server11 -
serverstartargs="<complete Args>" <<EOF
<wls password>
EOF

Add Managed Server configuration to Apache

oacore
perl $FND_TOP/patch/115/bin/txkSetAppsConf.pl -contextfile=$CONTEXT_FILE \
-configoption=addMS -oacore=<host>:<port1>,<host>:<port2>

forms
perl $FND_TOP/patch/115/bin/txkSetAppsConf.pl -contextfile=$CONTEXT_FILE \
-configoption=addMS -forms=<host>:<port1>,<host>:<port2>

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

Copyright © 2014, K21Technologies Ltd. All rights reserved 16
 Delete Managed Servers
Delete Managed Server
perl $AD_TOP/patch/115/bin/adProvisionEBS.pl \
ebs-delete-managedserver -contextfile=$CONTEXT_FILE \
-managedsrvname=oacore_server11 -servicetype=oacore \
-logfile=$APPLRGF/TXK/removeMS_oacore_server11.log <<EOF
<apps password>
<wls password>
EOF

Remove Managed Server configuration from Apache

oacore
perl $FND_TOP/patch/115/bin/txkSetAppsConf.pl -contextfile=$CONTEXT_FILE \
-configoption=removeMS -oacore=<host>:<port1>,<host>:<port2>

forms
perl $FND_TOP/patch/115/bin/txkSetAppsConf.pl -contextfile=$CONTEXT_FILE \
-configoption=removeMS -forms=<host>:<port1>,<host>:<port2>

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

Copyright © 2014, K21Technologies Ltd. All rights reserved 17
 Start/Stop Managed Servers
Through Admin Console

 Admin Server should be UP

 Node Manager should be UP on all target nodes
 Parallel Startup across Nodes

Through UNIX Prompt

Start Managed Server

sh $ADMIN_SCRIPTS_HOME/admanagedsrvctl.sh start oacore_server11 <<EOF
<wls password>
EOF

Stop Managed Server

sh $ADMIN_SCRIPTS_HOME/admanagedsrvctl.sh stop oacore_server11 <<EOF
<wls password>
EOF

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

Copyright © 2014, K21Technologies Ltd. All rights reserved 18
 Q&A

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

Copyright © 2014, K21Technologies Ltd. All rights reserved 19

 Find Us

http://facebook.com/k21technologies

http://twitter.com/k21technologies

https://www.linkedin.com/company/k21technologies

https://www.youtube.com/user/k21technologies

www.k21academy.com © Copyright 2016 | K21 Academy | All Rights Reserved

Copyright © 2014, K21Technologies Ltd. All rights reserved 20