42 -------------------1. 2. 3. 4. 5. 164 853 276 289 500 28 70 98 18 85 712 996 114 856 044 6. 7. 8. 9. 10.

735 417 027 288 141 38 41 63 18 10 924 091 025 396 023

Phone Passcode : 72578374 ------------------------------------------------imint referece no :777984 ------------------------------------------------in137884 Rangana ------------------------------0014164350464

Yogesh -------------------------416 256 2371 416 478 3563 acf@0950 ------------------------------------------------Ask ops to call randy. Randy Toy (Randy.Toy@ca.cevalogistics.com). Ceva/Matrix - Randy Toy 416-644-2549 CEVA Helpdesk 1-888-457-2382 ----------------------------------------------------

acf@8183 --------------------resubmit acf@8540 -------------------resubmit

acf@5102 -------------------------------------------------Resubmit the job , payables open interface

acf@0020 -------------------------------------------------Resubmit the Job. acf@8682 ------------------------------------------------New.dat file format was invalid,so we need to specify the correct path , we need to change the code in mainframe.

ACF@0011 -------------------------------------------------Failure : Parallel Server died unexpectedly. Solution: The server was down, so we can resubmit the job after it was up. acf@5020 -----------------------------------------------Resubmit --> Snapshot too old. acf@8283-->Resubmit acf@8280-->Resubmit aol@3511 ---------------------------------if it is failed at step 10,cc=12 if u dont see any error. then force complete the job and ask them to stop all subsequents jobs. ask kashif to bounce the task prcessor then run production gl clear data, ask yogesh or oleg to do that, then ask operations to start the new generation. aol@3516 -------------------------------Force complete the job then ask ops to resubmit the aol@3515 and aol@3516

aol@ap08 -----------------------------------Run the query to see all the errors, take the request id from the query and query it in apps and then check the fnd ouput for error. select * from fnd_conc_req_summary_v where user_concurrent_program_name='HBC Interface Errors Report' and parent_request_id in (select request_id from fnd_conc_req_summary_v where description='Run Error Report' and priority_request_id in (select priority_request_id from fnd_conc_req_summary_v where user_concurrent_program_name='HBC Run Interface'

and argument_text like '%AP008%')) and trunc(request_date)='01-Dec-10' order by request_id desc use this query for getting Error reports run for CIU files.. REquest ID - 62283903 is error report for the failure reported.. see the error message in Output of th is The file in output report is available under fin502/archive which suggests its p rocessed successfully.. xibmo58@ccfinp03 [/fin502/archive] $ ls -ltr *AP00820101201202043_11.dat -rw-rw-r-1 olprd olprd 87005 Dec 01 22:00 ARC_AP0082010120120204 3_11.dat Kadali, Chandra [1:30 AM]: okay Patil, Yogesh [1:31 AM]: verify that invoices in this file are indeed in Oracle. Read the file using CIU format in PAyable guider... get familiar with HDR and DDR record types.. and query the invoice in Oracle to see if its there for same vendor ( created y'day) As a last chance , we can force complete this job. TO find what is there in DRV files:---------------------------------ccfinp03 login with ID To get all the drv files of AOL (Finance). ls /ol/prd/scripts/bin To get all the drv files of ACF (COFI). ls /cf/prd/scripts/bin --------------------------ff1. Acceptable failures. (Note: Always pull the log to trap the problem, find children using section 3 approach if necessary). (a) ACF@7930 through ACF@7940 (acfstpck APPL). These jobs run large numbers of child processes (300 - 500). A very small percentage of children may fail on a cryptic format error. It's OK to force complete because there is a manual work around. (b) ACF@5100 price change job. Again a large number of child processes are involved. If a child shows an error because of no open accounting period send a message to Nancy Cheng and Ron Dawe and force compete. If a

"Mass Edit Material Costs" child fails for other reasons it should be investigated with finance support (Susan/Ghazi). If no "Mass Edit Material Costs" child failed it's OK to force complete. *** Please note: This job should not be terminated for the maintenance window if any "Mass Edit Material Costs" childrenfdrv are active. IRM can determine this at the time the system is to come down. Notifications (subappl ACFNTF, ACFNTFH). Send a message to the owner. Reporting (subappl ACFFINRP, ACFTXN, ACFASCP). Reporting jobs are jobs which start with ACF@8***. Note that many jobs release FTPs which also must be force completed. Send a message to Bob. Forecast (APPL ACFFST). Send a message to Sviatlana. Call as well she, may be able to fix the problem before ASCP. Service (APPL ACFSER*). Job can be restarted. If job fails again force complete. POS Offnet (APPL ACFPOSOF). Leave job in failed status. Contact Abi or Ivo in morning. Note that the log message: stage3a_cursor_not_found indicates bad data that needs to be cleaned up before the input file can be reprocessed. Jobs ACF@6020 or ACF@6030. If ACF@0051 or ACF@0053 runs into Sunday 6-9am maintenance window, jobs can be terminated by IRM and restarted after maintenance window. If ACF@0051 or ACF@0053 fails restart job. COFI background processes (jobs ACF@9*). A page happens after 2 unsuccessful resubmissions. During business hours contact Dieter or Oleg. If failure occurs over night contact one of them the next morning. COFI/RETEK extract (ACF@5022). This job often runs into contention problems. It is OK to force complete it since missing transactions will be picked up in the next run. *** Note this jobs does become critical at month end. One transaction type (price list markup/markdown) has been removed from the Oracle extract and is handled in new jobs ACF@5019/ACF5019/ACF@5029. It is important for these jobs to complete before ACF@5022 and ACF@500A run. If ACF@5022 is skipped it is important that ACF@500A runs successfully before the next run of ACF@5019/ACF5019/ACF@5029. This is necessary to make sure that files are properly synchrozed for the Retek interface. COFI background processes cleanup processes (ACF@777*). If resubmission is unsuccessful during business hours contact Dieter or Oleg. If failure occurs over night contact one of them the next morning. If ACF@8207 run longs. You can have IRM terminate the concurrent request and force complete job. If any of the Camco jobs fail ACF@42* subappl ACFCAMCO and ACFCAMCT they can be resubmitted. If jobs continues to fail after resubmitting leave job in failed status. Jobs can be left until next morning. If any of the Symcor jobs fail subappl ACFSYMCR they can be resubmitted. If jobs continues to fail after resubmitting leave job in failed status. Jobs can be left until next morning. If any of the Assurant jobs fail ACF@43* subappl ACFASSUR they can be resubmitted. If jobs continues to fail after

(c) (d)

(e) (f) (g)

(h)

(i)

(j)

(k)

(l) (m)

(n)

(o)

resubmitting leave job in failed status. Jobs can be left until next morning. Don't bother resubmitting ACF@4300 after an INVALID NUMBER condition. This is a data entry error that we can't fix. (p) If any for the reporting ftp jobs fail (ACF@85* or ACF@86*) have operations call ESSWIN oncall person and get them to increase space on CCDATA08. (q) If ACF@8089 (RETEK_REPORT2) fails with message: ORA-06512: at "APPS.GL_CURRENCY_API", line 102 ORA-01403: no data found ORA-06512: at "APPS.GL_CURRENCY_API", line 429 There are no rows of type 1000 on table GL_DAILY_RATES Contact Bob Green to add rates to table. (r) If ACF@1971,ACF@1972,ACF@1973,ACF@1974 fails job should be completed. (s) If ACF@862B or ACF@864B fails job should be resubmitted. If it fails again job can be force completed. /**************************************************************/ /* UPLOAD TERMINATION FILE TO SOLUTION STUDIO AS NOTIFICATION /* OF FTP COMPLETION. /**************************************************************/ AIX_JOB ACF@864B.FTP2VNDR DOCMEM(ACF@862A) RUN DAILY ESPNOMSG AJ ACF@864B.FTP2VNDR + BROWSE ASTLB.PRD.ESPPROC(ACFDTS) Line 00000144 Col 001 080 RESET LATEEND('REALNOW PLUS 60 MINUTES') APPL(%ESPAPPL..%ESPAPGEN) AGENT AIX-CCEXTFTPP02P USER stdata CMDNAME /opt/axway/SecureClient/SecureClient/sclient ARGS 'solutions' put + %ftp_dir_sol/TERMINATION.txt / RELEASE (ACF@8629 ACF@862C.DELFTP ACF@864C.DELFTP) ENDJOB /**************************************************************/ Output of messages for workload object ACF@864B.FTP2VNDR/ACFDTSH.8054/MAIN Start date Mon Mar 21 15:04:59 2011 ---------------------------------------------------------------Checking transfer engine status on port 1717: is running put /v/hbc/xf88721/cofi/cofiout/TERMINATION.txt / scheduler job - 9708 has been submitted

(t) If ACF@0078 fails job should be resubmitted. If it fails again job can be force completed. (u) If ACF@7402 fails job should be resubmitted. (v) ACF@092A or ACF@862A can fail due to space problems on FTP server. Tell operations to resubmit job. If it fails again have operations retry every 15 minutes. Job will eventually run. (w) If any of the mainframe jobs fail in a step using BMC with error resource not available. Have operations page IRM DB2 oncall person to investigate. 2. Critical failures a. DC pick jobs (APPL ACFDCPCK). Find children using section 3 approach.

If failure was in the 'COFI Release Sales Orders' set the job can be force completed. If failure was in the 'COFI Send Picktickets to PKMS' set call logistics Pager: 416-###-####. b. ASCP (APPL ACF, SUBAPPL ACFASCP). Call ASCP Pager: 416-426-4099 416-370-8969 (jan 17 - jan23) Zdenka Stwora Home Number: 905-274-5724 Masteneh Sarabi Cell Phone: 416-716-5347 c. PO/EDI/IMPORTS (APPL ACF , SUBAPPLs ACFPO, ACFEDIMP). CALL Zdenka Stwora (905-274-5724). d. INVENTORY INTERFACES (APPL ACF , SUBAPPL ACFINV) CALL COFI pager (416-729-1060). e. FINANCE INTERFACES (APPL ACF, SUBAPPL ACFFIN) CALL COFI finance pager (416-329-1657). ** As previously ACF@5022 is the exception (it can be force completed). f. TNT INTERFACES (APPL ACFTNTXM) Jobs begin with ACF@09** or ACF@74**. If jobs ACF@0930, ACF@0940 or ACF@0950 fail with message 'A remote host did not respond within the timeout period.' the TNT server is not responding. You can have operations resubmit failed job. If it fails again you have to contact the HBC Service desk and have them call the Ceva help desk or contact Randy Toy (Randy.Toy@ca.cevalogistics.com). If jobs ACF@74** fails with message 'XYCOFI_TNT_ASN table not yet updated' or 'XYCOFI_TNT_INV table not yet updated' or 'XYCOFI_TNT_PICKTICKET table not yet updated'. The cause of the problem is that the TNT files did not have any data or are missing. Run job BSTCF.DEV.DRVR(TNTLOG) to get and display log file from '\ccfinp03\fin201\oracle\hprdappl\xxhbcdata\1.0.0\tnt\log'. You will see one or more of these messages: 'No Pickticket Files Processed' 'No ASN Files Processed' 'No Inventory Files Processed'. Run job BSTCF.DEV.DRVR(TNTFILES) to log into TNT server and display files in directory From_TNT. ASN file name is ASNMMDD. Inventory file name is INVMMDD. Pickticket file name is PTMMDD. Where MM is the month and DD is the day. Sometimes the files are late being put on the server. The file load jobs run at 7am. If the missing files are there submit an ISR to rerun load jobs and restart failed jobs. The IP address, ID and password for the TNT server are in BSTCF.ESP.FTPID(TNTID).

If the files are missing you have to contact the HBC Service desk and have them call the Ceva help desk or contact Randy Toy (Randy.Toy@ca.cevalogistics.com). Once the file are there you have to rerun the FTP and load jobs. ASN FTP Load Jobs ACF@0930 ACF@0931 ACF@0932 ACF@0933 ACF@0934 ACF@0935 ACF@0960 Inventory FTP Load Jobs ACF@0940 ACF@0941 ACF@0942 ACF@0943 ACF@0944 ACF@0945 Pick Ticket FTP Load Jobs ACF@0950 ACF@0951 ACF@0952 ACF@0953 ACF@0954 ACF@0955 RMA Table Populate ACF@0960 The failed jobs can now be resubmitted. Also let Sandra X3647 and/or Carlos X3642 know that "Khalid's files" will be late due to a firefight. We have reports that run monday and thursday so we can inform the clients that the reports will be late. *** IMPORTANT - ASCP and DC pick do NOT restart gracefully. Even if a failure looks safe to restart (e.g. a snapshot too old message) call the specific application support person. *** There is an exception to this rule in the DSO plan (ACF@0020) In the following situation it's OK to resubmit ACF@0020 ONCE without calling ASCP support - The root level request has a single child and a single grandchild. - The grandchild has 6 children and NO grandchildren. - One or more of the 6 has a message in its log like this: Cause: The program is unable to obtain a lock on the table x Action: Resubmit the program at a later time. g. If job ACF8217 fails it can be left until the morning. If the FTP step to QLOGITEK fails call QLOGITEK at 416 741-1595 or email support.centre@qlogitek.com.

h. ASN cleanup jobs ACF@1970/71/72/73 may be force completed. If consecutive failures occur contact Zdenka. i. The STS/DTS extract ACF@8278 and the DTS update extract ACF@8288 are FTP to Solution Studio. These jobs should be fixed and rerun ASAP. If ACF861B or ACF@862B fails with error '426 Connection closed; transfer aborted' try resubmitting. If job fails again call Solution Studios at (416) 595-5086 or send email to joe@thesolutionstudio.com and have them check their server. If ACF@862B shows as executing for more than a minute, it is hung up and will not fail. Call operations to get the job terminated on the CCEXTFTP01 server and then have the job resubmitted. 3. Finding children when a concurrent manager job fails a. Enter job name in file ASTCF.ACFSAM.INTER.ACF1701D b. Have operations trigger event ASTLB.AIX_ACF@1700 (2 jobs will run ACF@1700 and ACF1710) C. When ACF1710 is finished all requests related to the job can be viewed in file 'BSTCF.ACFSAM.INTER.ACF1720S' (layout is ASTLB.PRD.COPY(ACF1720W)) 4. Pulling concurrent log file a. Find the 7 digit concurrent request ID in the ESP JOBNO field b. Paste the request ID for job name in control member YSMAD.ZEX.PRD.CNTL(ACFLOGPP) c. Run YSMAD.ZEX.PRD.DRVR(ACFLOGPP) d. The concurrent log is BSTCF.ACFSAM.INTER.ACFLOGPP *** NOTE if you don't have create access to BSTCF, override ACCTCF. 5. Pulling ESP logs a. Run YSMAD.ZEX.PRD.DRVR(ACF0010R) b. The command log is BSTCF.ACFSAM.INTER.ESPCOMD c. The transmit log is BSTCF.ACFSAM.INTER.ESPCOMDT d. The receive log is BSTCF.ACFSAM.INTER.ESPCOMDR e. The default parmeter file is BSTCF.ACFSAM.INTER.ESPPARM *** NOTE if you don't have create access to BSTCF, override ACCTCF. 6. Contention a. If a log shows rollback segment errors with snapshot too old a restart will usually solve the problem. b. If a log shows a failure in extending a rollback segment it probably won't go away and IRM will have to be paged. c. If a log shows a failure on acquring a resource it's a locking problem and IRM must be paged. 7. Long running jobs a. Certain service jobs (ACF@4002 , ACF@4121) have had problems with both contention failures and unpredictable run times. They are important but not critical. Jobs can be force completed. b. If run times are extreme and operations calls there may be problems with a dropped connection, looping or rollback segment slowdowns. IRM should be paged to look at the can be addessed in the morning. c. ASCP - it is very important that ACSP finish before 7 AM. Operations will get alerts on the console if certain jobs are

running to long. If there is no obvious reason why call ASCP support and have them look into it. **** IMPORTANT : 1. If called regarding the 3:30 AM cutoff for the DSO plan job (ACF@0020) call ASCP support immeadiately. A decision about running or skipping the API plan (ACF@0040) will be made based on the circumstances at the time. 2. If the decision is made to bypass ACF@0040 please temporarily change the subject and content of ACFEMAL1 PRIOR to skipping the job with these steps : a. Delete the contents of ASTCF.ACFSAM.INTER.EMAIL1.SUBJECT and copy in ASTCF.ACFSAM.INTER.EMAIL1.SUBJECTS b. Delete the contents of ASTCF.ACFSAM.INTER.EMAIL1.TEXT and copy in ASTCF.ACFSAM.INTER.EMAIL1.TEXTS c. Bypass ACF@0040, confirm that ACFEMAL1 is complete d. Delete the contents of ASTCF.ACFSAM.INTER.EMAIL1.SUBJECT and copy in ASTCF.ACFSAM.INTER.EMAIL1.SUBJECTR e. Delete the contents of ASTCF.ACFSAM.INTER.EMAIL1.TEXT and copy in ASTCF.ACFSAM.INTER.EMAIL1.TEXTR 3. If called regarding long run time of the lead time update job (ACF@0056) page IRM and have them check for contention. This job has caused serious delays because of contention with open forms. 8. Cancelling concurrent manager jobs a. If a concurrent manager job must be cancelled for any reason page IRM. Force completing in ESP does NOT stop the Oracle process. After IRM has killed the Oracle process an ESP failure will appear. 9. Running individual concurrent manager jobs a. If a concurrent manager job must be submitted off the schedule, be sure to ask for it from the special ACF@SUB event. All jobs are defined redundantly in ESP to avoid unintentionally running dependent jobs. 10.Cofi oncall rotation list located on I:\Operations\Shared\Contacts\Bay\Cofi. 11.When job fails with the following error messages: 'Problem with OA job data' The executable program name can not be found in concurrent manager. 12.When a bunch of jobs all fail at the same time with the following error messages: 'SQL Exception' 'Problem with OA job data' There is a problem with the ESP agent call operations have them check ESP agent and recycle agent. Restart failed jobs. 13.Jobs with status 'RUNNING:PAUSED' are a request set. Children jobs are running. 14.Jobs with status 'PENDING:NORMAL' are waiting for an initiator. 15.If ACF1156 fails because of error: THE ACF1165 FILE IS EMPTY Then advice Operation to submit the job after the failed step. This generally ha ppens when the stores are closed and no sales have happened.

India Offshore Notes:--------------------15.1 ACF@8275 (It is the report PL/SQL). GOt the Snapshot to old. It can be resu bmitted. 16. ACF@8198 or ACF@7320 Job fails then resubmit the program. And If it still fa ils then Contact the DBA. ORA-01555: snapshot too old: rollback segment number 4 with name "RBS04" t oo small 17. ACF@8208 If it takes more time then It can be Force Complete. This program r un on daily base. If it has taken more time then it will run next time so It wil l run automatically. Note:- Inform same to Rangana/ Concern Person. 18. AOL@AP08 Job Is the SQLLOADER job, If we get the following error. It is due to the permission not given to the file. SQL*Loader-500: Unable to open file (/fin502/inprocess/AP00820090409083433_37.da t) IBM AIX RISC System/6000 Error: 13: Permission denied Gautam/ Yogesh moves these file daily to the inbound folder manually. If it fai ls then it will move the dat file to the bad folder from inbound directory. 19. ACF@443B Job if get error got for not able to create the Temporary file. It could be issue with encrpted or dycrpted. For these things, we can try resubmitting the programs. 20.1 AOL@1300 Job is the rdf "Invocie Validation". Log as some error message, "N ON-Oracle Error message". resubmit the program has solved the issue. We can try AOL@13** program to r esubmit. 21) ACF@8294, COFI Safety Stock pegged to future planned orders went into Error Error in logfile :--8103 Error is OTHERS : ORA-08103: object no longer exists suggestion given :- Resubmission 22) ACF@8261,COFI RMA processed at store Error in logfile :-1555 Error is OTHERS : ORA-01555: snapshot too old: rollback segment number 4 with name "RBS04" too small suggestion given :- Resubmission 23) ACF@3505 (This is the FTP program). Log file has message, It has not found s ome file. (On Date: 07/07/2009) Inform the HBC operations to Restart the Job again (Resubmit) and it worked f ine. 24) ACF@7918 (This is newly implemented Job in ESP). Cause: FDPSTP failed due to ORA-06550: line 1, column 7: PLS-00306: wrong number or types of arguments in call to 'MAIN' ORA-06550: line 1, column 7: PL/SQL: Statement ignored We got the Error message given above.

Solution:- Forced Completed and RUn Manually by passing the parameter. 25) ACF@7042 (This Job Run Trice in the Day. If it is completed Successfully even once in that day. THen we can force comple te next time if it fails. 25.1) ACF@8205 This JOb run the RDF report. Got the following Error. MSG-00101: This report is last modified on Aug 25, 2005 ORA-08103: object no longer exists from ==> msc_demands md, THis appears to be PLans program is not at put the Data in the tables. SOlution:- I was able to query the data from msc_demands table now. --------- RDF file Name: XXCOFI_RPT205 PRogram nAme: COFI DC Build Requirement Report Tryied re-submitting it. GOt completed with no issue. 26) AOL@4903 (THIs is the REquest Set program Failed in eSP). THEre is no error in Application. Runs only on Saturday. The following are the request run in this request Set. * HBC Run Interface * GLJE Standard Inbound * HBC INterface Errors Report In "HBC Run Interface" Program Outfile has following message. lookups for stages stage ST completed No data file found lookups for stages stage GF completed not set up with Success at 29-AUG-2009 20:01:00 - aborting interface not set up with Failure at 29-AUG-2009 20:01:01

This error out in ESP because there is no data file found to process. I have forced Completed. INForm to finance Team about this. EMailed to: Margolin, Oleg; Omran, Ghazi CC: Yogesh Patil Query used to check the status of this request from toad ------------------------------------------------------------SELECT * FROM FND_CONC_REQ_SUMMARY_V where program like '%COFI Safety Stock And Zero Value Forecast Upload%' and trunc(actual_start_date)=trunc(sysdate) and status_code='E'

Error in log file -------------------------Concurrent Manager encountered an error while attempting to start your immediate concurrent program XXCOFISAFESTOCK. Routine &ROUTINE received a return code of failure. Contact your support representative. ----------------------------------------------------------------------------------------------------------------------26)AOL@1001 THe file which it process is manually put by --> SSF (shared service fin) team . Nema, Shekhar [4:27 PM]: Hi Andy Tiedemann, Andy [4:28 PM]: I'm here - hi! Nema, Shekhar [4:29 PM]: There is one job failure AOL@1001,can you please help me in that iam not able to see the log frm ESP Tiedemann, Andy [4:29 PM]: I'll take a look Nema, Shekhar [4:30 PM]: thanks a much, i am waiting for your reply Tiedemann, Andy [4:35 PM]: It's a cc 12 failure in step 20. It looks like it was restarted at 16:05, and failed there again - no surprise. I'm pretty sure it's a "file doesn't exist" error. I'm also a bit confused why it skips step 10, which checks for the exist ence of the file. Nema, Shekhar [4:36 PM]: what is the resolution for that?should i tell operations to force complete it? Tiedemann, Andy [4:37 PM]: Here's what the restart instructions say If it's monthend (which it isn't), then fight it. Otherwise, force-complete a nd unwait the rest of the schedule. Sometimes there isn't a file. Feel free to refer OPS to CSPAC.V2DOC.JOBLIB(AOL @1001) which lays this out. I think you're off the hook for this one. Nema, Shekhar [4:41 PM]: okay so i'll tell operations to Force complete it ! Tiedemann, Andy [4:42 PM]: yes Nema, Shekhar [4:42 PM]: Thanks Andy for ur Help Have a great Weekend Tiedemann, Andy [4:44 PM]: Cheers! sOLUTION GIVEN -->>>Force completed as it didnt fail during month end,as per And y Tiedemann ------------------------------------------------------------------------------------------------------------------------------------------------27.1) AOL@3958 ---------------

THe followingis the Error Message. + echo >>>ftp error - file ZHHCS.CZFSAM.RUN6890J.ftp not found on mainframe >>>ftp error - file ZHHCS.CZFSAM.RUN6890J.ftp not found on mainframe + echo + return 16 *!* 2010-01-31 10:32:19 *!* STEPNUMS/AOLGL.2847/MAIN ACTION SET AOL@3958R(13) *!* 2010-01-31 10:32:19 *!* AOL@3958/AOLGL.2847/MAIN State FAILED Cmpc(16) SetEnd UserStatus(STEP 13 FA *!* 2010-01-31 10:32:19 *!* STEP 13 FAILED, CC=16 COMMAND ===>

27) AOL@3960 The error message can also be found in the following path: (IN brower Window). http://ccfinp03.hbc.com/esp/MAIN/AOLGL.2694/AOL@3960.FTP THE error message would be easy to see. There will be two programs. AOL@3960 and AOL@3960.FTP AOL@3960 --> Will be submitted in Concurrent Program. AOL@3960.FTP would be submitted. If we are not able to solve this then we have t o move the files MAnually and Force Complet this. Called ANdy to do this. 29) ACF@8049 : Resubmission Worked. Failed on 06/09/09 30) AOL@35** is OFA job can not be force completed. I:\Customer FulFillment Systems\COFI_Rel1\Finance OFA EDW Portal PageNumber: 8 File NAme: OFA Support Guide. 40) AOL@45** is LT jobs 28) AOL@3511 Error Message --------

#------------------------------------------------------------------------------# # Step 10 - check OFA GL LINK data load # #------------------------------------------------------------------------------STEPexec 10 gllink_check.sh $INTRF_IN/gl_ofa.spool + STEPexec 10 gllink_check.sh /ol/prd/interfaces/in/gl_ofa.spool >>>Step 10 start: 2009-09-01 21:41:24 *!* 2009-09-01 21:41:24 *!* AOL@3511/AOLPNL.712/MAIN State EXEC UserStatus(EXECUTING STEP 10) *!* 2009-09-01 21:41:24 *!* EXECUTING STEP 10 *!* 2009-09-01 21:41:24 *!* EXECUTING COMMAND: /ol/prd/scripts/bin/gllink_check.sh /ol/prd/interfaces/in /gl_ofa.spool Calling this sql programs. /ol/prd/scripts/bin/pnl_gl_cm_check.sql AOL@3570_SEG 49999878 /fincsf/oracle/hprdcsf/log/HPRD/l49999878.req /fincsf/oracle/hprdcsf/out/HPRD/o49999878.out OFA loading has error Type -- AOL@3570_SEG RequestID -- 49999878 OutFile -- /fincsf/oracle/hprdcsf/out/HPRD/o49999878.out *!* 2009-09-01 21:41:24 *!* STEPNUMS/AOLPNL.712/MAIN ACTION SET AOL@3511R(10) *!* 2009-09-01 21:41:24 *!* AOL@3511/AOLPNL.712/MAIN State FAILED Cmpc(12) SetEnd UserStatus(STEP 10 FAI LED, CC=12) ---------In the SQL script. We have the following Select statement. select decode(r.STATUS_FLAG,'D','Loaded','C','Cancel','E','Error', 'H','Launched','N','New','L','Loading',r.STATUS_FLAG) from RG_DSS_REQUESTS r where --r.EXTRACTION_END_DATE is not null --and r.LOAD_END_DATE is not null r.CONCURRENT_REQUEST_ID = 49999878 The 49999878 is completed Successfully. Check from Front end. I do not have permissions to check from the above table. --------May be the above query is returning Error. Which is wrong in this case. Solution:- SKipped the Step 10 in Job. (Do not force complete this)

Mail From Oleg. -------------Team, this caused GL numbers not to show up in OFA this morning. WE HAVE TO BE VERY CAREFUL IN THE FUTURE! If any of the OFA jobs fail on GL or GP side, we should run clear (if it s the GL side clear job is AOL@3510) and run the failed side from the beginning. Both GL and GP calculations must complete successfully before AOL@3525 runs to calculat e P&L. If in doubt, rerun the failed side again from the start. If you are not clear, let me know. Thank you. Yogesh Email: (AOLPNL-Schedule.gif) ------------GL side jobs - ( Marked GREEN in the diagram ) aol@3550, aol@3555, aol@3560 /3561 , aol@3566 , aol@3551 , aol@3570, aol@3509, aol@3510 , aol@3511 , aol@3513 , aol@3512 , aol@3575 GP side jobs ( Marked RED in the diagram ) aol@3505 , aol@3515 , aol@3516, aol@3520 , aol@9595 Calculation Job : AOL@3525 EDW Portal Jobs ( Marked DEEP GREEN in the diagram ) aol@3530 , aol@3531 , aol@3532 ,aol@3533 aol@3535 , aol@3545 FTP job failures are exception to what Oleg mentioned as they may for fail for s pace issue or connectivity issue.

------------27) AOL@4649 File not found force completed bon 17/09/09

Contact Numbers:--------------Solution Studios Contacts:------------------------Joe Savoie joe@thesolutionstudio.com (t) 416.406.2602

(c) 416.435.1648

Todd Lumley todd@thesolutionstudio.com (416) 406 2600 ext 22

Dan Vella dan@thesolutionstudio.com (t) 416 406 2600 x 31 (c) 647.281.6495 Any email relating to recent or an ongoing outage should include all three conta cts. -----------8/11/09 ----------ACF@0060 faid,there was no error in its log,it faild due to failure of job "Refr esh Collection Snapshots" error on this job was following :+---------------------------------------------------------------------------+ Start of log messages from FND_FILE +---------------------------------------------------------------------------+ The degree of parallelism for Refreshing snapshots is set to: 0 create_cto_item_demand: Begin CREATE_CTO_ITEM_DEMAND module... initialize_assignment_set: **Default assignment set is 23 initialize_assignment_set: Default assignment set name is HBC create_cto_item_demand: Before getting the instance id .. create_cto_item_demand: Instance_id = 1 create_cto_item_demand: Before deleting records from Bcod table.. create_cto_item_demand: Start looping thru oe_order_lines..... ORA-12034: materialized view log on "INV"."MTL_SYSTEM_ITEMS_B" younger than last refresh ORA-12034: materialized view log on "INV"."MTL_SYSTEM_ITEMS_B" younger than last refresh +---------------------------------------------------------------------------+ Action Taken(Resolution) 1)Submitted Refresh Collection Snapshots with Refresh mode=completed and refresh snapshot name=MTL_SYS_ITEMS_SN, it took around 30 mins. 2)Told operations to resubmit ACF@0060 it is planning data pull program. 03/01/10

acf@5100 -- resubmitted Request set name= 'Update Transfer Cost' Request got completed successfully but the error was in one of the chalid progra m --Update Standard Costs error :- "No open accounting period is available Cause: No open accounting period corresponding to the transaction date is avail able in your organization. Action: ing " Please open the appropriate accounting period in the Open Account

6/01/10 AP034 (AP034 - Cheque Remittance Detail I failed error : AOL@1805 Error in Cheque_Remittance_Detail procedure: ORA-06502: PL/SQL: numeric or value error: number precision too large -----ACF@0020 Job has failed. Start. Concurrent Program: Launch Supply Chain Planning Process It has completed Error. Child Job must be failed. Checking the failed Jobs with the following Query. Note:- Data is the current date given for the issue. select * from fnd_amp_requests_v where (APPLICATION_NAME = 'Oracle Advanced Supply Chain Planning' or APPLICATION_NAME ='Oracle Master Scheduling/MRP' ) and REQUESTED_START_DATE > '21-Jan-2010' --and program='Planning ODS Load' order by request_id desc We found couple of Jobs failed. This Job Usually take time to complete. --------Checked the Error Message for the chided Programs like Memory-Based Snapshot Worker

Memory-Based Snapshot etc. Got the following Error Message. APP-MRP-22075: An internal error has occurred (mrnspgmsg, 1, 53881629, ) @ERRORTEXT Cause: The current routine encountered the specifie d@ERRORTEXT x Action: Contact your customer supportrepresentative. APP-MRP-22075: An internal error has occurred (main, 58, 6, ) @ERRORTEXT Cause: The current routine encountered the specifie d@ERRORTEXT x Action: Contact your customer supportrepresentative. ---------ACF@0020 Job has failed. Ended. ---------------------------05-03-2010 COL@BI01 FAILED JOB THAT PROCESSES/LOADS DATA FROM PVCS INTO COFI DAILY RUNS FOUR TIMES --- ERROR HAPPENED DUE TO INTG REFRESH ---JOB FORCE COMPLETED------ CONTACT SANDRA FOR URGENT HELP ----------------------------------05-03-2010 ACF@7320 COFI NOTIFY SALES ASSOCIATES REPORT -SNAPSHOT TOO OLD ERROR RESUBMIT IT AND IT WILL WORK FINE. IF NOT, CONTACT DBA FOR FURTHER ASSISTANCE. ------------------------------------------08-03-2010 ACF@0058 XYCOFI EXECUTE PROGRAMFAILED DUE TO SNAPSHOT TOO OLD ERROR. RESUBMIT WILL WORK OUT. -----------------------------------------AOL@3901 MAINFRAME FINANCE JOB ASK OPERATIONS TO CALL ANDY AND LOOK INTO ISSUE -------------------------------------------

AOL@AP08 TAKE THE CONC REQUEST AND CHECK THE LOG. YOU WILL GET A FILE NAME. SEARCH FOR THE SAME FILE NAME IN CCFINP03 SERVER : /FIN502/bad folder. you will see the same file name with '0' bytes size. RENAME/DELETE the file. ASK OPERATIONS TO RERUN THE JOB> -------------------------------------------ACF@7325 21APR COFI SALES ASSOCIATE PENDING NOTIFICATIONS NOT A CRITICAL JOB. CAN BE FORCE-COMPLETED FOR THAT DAY. ----------------------------------------------------