 |
dplmetrics Version 1.3 Build 675 run start time Mon Apr 09 19:43:00 2009
(c) 2007-2008 ZDS LLC (www.ezds.com)
-------------------------------------------------------------------------------------------------
OPTIONS
LOGPATH : c:\PPM Deploy Metrics\Samples
PROCESS : All
DISPLAY : Off
PERIOD : From: January 2008 (2008 1) To: December 2008 (2008 12)
-------------------------------------------------------------------------------------------------
PARAMETERS (dplmetrics.ini)
Discard Test Packages=
Skip Custom Percentage=60%
Skip Standard Percentage=40%
Max File Size=430000
Suppress Missing Package Warnings=Y
Suppress Zero Lines on Errors By Reason Report=Y
Output Successful Migrations=Y
Fully Qualified Output Directory Path=C:\PPM Deploy Metrics
[Type Chart]
Title=Top 10 PPM Migration Error Types
Period Unit=Month
ListTop=10
ListPct=80
WidthPx=700
HeightPx=350
|
The program records ID and run start up information, the command line options you supplied, and the parameters you chose in the dplmetrics.ini configuration file.
|
 |
-------------------------------------------------------------------------------------------------
PACKAGE+LINE+STEP+ENV MIGRATIONS January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Custom
Succeeded PPM s s DPM Agree. 63975 95.31%
Succeeded PPM s > s DPM Agree. Forcing had no effect. 0 0.00%
Succeeded PPM f s DPM Disagree. Check orange errors. 0 0.00%
Succeeded PPM f > s DPM Disagree. Forced into success count. 7 0.01%
Custom Succeeded 63982 95.32%
Failed PPM f f DPM Agree. 1863 2.78%
Failed PPM f > f DPM Agree. Forcing had no effect. 678 1.01%
Failed PPM s f DPM Disagree. Check orange errors. 25 0.04%
Failed PPM s > f DPM Disagree. Forced into failure count. 34 0.05%
Custom Failed 2600 3.87%
Custom Not Attempted Not included in ERRORS BY reports. 539 0.80%
Total Custom 67121
Standard
Succeeded PPM s s DPM Agree. 22020 95.14%
Succeeded PPM s > s DPM Agree. Forcing had no effect. 0 0.00%
Succeeded PPM f s DPM Disagree. Check orange errors. 0 0.00%
Succeeded PPM f > s DPM Disagree. Forced into success count. 0 0.00%
Standard Succeeded 22020 95.14%
Failed PPM f f DPM Agree. 469 2.03%
Failed PPM f > f DPM Agree. Forcing had no effect. 447 1.93%
Failed PPM s f DPM Disagree. Check orange errors. 0 0.00%
Failed PPM s > f DPM Disagree. Forced into failure count. 201 0.87%
Standard Failed 1117 4.83%
Standard Not Attempted Not included in ERRORS BY reports. 8 0.03%
Total Standard 23145
|
This is the key report. It gives you a precise measure of your PPM Deploy service levels.
You cannot manage what you cannot measure. For the first time, Deploy Metrics gives you the ability to manage the migration process against quantitative service level targets.
To improve your current service levels you need to identify the root causes of the errors that contributed to the failure counts.
The next reports help you to understand this.
As you drill down through successive layers of detail you build an action plan to eliminate or reduce the errors and improve your service levels.
|
 |
-------------------------------------------------------------------------------------------------
ERRORS BY TYPE January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Custom
DE Developer Error 916 35.23%
TO Timeout 651 25.04%
CR CRC Failure 402 15.46%
VC Starteam Errors 138 5.31%
FT File transfer 117 4.50%
DT Directory Tree 89 3.42%
SH SSH Errors 58 2.23%
KX Kintana Exit Status 58 2.23%
PW Passwords 47 1.81%
CS Command Script 46 1.77%
SP SQL*Plus error 43 1.65%
UC Unable to Connect 28 1.08%
SC Shell Command 2 0.08%
IP Insufficient Privileges 2 0.08%
LK Locked table or row 2 0.08%
F6 F60Gen error 1 0.04%
IE Internal Error 0 0.00%
KB Kintana Bug 0 0.00%
EN Environment 0 0.00%
PA Patch 0 0.00%
Total 2600
Standard
NL Log Not Available 648 58.01%
OM Object Migrator 201 17.99%
IM ITG Migrator 144 12.89%
DE Developer Error 44 3.94%
LK Locked table or row 34 3.04%
IE Internal Error 13 1.16%
CP Concurrent Program 11 0.98%
DT Directory Tree 10 0.90%
UC Unable to Connect 7 0.63%
TO Timeout 4 0.36%
PW Passwords 1 0.09%
RS Report Set 0 0.00%
IP Insufficient Privileges 0 0.00%
FT File Transfer 0 0.00%
XX Not Classified 0 0.00%
KB Kintana Bug 0 0.00%
Total 1117
|
The Custom Failed and Standard Failed totals listed in the MIGRATIONS section are now broken down to the broad error reason categories that contribute to them.
Deploy Metrics comes with pre-defined categories that you can add to or change to customize the package to your individual requirements.
This report provides the basis for your action plan.
Hitting just the top three categories will typically reduce errors by more than 80% and improve your service levels accordingly.
|
 |
-------------------------------------------------------------------------------------------------
ERRORS BY REASON January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Custom
TO Command(s) timed out... 632 24.31%
CR crc gen failed 390 15.00%
DE f ORA-00955: name is already used by an existing object 224 8.62%
DE f ORA-00942: table or view does not exist 198 7.62%
FT Source SCPClient:(b)Error: transfer failed(/b) 111 4.27%
VC Starteam [status aborted]: no such directory 104 4.00%
DT Command: [cd 75 2.88%
DE f ORA-02289: sequence does not exist 72 2.77%
DE f ORA-01418: specified index does not exist 49 1.88%
PW ORA-01017: invalid username/password; logon denied 47 1.81%
KX KSC_EXIT_STATUS 1 46 1.77%
CS (KNTA-10127) Unknown or out of sequence command: 46 1.77%
SP Command: [sqlplus 43 1.65%
DE ORA-00904: 35 1.35%
VC Starteam checkout error 304 file not archived 28 1.08%
DE PLS-00905: object 28 1.08%
SH All SSH authentication methods failed. Check the Key Ident 26 1.00%
SH ssh_exchange_identification: Connection closed by remote ho 26 1.00%
DE f protected, no changes were saved. 25 0.96%
UC ORA-01034: ORACLE not available 24 0.92%
DE PLS-00341: declaration 20 0.77%
DE f ORA-01434: private synonym to be dropped does not exist 20 0.77%
DE f PLS-00201: identifier 19 0.73%
TO ERROR: java.net.ConnectException: Connection timed out 19 0.73%
DE ORA-12003: materialized view 19 0.73%
DE PLS-00364: 18 0.69%
DE f unknown command beginning 17 0.65%
DE PLS-00320: the declaration of the type of this expression i 15 0.58%
DT Error: could not create directory on destination. 14 0.54%
DE f ORA-12006: a materialized view with the same user.name alre 13 0.50%
DE f ORA-00933: SQL command not properly ended 12 0.46%
CR crc mismatch 12 0.46%
DE f Warning: Package Body created with compilation errors. 12 0.46%
DE PLS-00103: Encountered the symbol 11 0.42%
DE f ORA-01720: grant option does not exist for 9 0.35%
KX KSC_EXIT_STATUS 2 9 0.35%
DE ORA-00907: missing right parenthesis 8 0.31%
DE PLS-00323: subprogram or cursor 7 0.27%
DE f ORA-00980: synonym translation is no longer valid 7 0.27%
DE ORA-04043: object 7 0.27%
SH bad permissions: ignore key: 6 0.23%
VC Starteam checkout error 270 6 0.23%
DE f ORA-01430: column being added already exists in table 6 0.23%
FT Source SCPClient:(b)Error: source file not found.(/b) 6 0.23%
DE f ORA-01917: user or role 6 0.23%
DE PLS-00302: component 5 0.19%
DE f Compilation errors have occurred. 5 0.19%
DE f ORA-01471: cannot create a synonym with same name as object 5 0.19%
DE ORA-00913: too many values 5 0.19%
DE PLS-00306: wrong number or types of arguments 4 0.15%
DE ORA-00936: missing expression 3 0.12%
DE ORA-00928: missing SELECT keyword 3 0.12%
DE ORA-00957: duplicate column name 3 0.12%
DE f ORA-01403: no data found 3 0.12%
KX KSC_EXIT_STATUS 3 3 0.12%
DE f ORA-01929: no privileges to GRANT 3 0.12%
DE SQL*Loader-601: For INSERT option, table must be empty. Er 3 0.12%
DE f ORA-01749: you may not GRANT/REVOKE privileges to/from your 2 0.08%
IP f ORA-01031: insufficient privileges 2 0.08%
UC java.sql.SQLException: Could not connect to the JDBC URL 2 0.08%
UC ORA-01033: ORACLE initialization or shutdown in progress 2 0.08%
DE ORA-00950: invalid DROP option 2 0.08%
DE PL/SQL ERROR 302 2 0.08%
DE ORA-00054: resource busy and acquire with NOWAIT specified 2 0.08%
DE ORA-02303: cannot drop or replace a type with type or table 2 0.08%
DE ORA-01735: invalid ALTER TABLE option 1 0.04%
DE f ORA-00972: identifier is too long 1 0.04%
SC Permission denied 1 0.04%
LK The row containing the token to be stored is locked and can 1 0.04%
DE ORA-00905: missing keyword 1 0.04%
DE ORA-00922: missing or invalid option 1 0.04%
SC pfksh: awk: not found 1 0.04%
LK ORA-04021: timeout occurred while waiting to lock object 1 0.04%
DE f ORA-01432: public synonym to be dropped does not exist 1 0.04%
DE f ORA-00001: unique constraint 1 0.04%
F6 PDE-PLI018 Could not find library 1 0.04%
DE javac: invalid argument: 1 0.04%
Total 2600
Standard
NL f Logfile not available on server 607 54.34%
OM MSG-00001: No objects were sucessfully migrated. 112 10.03%
IM No Mercury IT Governance objects matched the requested sear 73 6.54%
OM MSG-00001: Possible problem with database link definition. 72 6.45%
IM Import failed 68 6.09%
NL f Could not retrieve logfile 41 3.67%
LK ORA-02049: timeout: distributed transaction waiting for loc 33 2.95%
DE MSG-00001: You have not specified all the required paramete 21 1.88%
DE MSG-00001: The source and destination databases and value s 15 1.34%
IE A Mercury internal error has occurred. 13 1.16%
CP Error: Concurrent Program 11 0.98%
DT No such file or directory. 10 0.90%
UC Address already in use: connect 7 0.63%
OM ORA-12537: TNS:connection closed 6 0.54%
OM ORA-00001: unique constraint 4 0.36%
TO ORA-12170: TNS:Connect timeout occurred 4 0.36%
OM Unable to execute: ksc_om_migrate 3 0.27%
DE Error: Report Set 3 0.27%
DE ORA-01427: single-row subquery returns more than one row 3 0.27%
DE ORA-12899: value too large for column 2 0.18%
OM ORA-12541: TNS:no listener 2 0.18%
IM MIG_WF_STEPS_DONT_MATCH_FOR_STEPNAME 2 0.18%
OM ORA-02068: following severe error 2 0.18%
IM MIG_WF_STEPS_DONT_MATCH_FOR_SEQNUM 1 0.09%
LK ORA-00060: deadlock detected while waiting for resource 1 0.09%
PW ORA-01017: invalid username/password; logon denied 1 0.09%
Total 1117
|
This analysis ranks each error that occurred in the specified period from most to least frequent.
To get your service levels up you need to start at the top and work down to identify the root causes and fix the underlying problems.
Deploy Metrics generates an html file which enables you to do just that by indexing every error so that you can drill down into
each individual error log for a specific error.
|
 |
-------------------------------------------------------------------------------------------------
ERRORS BY OBJECT January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Custom s f f/s
Oracle SQL Script 30721 1999 76.88% 6.51%
Starteam File Migration 30509 378 14.54% 1.24%
Oracle Report 883 74 2.85% 8.38%
Command Scripts 941 58 2.23% 6.16%
Oracle Workflow 186 34 1.31% 18.28%
SQL Loader File 94 25 0.96% 26.60%
Application Load Libraries 159 13 0.50% 8.18%
Oracle Form 112 10 0.38% 8.93%
Template File Migration 354 6 0.23% 1.69%
R11 Oracle Patch EOESP1 17 2 0.08% 11.76%
Java Class File 6 1 0.04% 16.67%
Total 63982 2600
Standard s f f/s
AOL:Conc Prog 6123 367 32.86% 5.99%
AOL:Message Rel 11 6323 298 26.68% 4.71%
AOL:Value Set 3604 148 13.25% 4.11%
ITG Validation Migrator 831 76 6.80% 9.15%
AOL:Report Set Rel 11 384 64 5.73% 16.67%
ITG Workflow Migrator 259 42 3.76% 16.22%
AOL:Profile 382 22 1.97% 5.76%
AOL:QuickCode 1971 21 1.88% 1.07%
ITG Module Migrator 103 20 1.79% 19.42%
AOL:Single Report Group Unit 1366 17 1.52% 1.24%
ITG Portlet Definition Migrator 118 12 1.07% 10.17%
ITG Data Source Migrator 105 10 0.90% 9.52%
ITG Request Type Migrator 97 8 0.72% 8.25%
ITG Request Header Type Migrator 74 6 0.54% 8.11%
AOL:Report Group 44 4 0.36% 9.09%
AOL:Function 164 2 0.18% 1.22%
AOL:Desc Flex 0 0.00%
AOL:User 0 0.00%
AOL:Menu 0 0.00%
AOL:Help Text 0 0.00%
AOL:Single Report Group Unit 0 0.00%
AOL:Single GUI Menu Entry 0 0.00%
AOL:GUI Menu 10 0 0.00%
AOL:Resp 9 0 0.00%
AOL:Printer Def 35 0 0.00%
AOL:Single Conc Mgr Entry 0 0.00%
ITG Project Template Migrator 0 0.00%
AOL:FSG Set 0 0.00%
AOL:Folder 0 0.00%
ITG User Data Context Migrator 18 0 0.00%
AOL:Concurrent Manager Rel 11 0 0.00%
Total 22020 1117
ITG Module Migrator 0 0.00%
Total 22020 1117
|
The last analysis focuses on identifying the object types most subject to migration failures.
To a large degree this will follow the order of popularity of the object types you migrate.
However, all object types are not created equal.
Each contains different command code that may be handling error conditions more or less successfully.
The report shows in the last column the failure to success ratio.
A high ratio pinpoints an object for review to see if it's code is adapted to survive successfully in the environments it encounters during it's travels.
For example, just over a quarter of SQL Loader File migrations fail.
|
 |
-------------------------------------------------------------------------------------------------
PACKAGES January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Missing 321 43.03%
Test 0 0.00%
Processed 425 56.97%
Total Packages 746
Processed Out Of Period 53 12.47%
Processed In Period 372 87.53%
Processed Unable to Determine Period 0 0.00%
|
The packages report is the first in a group of audit reports.
For a complete analysis we want a complete set of package execution logs.
It is also a SOX requirement, as well as a basic audit trail requirement that the package execution logs that contain the history of your migrations not be deleted.
Deploy Metrics counts ( and also lists in the dplmetrics_rpts.html file) any missing package gaps found in the package number sequence for the specified period.
|
 |
-------------------------------------------------------------------------------------------------
FILES January 2008 - December 2008 Mon Apr 09 20:45:08 2009
PKG Files 425 0.22%
PKG_BID Files 36141 18.66%
CONC_REQ_LOGFILE Files 2027 1.05%
CONC_REQ_OUTFILE Files 1872 0.97%
PKG_PKGL_BID Files 68208 35.21%
PKG_PKGL_BID_ENV Files 85033 43.90%
Unknown File Types 4 0.00%
Files Traversed 193710
File Open Errors 0
File Size Errors 0
File Read Errors 0
File Field Errors 0
Files Discarded - Over Length 0
Files Discarded - Unknown Object Type 0
Files Discarded - Orphan Environment File 2
-------------------------------------------------------------------------------------------------
LOGS January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Logs Out of Period 644 0.41%
Logs In Period 154624 99.59%
Total Logs 155268
Logs Discarded - Unknown Log Type 0
Logs Discarded - Unknown Started Date 0
Logs Discarded - Env Link Parse Errors 0
Logs Discarded - CONC_REQ_LOGFILE 0
-------------------------------------------------------------------------------------------------
PROGRAM January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Maximum environment array count exceeded 0
Maximum CONC_REQ_FILE array count exceeded 0
CONC_REQ_LOGFILE entry not found 0
|
 |
-------------------------------------------------------------------------------------------------
THROUGHPUT January 2008 - December 2008 Mon Apr 09 20:45:08 2009
Run Time : 01:02:08
Files Traversed Count 193710
Files Per Hour 187,059
Files Traversed Bytes 2,806,434,902
Bytes Per Hour 2,710,076,400
Logs Read Count 155268
Logs Per Hour 149,936
Logs Read Bytes 1,183,578,148
Bytes Per Hour 1,142,938,800
Packages Processed Count 425
Packages Per Hour 410
|
The throughput section provides various metrics to help you estimate run times on your own logs.
Which metric is appropriate to your installation depends on whether you typically have packages with large or small numbers of lines
These figures were recorded on a Pentium IV laptop with a 3.2 Ghz processor.
|
PPM Project and Portfolio Management is a trademark of Hewlett Packard Corporation.