Optimizing Batch Job Performance Resources Consumed by Program I/O by Database File Name Delays Caused by Object Locks Heaviest Active Job Function Names.

Slides:



Advertisements
Similar presentations
An Introduction To Heritrix
Advertisements

DAT 342 Advanced SQL Server Performance and Tuning Bren Newman Program Manager SQL Server Development Microsoft Corporation.
Interprocess Communication
Copyright © 200\8 Quest Software High Performance PL/SQL Guy Harrison Chief Architect, Database Solutions.
Parasol Architecture A mild case of scary asynchronous system stuff.
Copyright © 2003, SAS Institute Inc. All rights reserved. Where's Waldo Uncovering Hard-to-Find Application Killers Claire Cates SAS Institute, Inc
DiskScope. Do you need DiskScope? Vanishing disk space ? Poor I/O performance ? No time to investigate ? No resources for solutions ? Don’t know when,
SOFTWARE PRESENTATION ODMS (OPEN SOURCE DOCUMENT MANAGEMENT SYSTEM)
4: Processes1 PROCESSES PROCESS CONCEPT: A program is passive; a process active. Attributes held by a process include hardware state, memory, CPU, progress.
Chapter 2: Processes Topics –Processes –Threads –Process Scheduling –Inter Process Communication (IPC) Reference: Operating Systems Design and Implementation.
Concurrent Processes Lecture 5. Introduction Modern operating systems can handle more than one process at a time System scheduler manages processes and.
What is SDM? SDM : Server and Database Monitoring  SDM is the web-based real-time server and database monitoring and reporting tool  Service Items Server.
Concurrency. What is Concurrency Ability to execute two operations at the same time Physical concurrency –multiple processors on the same machine –distributing.
CPU Scheduling. Schedulers Process migrates among several queues –Device queue, job queue, ready queue Scheduler selects a process to run from these queues.
Semaphores CSCI 444/544 Operating Systems Fall 2008.
1 Operating Systems Ch An Overview. Architecture of Computer Hardware and Systems Software Irv Englander, John Wiley, Bare Bones Computer.
Common Tuning Opportunities
Loupe /loop/ noun a magnifying glass used by jewelers to reveal flaws in gems. a logging and error management tool used by.NET teams to reveal flaws in.
SE Document Document Control Software. SE Document SE Document is a Document Management Software System to help you meet all document control requirements.
SAS: Managing Memory and Optimizing System Performance Jacek Czajkowski 09/29/2008.
Chapter 9 Overview  Reasons to monitor SQL Server  Performance Monitoring and Tuning  Tools for Monitoring SQL Server  Common Monitoring and Tuning.
Module 8: Monitoring SQL Server for Performance. Overview Why to Monitor SQL Server Performance Monitoring and Tuning Tools for Monitoring SQL Server.
Group 5 Alain J. Percial Paula A. Ortiz Francis X. Ruiz.
SERVICE BROKER. SQL Server Service Broker SQL Server Service Broker provides the SQL Server Database Engine native support for messaging and queuing applications.
© 2009 GroundWork Open Source, Inc. PROPRIETARY INFORMATION: Information contained herein is not for use or disclosure outside of GroundWork Open Source,
Page 1 © 2001 Hewlett-Packard Company Tools for Measuring System and Application Performance Introduction GlancePlus Introduction Glance Motif Glance Character.
Prof. Vishnuprasad Nagadevara Indian Institute of Management Bangalore
Portal and AQAS-Philadelphia University 21-22/6/2011 AVCI Platform in PU Dr. Abdel-Rahman Al-Qawasmi Philadelphia University Director of Computer Center.
Introduction to the Enterprise Library. Sounds familiar? Writing a component to encapsulate data access Building a component that allows you to log errors.
File Management Chapter 12. File Management File management system is considered part of the operating system Input to applications is by means of a file.
Introduction and simple using of Oracle Logistics Information System Yaxian Yao
Introduction Optimizing Application Performance with Pinpoint Accuracy What every IT Executive, Administrator & Developer Needs to Know.
AQS Web Quick Reference Guide Changing Raw Data Values Using Maintenance 1. From Main Menu, click Maintenance, Sample Values, Raw Data 2. Enter monitor.
1 I/O Management and Disk Scheduling Chapter Categories of I/O Devices Human readable Used to communicate with the user Printers Video display terminals.
Hardware Definitions –Port: Point of connection –Bus: Interface Daisy Chain (A=>B=>…=>X) Shared Direct Device Access –Controller: Device Electronics –Registers:
CS 153 Design of Operating Systems Spring 2015 Lecture 11: Scheduling & Deadlock.
Improving Efficiency of I/O Bound Systems More Memory, Better Caching Newer and Faster Disk Drives Set Object Access (SETOBJACC) Reorganize (RGZPFM) w/
Introduction Journal Analysis and Optimization Journaling Uses and Benefits Understanding Costs and Implications Ongoing Management and Administration.
Session objectives Discuss whether or not virtualization makes sense for Exchange 2013 Describe supportability of virtualization features Explain sizing.
Operating Systems Process Management.
Public vs. Private Public vs. Private Network?.
1 Scheduling The part of the OS that makes the choice of which process to run next is called the scheduler and the algorithm it uses is called the scheduling.
Computers Operating System Essentials. Operating Systems PROGRAM HARDWARE OPERATING SYSTEM.
Module 14 Monitoring and Optimizing SharePoint Performance.
Managing a MAPICS R7/R9 PowerLink Environment (704)
Introduction FREE Application Performance Analysis Workload Performance Series Software Software Installation Procedure Initial Performance Review Process.
Designing Applications for Performance Appropriate I/O for Specific Task Minimize all Initiation and Termination Design Everything to be “Interactive”
“Load Testing Early and Often” By Donald Doane Presentation to the Rockville MDCFUG.
CE Operating Systems Lecture 7 Threads & Introduction to CPU Scheduling.
Process Architecture Process Architecture - A portion of a program that can run independently of and concurrently with other portions of the program. Some.
Session #2 Session 23 Using the Quality Analysis Tool to Answer Your Institutional Verification Questions.
Interpreting DMV’s & practical uses Jannie Muller mullerjannie.wordpress.com.
Eliminate the Confusion Eliminate the Confusion!.
Processes. Process Concept Process Scheduling Operations on Processes Interprocess Communication Communication in Client-Server Systems.
Memory Management Program must be brought (from disk) into memory and placed within a process for it to be run Main memory and registers are only storage.
SAP Tuning 실무 SK㈜ ERP TFT.
Getting the Most out of Scientific Computing Resources
Getting the Most out of Scientific Computing Resources
Dan C. Marinescu Office: HEC 439 B. Office hours: M, Wd 3 – 4:30 PM.
Chapter 2: System Structures
Introduction of Week 3 Assignment Discussion
Operating System Concepts
Operating Systems Lecture 1.
General Functionality
Why Threads Are A Bad Idea (for most purposes)
Operating System , Fall 2000 EA101 W 9:00-10:00 F 9:00-11:00
Why Threads Are A Bad Idea (for most purposes)
Why Threads Are A Bad Idea (for most purposes)
Performance Tuning ETL Process
Chapter 13: I/O Systems “The two main jobs of a computer are I/O and [CPU] processing. In many cases, the main job is I/O, and the [CPU] processing is.
Presentation transcript:

Optimizing Batch Job Performance Resources Consumed by Program I/O by Database File Name Delays Caused by Object Locks Heaviest Active Job Function Names Record Lock Contention Time Spent on Job Status CPU by Line of Source Code Duration of ILE Modules Elapse Time by ILE Procedure Name

System Navigator Identify Job Level Bottleneck First!!

Workload Navigator Is the job CPU, Memory or I/O bound?

Resources Consumed by Program “Job” versus “Job Stream” Application or Operating System CPU, I/O, Memory, Elapse Time Date Routines, Tax Calculation Routine Imbedded SQL, High Initiation/Termination Stand-alone or Hundreds of Calls ILE w/ Many Modules versus OPM Program

Operating System Level

Application Level

I/O by Database File Name Compare Percent Reads to Writes/Updates Number of I/Os versus Records in File Small I/O Counts, Files Opening/Closing High Sequential Reads, Low Random Reads Time to Purge or Move Some Data? “Open Orders” File w/ 7 Years of Closed Proper Logical Views for Quick Access

I/O Example

Delays Caused by Object Locks Work Files that Should be in QTEMP Separate Data Libraries per Location? Hundreds of Jobs Daytime, One Job at Night Rare Situations Require Exclusive Locks! CPYF CRTFILE(*YES) vs. CRTDUPOBJ Fix the Job, Don’t Live w/ Consequences Older Code more Prone to Locking Issues

Lock Wait Job Status

Locks by Object Name

Heaviest Active Job Function Names Job Going In and Out of Short DLYJOBs Operating System Rebuilding Access Paths Job Copying Data with Selection Criteria

Job Function Example

Record Lock Contention Don’t Single Thread, Fear of Record Locks Not a Bigger Issue at Night versus Daytime Automatic Notification and Retry Monitor Time Spent in Lock Wait Status Release Records in Code if Causing Delays

Record Lock Example

Time Spent on Job Status Never Ending Job, Always in RUN Status? Nightly Job, not Always in RUN Status? DLYJOB used as Bad Timing Technique Object Locks for Long Periods of Time Short Object Locks, Thousands of Times Data Queue Wait that Never Waits! Job Waits on Message for Hours Nightly

Job Status Example

CPU by Line of Source Code Is There One Bad Line of Code? SETON LR at end of Date Routine CHAIN to CustMast for Every Line Item Open/Close 50 Files for Each Line Item OPNQRYFs are 73% of CPU and Elapse CALL to Tax Routine, 85% of Elapse Format Date Routine, 93% of Duration

Source Code Example

Duration of ILE Modules Complex ILE Bound Program Identify Specific Module Causing Delays Date Routines, Tax Calculation Routine Older Routines, Called for Every Line Item Outside Loop, Now that Impact is Known

ILE Modules Example

Elapse Time by ILE Procedure Name Identify High Use Subroutines Optimize Those Routines Minimize Calls to Intensive Routines Pinpoint Section of Code Needing Rework

ILE Procedure Name Example

Q&A To receive MB Software’s FREE performance evaluation: 1. Register at 2. Download and install software on AS/400 or iSeries 3. Call (800) to schedule your free performance review session What To Expect: After allowing performance data to accumulate for one full business day, you will log into a secure area of MB Software’s web site. We will then have a conference call to discuss our findings and how you can gain performance improvements with your existing applications. It’s that easy! Questions & Answers