Tom Quinn, Principal Consultant, CA technologies St Louis CMG August 23, 2011 St Louis

2 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —various definitions of apm —management vs monitoring —understanding your applications —business volume metrics vs system volume metrics —application performance budget —application performance monitoring agenda St Louis

3 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, application performance management vs application performance monitoring -application performance management refers to the processes and procedures used to ensure applications have and meet performance goals. application performance monitoring is a piece of this. -application performance monitoring refers to the use of tools to gather metrics, real time status, identification. this can be done throughout the software development lifecycle (sdlc) -performance falls under the ITIL discipline of Availability Management -In accordance with ITIL, the primary objective of the Availability Management process is to define, plan, evaluate and improve all aspects of the availability of IT services, establishing and maintaining them in compliance with agreed availability targets. These aspects include the people, process and technology factors of availability. 2 what is apm? 2 Availability Management: St Louis

apm toolspeopleprocessdata —apm: application performance management −the use of technology to initiate, deploy, monitor, fix, update and/or optimize systems within an organization. 1 −apm is more than end-user monitoring. it is a philosophy as much as a tool that spans across many areas. −today’s applications are complex and span platforms and teams, it’s important to understand all the pieces. 1. APM Best Practices. Sydor. CA Press 4Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 St Louis

5 levels of monitoring —monitoring occurs at various levels and by different audiences −end user experience what is your customer experiencing? −business transactions how are the individual business transactions performing? −architecture how are the systems performing for all things running on it? −software how are the individual components that make up the business transactions performing? Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 St Louis

6 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 A positive customer experience is your business lifeline. IT is critical to delivering a positive customer experience to drive revenue and growth. why do you need apm? St Louis

7 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 today’s applications are complex WAN/ WWW End User RouterFirewallSwitchWeb Servers Load Balancer Portal SAP Siebel Web Services 3 rd Party Applications Databases MAINFRAME PSFT NETWORK USER BACK END FRONT END MIDDLEWARE App Server CICS Datacom DB2 CTG IMS MQ z/OS today’s applications span platforms and teams, are self developed and vendor code. St Louis

who’s measuring the entire thing? 8Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 Web Server App Server MQ DB2 z/OS CICS End-User App 05:0006:00 07:0008:00 09:0010:00 11:0012:00 13:0014:00 15:0016:00 99% 99.9% % 99.9% ? % available Unavailable or Slow Available, Performant And no one is measuring the real customer experience… St Louis

Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, St Louis

10 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —business volume metrics (bvms) – the number of business transactions executed during a given time interval with peaks identified —system volume metrics (svms) – the number of system transactions executed on behalf of a business transaction —application performance budget – the resource constraints (response time, cpu, etc) for a given application and its components —critical path – the application path that is most used and provides the most business value —peak hour – identifying when system utilization is likely to spike based on higher business/transaction volume terminology St Louis

11 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 AP M System Analysis Design Developmen t Implementatio n ValidationEvaluation sdlc and performance —APM can be incorporated into all phases of the sdlc —get performance involved early and often —it is less expensive to fix problems early in the cycle – build a kayak! the later you discover these problems, the harder and more expensive they are to fix – the cruise ship. —build performance requirements into your project plans Performance gateway St Louis

12 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —the business defines what the problem is, in essence, what the application is to do —requirements are gathered −end user response time goals —business transactions are determined −ex: Balance Inquiry —business volume metrics are built system analysis St Louis

13 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —Build your application Business Volume Metrics (BVMs) −define the business transactions this application contains Balance Inquiry −Estimate how many times per day each business transaction will be invoked Balance Inquiry150,000 times per day −Estimate the transaction distribution and peak hour Balance Inquiry150,000 times per day 80% 7:00 am – 5:00 pm 120,000 or 12,000/hour Peak hour11:00 am – 12:00 pm50% increase 18,000/hr (11,334/hour) Business Volume Metrics (BVMs) St Louis

14 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —Classify your business transactions based on response time goals and importance −Tier 1: 0.0 – 3.0 seconds response time −Tier seconds response time −Tier 30.0 – 10 seconds response time —This is intended to help you determine priorities in your development and within your system −Tier 1 transactions get priority in your system Business Volume Metrics (BVMs) St Louis

15 design —Describes desired features and operations in detail, including screen layouts, business rules, process diagrams, pseudocode and other documentation. —performance management begins with application design. get involved early! —have baselines of the proposed architectures available to help in your decision making −data sources: own environment metrics, vendor metrics, industry experts —build the Application Performance Budget Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 St Louis

16 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —Application Performance Budgeting is an approach to ensure applications meet their response time objectives and proactively mitigate performance concerns at any phase – development, performance testing, production. —Always updating and validating —May assist in identifying performance bottlenecks and inefficiencies. —A Performance Budget breaks down a transaction to allow for the developer to code to requirements and enable operations to maintain the application and continue meeting design specifications. application performance budget St Louis

17 application design and the performance budget —identify the required pieces of the application before a single line of code is written −data sources and locations −security/authentication requirements −hardware hops —measure the infrastructure response times. before a single line of code is written, you know the fastest this application will ever run! Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 St Louis

18 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 build the application performance budget -start with what you know. use existing metrics, industry standards, vendor metrics -start by allocating time across the tiers for each transaction class to add up to the maximum response time. St Louis

19 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 populate the application performance budget Classcomponent nameTier# of execscpuresponse cumulative cpucumulative response Balance Inquiry1abcdclient defgmiddle wxyzdb mnopmiddle total application performance budgets can vary in information, look and feel, but the goal is the same – help develop well performing transaction that meet response time goals St Louis

20 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —make application performance testing a requirement —test at least your defined critical path —gather numbers to populate and validate the application performance budget —build the application monitoring in the test environment −build end to end dashboards performance testing St Louis

21 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —create a performance gateway where the performance team reviews the performance testing numbers and must sign off before the application can be implemented into your production environment. −this is the final opportunity to keep poor performing applications from being implemented into production −this also gives you an opportunity to acquire necessary capacity planning numbers implementation St Louis

22 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —once in production, capture performance data for these transactions and compare to your application performance budget and validate your model —if large discrepancies, look at why? −test infrastructure is too different than production −BVM’s are incorrect −database inefficiencies validation St Louis

23 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —can improvements be made? −can I tune the infrastructure? more cics or ims regions classify and group workload –horses, rabbits and elephants caching −can I tune the application? break transactions into multiple pieces verify database indexes are the same in production as tested against evaluation St Louis

24 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —implement the application dashboards built during performance testing into the production environment —compare performance test numbers to production numbers —set up thresholds and alerts based upon these numbers —publish performance goals for transactions −example: 95% of CICS transactions must be 0.5 seconds or less application performance monitoring St Louis

25 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —the earlier you get involved, the earlier performance problems can be identified and corrected —build in a performance gateway to approve or deny new and changed applications that will/will not perform —maintain application performance budgets for future development get engaged early and often St Louis

26 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 questions? St Louis

27 —Tom Quinn is a Principal Consultant, Mainframe Technical Sales at CA technologies responsible for mainframe performance monitoring products. Tom joined CA in 2009, bringing with him over 15 years of technical and leadership experience in Information Technology. Having worked for a large Mid-Western insurance company in mainframe system and application performance, Tom understands the technical challenges a large organization can face and utilizes his ITIL and ScrumMaster experience to discover and build customer solutions. You can reach him at or Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 St Louis

28 Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, 2011 —Kayaks and Cruise Ships – which would you rather turn around? Today’s applications are complex, and competition is a click away. Performance needs to be involved in every step of the application lifecycle, ensuring you’re building a kayak that can turn easily when nearing troubled waters. If you build a cruise ship, you can turn it, but it’s costly and slow. In this session you will learn about the concepts and techniques available to implement Application Performance Management in your shop. —Bulldozing the Bottleneck– the CA Solution : Do you know where your bottleneck is? How fast can you find the right one and then eliminate it? CA technologies’ Cross Enterprise APM solution helps you manage enterprise business applications, quickly pinpointing the problem and helping you resolve it. Work smarter by having the enterprise picture at your fingertips. abstract St Louis

or Tom Quinn Kayaks and Cruise Ships - Application Performance Management August 23, St Louis