Standalone Apps; Web Clients; Mobile Devices Client/Server Systems Online Services

−Standalone Apps; Web Clients −Response time, proc usage, memory footprint, disk I/O, etc. −Client/Server Systems −Resource utilization on both sides −Throughput, concurrency −Locking and deadlock issues −Server side reliability and uptime −Stress

−Online Services (Internet Apps) −Scalability −Resiliency −Peak load and large data volume −Unpredictable user patterns −Geo-distributed topology −Revenue impact −Quality of Service (QoS) −Quality of Experience (QoE)

TeamTest TargetDescription Office ServerOffice SharePoint Windows SharePoint Excel Server Perf and stress testing of Office Server System SQLSQL Reporting Services SQL BI Perf and Stress, benchmarking, sizing Dynamics AXDynamics 4.0Perf and Stress, benchmarking, sizing MSN/LiveAd Center Hot Mail Virtual Earth Autos March Madness Music More… High volume perf and stress testing GrooveOpen OfficePerf and Stress Testing DevDivTeam Foundation ServerPerf and Stress Test TFS MSITSAPLoad Test SAP via Web Services MSTVIPTV serversHuge tests to load test IPTV national rollout MS CRM Perf and Stress, benchmarking, sizing Microsoft.com Perf and Stress Testing Dr WatsonLog collection serversPerf and Stress Testing Windows UpdatePatch download serversPerf and Stress Testing Recent 12-hour production test: Total requests generated 3.63 Billion Average requests/sec 84,248 Recent 12-hour production test: Total requests generated 3.63 Billion Average requests/sec 84,248 Using Load Tests to validate IPTV pods Each services 100,000 customers Many major telecoms are customers: AT&T, Tel Italia, Bell Canada, more… Using Load Tests to validate IPTV pods Each services 100,000 customers Many major telecoms are customers: AT&T, Tel Italia, Bell Canada, more…

Small DB Expected Data Size Peak Data Size # Users Data Scale Target Layer Web App Database Unit Test Web Server Web App Database Web Test UI Action Layer Service API Web App Database Web App Database UI Test Manual Test Single User Typical Load Peak Load

Record through the browser Automatic parameter extraction Record and manage think times Set performance goals Data driven

Creating Web Performance Tests

Visual Studio Recorder Listener Internet Explorer Browser Control Wininet Shim Wininet Browser RecorderWininet Recorder Browser events Intercepts wininet calls Merging Recorder Record events Recorder BHO Visual Studio Launches Internet Explorer

Visual Studio Recorder Listener Record events Internet Explorer Browser Control Wininet Shim Wininet Browser Recorder Wininet Recorder Browser events Intercepts wininet calls Merging Recorder Record events Recorder BHO Visual Studio Launches Internet Explorer

Create load tests from automated UI testsExecute them locally, orDistribute them to generate large loadsCollect execution and performance dataInclude performance profiling

web server database server Microsoft Test Manager 2010 test controller Load agent Visual Studio

Executing & Analyzing Load Tests

Store and analyze test results Maintain historical information Create comparison and trend reports in Excel 26

Manual Testing Layer Diagram UML Modeling Load Test Testing 1 Web Performance Testing 1 Test Case Management IntelliTrace™ Architecture Explorer FFwd for Manual Test Logical Class Designer Test Manager Rich Actionable Bugs 1 Requires Visual Studio Load Test Virtual User Pack 2010 for 1000 Virtual Users or more load 1: Visual Studio 2010 Ultimate provides the ability to create unlimited number of Virtual Users

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows 7 and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.