1. 04b | Manage Test Execution (2 of 2) Steven Borg | Co-founder & Strategist, Northwest Cadence Anthony Borton | ALM Consultant, Enhance ALM

2. Run Tests Perform Exploratory Testing Manage Bugs Use Lab Center Analyze Recommended Tests Perform Analysis Manage Work Items Module Overview

3. Microsoft Virtual Academy Manage Bugs

4. What the Study Guide says… Manage bugs –tracking bug metrics (bug trends, status) –verifying bugs (create Test from bugs) –analyzing bug reports –managing bug workflow

5. DEMO Microsoft Virtual Academy Manage Bugs

6. Microsoft Virtual Academy Use Lab Center

7. What the Study Guide says… Use Lab Center –creating new environments –creating copies of environments –running Tests on remote environments –executing Test Case in a Lab Center Environment

8. Software testing with Visual Studio

9. Lab management automation

10. Create a new environment using virtual machine templates in SCVMM Create an environment using machines running on SCVMM Create new environments on existing machines

11. Quickly choose multiple test suites to run after deployment Choose your environment, and build, deploy and test in that environment from a single dialog

12. Snapshot environments during manual testing to increase reproducibility Spin up virtual test environments from within Test Manager, or attach a virtual environment to a manual testing session

13. Test run results are attached to specific builds and environments Collect all the data required to recreate bugs from virtual environments

16. Create a new environment using virtual machine templates in SCVMM Create an environment using machines running on SCVMM Create new environments on existing machines

17. Quickly choose multiple test suites to run after deployment Choose your environment, and build, deploy and test in that environment from a single dialog

18. Snapshot environments during manual testing to increase reproducibility Spin up virtual test environments from within Test Manager, or attach a virtual environment to a manual testing session

19. Test run results are attached to specific builds and environments Collect all the data required to recreate bugs from virtual environments

20. DEMO Microsoft Virtual Academy Use Lab Center

21. Microsoft Virtual Academy Analyze Recommended Tests

22. What the Study Guide says… Analyze Recommended Tests –selecting the build in use –comparing the current build to a previous build –viewing Recommended Tests –analyzing related Work Items

23. DEMO Microsoft Virtual Academy Analyze Recommended Tests

24. Microsoft Virtual Academy Perform Analysis

25. What the Study Guide says… Perform analysis –analyzing reports (Requirements-User Stories) –analyzing by Test Suite –analyzing by configuration –identifying areas where quality is low –identifying Test Plan status

26. Software testing with Visual Studio

27. Monitoring Quality Metrics Actionable feedback Exploratory testing Requirements management Acceptance criteria definition Developer testing Build automation Actionable diagnostics Test planning and management Test execution and defect reporting Lab management Production monitoring Integrated incident management Quality metrics and reporting Role tailored tools feed data to transparent quality reports Data Warehouse Stories Overview Test Failure Analysis Bug Reactivation Bug Trends Custom SSRS/SSIS Pre-built and fully customizable cross project reporting

28. Filters allow you to control which builds you see View the test and code coverage results for each build to determine quality

31. Line-by-line highlighting illustrates which code is covered, uncovered, or partially covered by test Results show which methods are covered by test and total coverage is indicated by a percentage

32. Track total percentage hours completed by user story View real-time status of each user story Test results quickly display quality status of each user story Track active and resolved bugs by user story

34. Actionable feedback Exploratory testing Requirements management Acceptance criteria definition Developer testing Build automation Actionable diagnostics Test planning and management Test execution and defect reporting Lab management Production monitoring Integrated incident management Quality metrics and reporting Role tailored tools feed data to transparent quality reports Data Warehouse Stories Overview Test Failure Analysis Bug Reactivation Bug Trends Custom SSRS/SSIS Pre-built and fully customizable cross project reporting

35. Business challenges Comprehensive data exists but is not actionable Modern quality demands are overwhelming, don’t know how to get started Still in reactive mode Solutions Create reports containing accurate, actionable, real- time data from all team roles Identify key quality trends, opportunities, and risks Prioritize metrics for team attention and track improvements over time Business value Out-of-box reports save time, provide deep insight Teams focus on incrementally adopting new quality practices Overall app quality, team performance, and user satisfaction increase

36. Filters allow you to control which builds you see View the test and code coverage results for each build to determine quality

39. Line-by-line highlighting illustrates which code is covered, uncovered, or partially covered by test Results show which methods are covered by test and total coverage is indicated by a percentage

40. Track total percentage hours completed by user story View real-time status of each user story Test results quickly display quality status of each user story Track active and resolved bugs by user story

42. DEMO Microsoft Virtual Academy Perform Analysis

43. Microsoft Virtual Academy Manage Work Items

44. What the Study Guide says… Manage Work Items –validating requirements –Work Item relationships (eg, what it means when a test case is associated with a requirement) –creating Work Item queries –performing bulk updates in Microsoft Excel

45. DEMO Microsoft Virtual Academy Manage Work Items

46. Become very familiar with work items, work item queries, and how work items are related Understand the lifecycle of a bug and its associated test case Know what Excel reports are available for each process template Know what SSRS reports are available for each process template Understand the basics of the Lab Center tab, including environments and an overview of Lab Management

47. ©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.