04b | Manage Test Execution (2 of 2) Steven Borg | Co-founder & Strategist, Northwest Cadence Anthony Borton | ALM Consultant, Enhance ALM

Run Tests Perform Exploratory Testing Manage Bugs Use Lab Center Analyze Recommended Tests Perform Analysis Manage Work Items Module Overview

Microsoft Virtual Academy Manage Bugs

What the Study Guide says… Manage bugs –tracking bug metrics (bug trends, status) –verifying bugs (create Test from bugs) –analyzing bug reports –managing bug workflow

DEMO Microsoft Virtual Academy Manage Bugs

Microsoft Virtual Academy Use Lab Center

What the Study Guide says… Use Lab Center –creating new environments –creating copies of environments –running Tests on remote environments –executing Test Case in a Lab Center Environment

Software testing with Visual Studio

Lab management automation

Create a new environment using virtual machine templates in SCVMM Create an environment using machines running on SCVMM Create new environments on existing machines

Quickly choose multiple test suites to run after deployment Choose your environment, and build, deploy and test in that environment from a single dialog

Snapshot environments during manual testing to increase reproducibility Spin up virtual test environments from within Test Manager, or attach a virtual environment to a manual testing session

Test run results are attached to specific builds and environments Collect all the data required to recreate bugs from virtual environments

Create a new environment using virtual machine templates in SCVMM Create an environment using machines running on SCVMM Create new environments on existing machines

Quickly choose multiple test suites to run after deployment Choose your environment, and build, deploy and test in that environment from a single dialog

Snapshot environments during manual testing to increase reproducibility Spin up virtual test environments from within Test Manager, or attach a virtual environment to a manual testing session

Test run results are attached to specific builds and environments Collect all the data required to recreate bugs from virtual environments

DEMO Microsoft Virtual Academy Use Lab Center

Microsoft Virtual Academy Analyze Recommended Tests

What the Study Guide says… Analyze Recommended Tests –selecting the build in use –comparing the current build to a previous build –viewing Recommended Tests –analyzing related Work Items

DEMO Microsoft Virtual Academy Analyze Recommended Tests

Microsoft Virtual Academy Perform Analysis

What the Study Guide says… Perform analysis –analyzing reports (Requirements-User Stories) –analyzing by Test Suite –analyzing by configuration –identifying areas where quality is low –identifying Test Plan status

Software testing with Visual Studio

Monitoring Quality Metrics Actionable feedback Exploratory testing Requirements management Acceptance criteria definition Developer testing Build automation Actionable diagnostics Test planning and management Test execution and defect reporting Lab management Production monitoring Integrated incident management Quality metrics and reporting Role tailored tools feed data to transparent quality reports Data Warehouse Stories Overview Test Failure Analysis Bug Reactivation Bug Trends Custom SSRS/SSIS Pre-built and fully customizable cross project reporting

Filters allow you to control which builds you see View the test and code coverage results for each build to determine quality

Line-by-line highlighting illustrates which code is covered, uncovered, or partially covered by test Results show which methods are covered by test and total coverage is indicated by a percentage

Track total percentage hours completed by user story View real-time status of each user story Test results quickly display quality status of each user story Track active and resolved bugs by user story

Actionable feedback Exploratory testing Requirements management Acceptance criteria definition Developer testing Build automation Actionable diagnostics Test planning and management Test execution and defect reporting Lab management Production monitoring Integrated incident management Quality metrics and reporting Role tailored tools feed data to transparent quality reports Data Warehouse Stories Overview Test Failure Analysis Bug Reactivation Bug Trends Custom SSRS/SSIS Pre-built and fully customizable cross project reporting

Business challenges Comprehensive data exists but is not actionable Modern quality demands are overwhelming, don’t know how to get started Still in reactive mode Solutions Create reports containing accurate, actionable, real- time data from all team roles Identify key quality trends, opportunities, and risks Prioritize metrics for team attention and track improvements over time Business value Out-of-box reports save time, provide deep insight Teams focus on incrementally adopting new quality practices Overall app quality, team performance, and user satisfaction increase

Filters allow you to control which builds you see View the test and code coverage results for each build to determine quality

Line-by-line highlighting illustrates which code is covered, uncovered, or partially covered by test Results show which methods are covered by test and total coverage is indicated by a percentage

Track total percentage hours completed by user story View real-time status of each user story Test results quickly display quality status of each user story Track active and resolved bugs by user story

DEMO Microsoft Virtual Academy Perform Analysis

Microsoft Virtual Academy Manage Work Items

What the Study Guide says… Manage Work Items –validating requirements –Work Item relationships (eg, what it means when a test case is associated with a requirement) –creating Work Item queries –performing bulk updates in Microsoft Excel

DEMO Microsoft Virtual Academy Manage Work Items

Become very familiar with work items, work item queries, and how work items are related Understand the lifecycle of a bug and its associated test case Know what Excel reports are available for each process template Know what SSRS reports are available for each process template Understand the basics of the Lab Center tab, including environments and an overview of Lab Management

©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.