Neelesh Kamkolkar Sr. Product Manager/Planner | Microsoft

Agenda 2

Visual Studio Team System

How Far Can We Get In The Available Time? Work planned Work completed

How Effectively Is Our (Outsourced) Team Delivering? Test rates (pass, inconclusive, fail) shown in bars Against code coverage, … code churn, … and active bugs

Supporting Heterogeneous Development Web Access Client for NON-development roles Eclipse integration as partner solution for heterogeneous environments

We Document For The Auditor …because there is a complete audit trail on all the tasks, code and tests… Capturing evidence does not have to be a manual process,...

Process Enacted By Tooling

Process Enacted In Cycles

Agenda 10

"Quotable Quotes" IT WORKS ON MY MACHINE!! IT’S A USER ERROR! DID YOU HAVE THE RIGHT BUILD? WHAT WERE YOU DOING? I CANNOT REPRO THE BUG!!!!

What if.. No walls between dev and test? Dev focus on writing code, test focus on comprehensive testing There is no bug ping pong? Teams can embrace change?

VSTS 2010 – What’s New, What’s Cool 13

Team Collaboration (Test/Dev/Project/Architect Asset Visibility) Team Collaboration (Test/Dev/Project/Architect Asset Visibility) Web Test Load Test Coded UI Test Unit Testing Reporting Development (Teams) Testing (Teams) Test Case Management Lab Management Microsoft Test Runner Capture & Replay Generalist Specialist Engineering Support Microsoft Test Offerings

Team Test Performance Testing Extensible performance solution that includes hot spot identification and analysis as well as rich Excel based analysis and reporting UI Test Automation UI automation framework that supports capture/replay as well as coded UI across multiple windows UI technologies including Web, Winform, and WPF Manual Testing Lightweight, efficient tooling to support manual testing with integrated capture/replay as well as rich bug filing Test Case Management Infrastructure to manage the testing effort and ultimately be able to answer the question “are we ready to ship” Test Execution The ability to execute tests locally and remotely, to collect detailed data during execution, enabling rich bugs to be filed Capabilities 17 Lab Management Manage Lab Environment Import, Delete, Update, Save Lab environments that include multiple lab systems created as virtual machines Role based access to environments Checkpoint & Reproduce Environments Ability to take checkpoints of lab environments and revert to them allowing teams to collaborate effectively in identifying and resolving bugs that are hard to recreate. Application Deployment Ability to automatically deploying applications in the lab environment allowing teams to effectively automate build verification tests and other activities requiring application deployments. Build Integration Workflow Ability to create work flows for the build that enables lab environments to be automatically deployed when triggered during build.

Ensure Complete Testing Quality is Transparent Explicitly plan the testing effort and monitor progress Link test cases and requirements for traceability Report on test authoring and execution progress Report on code metrics from the warehouse Find the Gaps Requirements that were missed Missing tests Missing configurations Code that was missed Test the Changes Test prioritization based on code and work item churn

Community Participation Virtual Team System User Group Radio TFS Team System blogs Channel 9 PDC VS2010 week