1. Software Testing with Microsoft Test Manager 2012 and Lab Management
4/19/2017 2:33 PM
DEV337
Software Testing with Microsoft Test Manager 2012 and Lab Management
Brian Keller
Sr. Technical Evangelist
Microsoft Corporation
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. I work here…

3. …on this…

4. …and this.

5. I blog here: http://blogs.msdn.com/briankel

7. Agenda Manual Testing Lab Management Tracking Quality
Formal Test Case Management
Exploratory Testing
Lab Management
Standard Environments
Build-Deploy-Test Workflows
Tracking Quality

8. USS Yorktown, SmartShip
crew member entered 0 in a data entry field, caused a “divide by 0” error that shut down propulsion
dead in the water for 2hrs 45mins

9. Ariane 5 Flight 501
re-used code from Ariane 4, but took a different flight path because of different booster design
conversation from 64bit float to 16bit signed int caused overflow (exception handler was disabled for perf reasons)
cost: > $ prices

10. Vasa sank after sailing less than 1 nautical mile out of Stockholm
specifications were faulty, failing to take into account enough ballast to keep the ship upright
test teams revealed that it was unstable, but launch was rushed, and QA was ignored

15. Climbing
Cost of Failure
Conditioning
Training
Training Phase

17. Release
Cost of Bugs
Test
Development
Software Phase

18. Tester Segmentation Generalist Specialist 70% of testing happens here
Manual Testing
Some scripting
Creates scripts to set up lab, create data
Strong scripting skills
Some coding skills
Strong coding
Develops automated testing procedures
Expert coding skills
70% of testing happens here
majority of test tools target here
Black Box Testing
White Box Testing
API Testing

19. What usually happens when a tester finds a bug?
Graphic by Jeff Atwood (CodingHorror.com)

20. Visual Studio

21. Microsoft Test Manager 2012
4/19/2017 2:33 PM
demo
Microsoft Test Manager 2012
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

22. Manual Testing Improvements
Exploratory Testing
Rich text test steps
HTML5 automation
Metro style application testing
Pass / Fail tests from Test Activity

25. 3rd Party Virtualization
Environments
SCVMM Environment
Standard Environment
Build-Deploy-Test
Snapshot / Restore
Share Bug Snapshots
Network Fencing
3rd Party Virtualization
Physical Machines

26. demo Lab Management 4/19/2017 2:33 PM
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

27. Lord Kelvin,
“…you cannot manage what you cannot measure.”

34. Go get started! Download the RC: www.microsoft.com/VisualStudio/11
TechEd 2012
4/19/2017 2:33 PM
Go get started!
Download the RC:
Download the ALM VM:
Ask the Experts, TLC area
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

35. tfspreview.com

36. Related Content Breakout Sessions DEV214
Introducing the New Visual Studio 2012 Unit Testing Experience
DEV344
Developer Collaboration with Team Foundation Server 2012
AAP309
Making Agile Estimation Work
DEV337
Software testing with Microsoft Test Manager 2012 and Lab Management
DEV317
Going Beyond F11: Debug Better and Faster with Visual Studio 2012
DEV340
Taking ALM to the Cloud with the Team Foundation Service
AAP313
Scrum Under a Waterfall
DEV362
From Development to Production: Optimizing for Continuous Delivery
DEV363
Dev-Ops Best Practices on the Microsoft Stack
DEV212
Implementing Scrum Using Team Foundation Server 2012

37. Related Content Breakout Sessions DEV346
All Aboard the Team Foundation Server Express
DEV217
Deep Dive into the Team Foundation Server 2012 Agile Planning Tools
DEV365
Advanced IntelliTrace in Production with Visual Studio 2012
DEV316
Application Lifecycle Management Tools for C++ in Visual Studio 2012
DEV343
Implementing Team Foundation Server in the Enterprise
DEV321
Continuous Feedback in Agile Teams
DEV243
Demystifying Team Foundation Server Builds
DEV411
Testing Un-testable Code with Fakes in Visual Studio 2012
DEV410
Deep Dive into Team Foundation Server 2012 Reporting
DEV412
Identify and Fix Performance Problems with Visual Studio 2012 Ultimate
DEV345
The Accidental Team Foundation Server Admin

38. Related Content Breakout Sessions
DEV318
Working on an Agile team with Visual Studio 2012 and Team Foundation Server 2012
DEV339
Metrics That Matter: Improving Lean and Agile, Kanban and Scrum
AAP204
Introduction to Kanban
Hands-on Labs (session codes and titles)
DEV11-HOL
Agile Project Management in Team Foundation Server 2012
DEV12-HOL
Build the Right Software and Collaborate Effectively Using Storyboarding and Feedback Tools in Visual Studio 2012
DEV13-HOL
Using IntelliTrace with Production Systems to Quickly Diagnose and Fix Issues
DEV16-HOL
Learn How Microsoft Test Manager 2012 Will Embrace an Exploratory Testing Approach
DEV17-HOL
Explore the New Unit Testing and Code Clone Capabilities of Visual Studio 2012
DEV19-HOL
Discover How the New Features of Team Foundation Server 2012 Can Improve Collaboration in Your Development Team

39. Resources Learning TechNet http://europe.msteched.com
Connect. Share. Discuss.
Microsoft Certification & Training Resources
TechNet
Resources for IT Professionals
Resources for Developers

40. Submit your evals online
4/19/2017 2:33 PM
Evaluations
Submit your evals online
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

41. 4/19/2017 2:33 PM
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

42. 4/19/2017 2:33 PM
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.