2. Ahmed Salijee Developer Advisor http://dotnet.org.za/ahmeds ahmeds@microsoft.com DTL201

3. int Multiply(int a, int b) { return (a*b); } The extensive reviews and tests carried out during the Ariane 5 Development Programme did not include adequate analysis and testing of the inertial reference system or of the complete flight control system, which could have detected the potential failure. http://sunnyday.mit.edu/accidents/Ariane5acci dentreport.html

4. Can you relate TesterDeveloper

5. GeneralistSpecialist Manual TestingSome scripting Creates scripts to set up lab, create data Strong scripting skills Some coding skills Strong coding Develops fully automated testing procedures Expert coding skills Tester Segmentation Black Box Testing White Box Testing API Testing

6. VSTS 2010 Test Capabilities Coded UI Test Unit Testing Web Test Load Test Test Runner Test Case Management Virtual Lab Management Data Collectors (Historic Debugging, System Info.) Team Foundation Server with Reporting GeneralistSpecialist FF Manual Test

7. Today.. Coded UI Test Unit Testing Web Test Load Test Test Runner Test Case Management Virtual Lab Management Data Collectors (Historic Debugging, System Info.) Team Foundation Server with Reporting** GeneralistSpecialist FF Manual Test

8. Iteration N Sprint plan Write tests for US1 Write tests for US2 Sprint plan Build 1 Build 2 Build 3 Implement User Story ‘1’ (US1) Test US1 & file bugs Implement US2 Build 4 Fix bugs Build 6 Build 7 Regress impacted tests Build 5 Implement US2 Fix bugs Test US2 & file bugs Verify fixes Sprint planning: Move user stories from Product Backlog to Iteration Backlog – User Story #1: “As a I want to so that I can User Story #2: “As a I want to… Sprint planning: Move user stories from Product Backlog to Iteration Backlog – User Story #1: “As a I want to so that I can User Story #2: “As a I want to…

9. Play Back Test Case Create Test Plan (config etc) Run and Record Test Case Create Test Suite Run Test Case Create Test Case Connect to TFS Track Test Case Management Scenario Getting Started

10. The big picture

11. Getting Started – Test Case Management, Running your tests

12. Sprint plan Write tests for US1 Write tests for US2 Sprint plan Build 1 Build 2 Build 3 Implement User Story ‘1’ (US1) Test US1 & file bugs Build 4 Fix bugs Build 6 Build 7 Regress impacted tests Build 5 Implement US2 Fix bugs Test US2 & file bugs Verify fixes Sprint plan Write tests for US1 Sprint plan Build 1 Build 2 Build 3 Implement User Story ‘1’ (US1) Test US1 & file bugs MTLM provides rich tools for planning test coverage of requirements. MTLM helps testers understand what’s available with each build. Requirements Tasks Bugs MTLM helps testers understand what’s available with each build. Requirements Tasks Bugs Sprint plan Write tests for US1 Key Value: Requirements Planning Build 3 Implement User Story ‘1’ (US1) Test US1 & file bugs

13. Test Plans and TFS items Server TCM Server Plan “Iteration 2”  Suite US1  Suite US2 Test Case A Test Case B Test Case C Test Case D Plan “Iteration 2”  Suite US1  Suite US2 Test Case A Test Case B Test Case C Test Case D MTLM Client Plan “Iter 1” Plan “Iter 3” TFS User Story 2 Test Case A Test Case B Test Case C Task X Task Y Task Z Test Case C

14. Connect to TFS

15. Create a Test Plan

16. Define configurations for test plan

17. Setting the Plan Context

18. Creating your test suite

19. Adding Test Cases

20. Defining your test case

21. Assign testers/configs to test case

22. Executing your test case

23. Running your test

24. Test Playback

25. Playback a test

26. Preview a playback

27. Tracking your tests

28. Shared Steps and Parameters

29. Shared Steps

30. Parameters

31. Anatomy of a Test Case Test case fields – Title Priority, Area, Iteration, … Test case fields – Title Priority, Area, Iteration, … Tabs for linked items and other info. Steps tab includes – Action for each step Expected Results Attachments Steps tab includes – Action for each step Expected Results Attachments Parameterized Data A table of parameter values for iterated, data-driven testing. Parameterized Data A table of parameter values for iterated, data-driven testing. Shared Steps A common sequence of steps shared by multiple test cases. Shared Steps A common sequence of steps shared by multiple test cases.

32. Developer Codes Tasks, Fixes Bugs Checks In Developer Codes Tasks, Fixes Bugs Checks In Tester runs appropriate tests Build Kicked Off Tester updates test settings to collect data *** Developer Reviews WorkItems Reproducible Bug Scenario Tester Picks up New Build Tester Verifies/ Closes Bugs Tester Finds Bug Tester Logs/Updates “Rich Bug” Tester finds non reproducible big Tester Determines what test to run**

33. Rich Bugs

34. Sprint plan Write tests for US1 Write tests for US2 Sprint plan Build 1 Build 2 Build 3 Implement User Story ‘1’ (US1) Test US1 & file bugs Build 4 Fix bugs Build 6 Build 7 Regress impacted tests Build 5 Implement US2 Fix bugs Test US2 & file bugs Verify fixes Test US1 & file bugs Fix bugs Verify fixes Build 3 MTLM helps testers and devs tighten the bug loop. Testers file rich, easy-to-repro bugs Build 5 Testers quickly verify fixes by playing back a recording (ffwd) Fix bugs Test US1 & file bugs Build 5 Verify fixes Key Value: Virtuous Bug Cycle

35. Sprint plan Write tests for US1 Write tests for US2 Sprint plan Build 1 Build 2 Build 3 Implement User Story ‘1’ (US1) Test US1 & file bugs Build 4 Fix bugs Build 6 Build 7 Regress impacted tests Build 5 Implement US2 Fix bugs Test US2 & file bugs Verify fixes Key Value: Catch Regressions Build 3 Build 4 Build 6 Build 7 Build 5 Test US1 Code churn ??? Code churn ??? MTLM helps testers identify tests impacted by code churn ? ? ? ? Build 4 Build 6 Build 7 Build 5 Regress impacted tests ? ?

36. Assign Build to Test Plan

37. Build Integration

38. Collecting Data…

39. Determine recommended tests

40. Get Historical Debugging Info

41. Attach Information to Bug

42. Developer/Tester Integration

43. Verify Bug

44. Recap: What did we accomplish? Rich Bug Turned on rich data collectors Manually ran a test case - recorded our actions for future playback Filed a rich, easy-to-repro bug Took new build with the resolved bug Quickly verified the fix using playback Closed the bug Regress Impacted Tests Assigned a build to our test plan Ran some test and marked them ‘passed’ Checked-in churned code Assign the new build to our test plan Evaluated and reset tests impacted by code churn

45. Recap: What did we accomplish? Assigned a build to our test plan Ran some test and marked them ‘passed’ Checked-in churned code Assign the new build to our test plan Evaluated and reset tests impacted by code churn

46. Rich Bug Demo Recap Minimize “no repro” scenario Shorten the time from find to fix Improve productivity/quality Improve dev/test interaction

47. Managing Testing Recap Author and manage tests through plans, suites, and test cases Define testing matrix using configurations Control data collection via test settings Run tests via manual testing or automation Create rich bugs with nearly no overhead Fast-forward through tests to verify

48. Setup Environment (Agents and Controllers) Convert to Automated Define Automated Test Settings Run as part of Build Process Associate Test Settings and Build with Test Plan Manual Test Associate Automation with Test Case (Test/Lab Mgr) Moving to Automated Run Tests Track and Report Other Tests (eg Unit Tests)

49. Automated Testing

50. Creating a Coded UI Test

51. Coded UI Recorder

52. Coded UI – Add Assertions

53. Associate Coded UI with Test Case

54. Creating a Physical Test Environment aka Test Agents

55. Configure Test Settings Automation Indicate you want you want to run as automated (not manual) Associate Environment

56. Configure Test Plan to use Automated Tests Indicate on Test Plan the automated test settings to use

57. Running Automated Tests

58. Track Run

59. Automated Testing Recap Specialist testing experience Coded UI Test Type Generate tests using manual test recordings, direct recording or control map Create C# or VB.NET code Leverages test framework for data binding, data collection, test categories, etc. Leverage Team and Test Agents

60. Reporting Work Progress Product Quality Build Quality

61. Dashboard: Test Progress

62. Platform Support

63. VSTS 2010 Team Test Recap Rich bugs made easy Testers are first-class citizens of ALM Developers and Testers have tighter interaction Very easy to create robust automation and re-factor code Extensible platform

64. Resources http://dotnet.org.za/ahmeds Will post links, resources here http://blogs.msdn.com/mathew_aniyan http://blogs.msdn.com/amit_chatterjee http://blogs.msdn.com/vstsqualitytools http://msdn.microsoft.com/en- us/library/ms182409(VS.100).aspx

65. VSTS/SDLC Sessions at Teched TimeCodeTitle Monday 9:15DTL203What’s New in Team Foundation Server 2010? Monday 10:45DTL305Managing Releases Between Your Development and QA with Team System 2008 Monday 13:15DTL201Improve Application Quality with Microsoft Visual Studio Team System 2010 Team Test Monday 13:15OFC309Capacity Planning for SharePoint Server 2007 using Visual Studio 2008 Team Test Monday 15:45DPR201The Daily Scrum Monday 17:15DTL301Power Tools on Team Foundation Server 2008 Tues 8:00DTL205A Lap Around Team System 2010 Architecture Edition Tues 9:15DTL306Team Build Tips and Tricks Tues 12:00DTL313Using Virtualization to Improve Application Quality with Team System Lab Management Tues 13:15DTL210Managing Requirements with Team Foundation Server 2010 Tues 14:30WTB212How Microsoft and Others Use Team Foundation Server (whiteboard) Tues 16:15DTL202Team System 2010 Development Essentials Tues 16:15ARC203Application Lifecycle Maturity Wed 10:15DTL303Practical Web Testing

66. Required Slide Complete a session evaluation and enter to win! 10 pairs of MP3 sunglasses to be won

67. www.microsoft.com/teched Sessions On-Demand & Community http://microsoft.com/technet Resources for IT Professionals http://microsoft.com/msdn Resources for Developers www.microsoft.com/learning Microsoft Certification and Training Resources www.microsoft.com/learning Microsoft Certification & Training Resources Resources Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings at TechEd Online. Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings at TechEd Online.

68. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Required Slide