GSJGD

Agenda Review of what we delivered in Visual Studio enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing Enhancements in Lab Management

Agenda Review of what we delivered in Visual Studio enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing Enhancements in Lab Management

The Agile Workflow

Why - Exploratory testing Enables focusing customer value rather than spec compliance Free Testers from up front planning and find bugs fast and early without overhead Focuses on working software!

Exploratory testing – myths 1.Exploratory testing is ad-hoc, random testing 2.There is no way to measure exploratory testing 3.Bugs found through exploratory testing are hard to repro

Using “Testing Tours” to put a method to the madness Guidebook tour Back alley tour Supermodel tour You can make up your own… Dogfood IDC NAR

Sample tours – how we did it The Reflex tour – tests responsiveness of the IDE The Idiot tour – tests F1 inline help on each element The Palatial tour – tests our multi monitors experience The Footprint tour – tests virtual memory usage The Budget tour – tests experience on a low end machine Dogfood IDC NAR

Measuring exploratory testing Right metrics are like a fingerprint of your team: no silver bullet Distinguish between app quality metrics and metrics that direct exploratory testing

Metrics – how we did it Code coverage across tours Story complexity to bugs ratio Session duration for stories Session roll up per tour

Heat maps – how we did it

Finding reproducible bugs

Rich bugs – how we did it Automatic repro steps Screenshots Desktop recording System information Intellitrace logs

Test documentation – how we did it Test cases automatically created while doing exploratory testing Can save artifacts from exploration like expected image With each sprint, regression suites are automatically ready

Agenda Review of what we delivered in Visual Studio enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing Enhancements in Lab Management

Use physical infrastructure Zero Configuration Support for clustered Hyper-V hosts Scale to 1000’s of VMs Scale by cloning VMs via Network Isolation New Environment viewer Deploy using deployment scripts Full support SCVMM 2012

Q&A Please fill the feedback forms!