Geoff Thompson Experimentus Test Management Summit 30 th January 2008 Test Process Improvement and the Test Manager (An uncomfortable marriage?)

Agenda 1. Introduction 2. What is Test Process Improvement? 3. The issue 4. Discuss

Introduction

Experimentus  Is a leading specialist in Software Quality Management  Provides strategic consulting solutions aimed at optimising software quality processes and help organisation’s properly manage the integration, installation and performance of new and existing software applications  Has developed industry recognised Test Maturity Model (TMM) assessment method  Has delivery capabilities in:  Project Management  Requirements Management  Testing (both Non-Functional and Functional)  Configuration Management  Product Selection  Management Information and Training  Client base predominantly represents ‘blue chip’ corporations operating in the Finance, Professional Services, Media, Telecommunications and Technology sectors

What is Test Process Improvement?

“Continuous improvement of the quality, and the efficiency of the testing process, in the context of the total software process” InsightCoverage Product quality ControlPredictability….. CostsEffort Throughput time Early defects ….. TestabilityRequirements Project planning...

Examples of Test Process Improvement models  TMMi (Test Maturity Model)  CMMi (Capability Maturity Model)  TPI (Test Process Improvement)  CTP (Critical Test Process)  STEP (Systematic Test and Evaluation Process)

How many of you has managed or been involved in Test Process Improvement?

The Issue

 There is a stigma attached to Test Process Improvement  Its easy, isn't it, doesn’t need good project management skills!  Most seem to focus on detection rather than prevention activities  Focus on revolution rather than evolution – which delivers long term results  No metrics are recorded so no real value identified  Career limiting?  However it is one of the most effective solutions when an organisation does ‘poor testing’ isn’t it?

Case Study 1  Very experienced contract Test Manager – managed many multi million pound test projects to successful delivery for many blue chip companies – during the 90’s and early 2000’s  Identified many issues in that time that could have been resolved by implementing better and more repeatable processes  Decided in early 2003 to specialise in Test Process Improvement  Between 2003 and mid 2007 he implemented better process models into 3 major companies with over 200 test resources each  In 2007 decided he wanted to go back to Test Management  January 2008 still not employed, why…  TPI is seen as easier than delivery so with TPI on it, his CV is unusable for ‘real’ testing jobs

 Do you agree it is a worthwhile exercise?  Do you agree it is career limiting?  What do you think?

The good news  It is the first planned ISTQB (International Software Testing Qualification Board) Expert level syllabus  It is no longer the activity that gets stopped first when the pennies get short it is seen to add real value in mature organisations

Thank You Geoff Thompson