Test Process Improvement Asking the BIG questions? Graham Thomas 4 th Test Management Summit Institute of Directors 27 th January 2010

Abstract We all need to improve the testing process, but very few people actually answer the BIG questions, such as: Why? Is it just to save money, or do it quicker? How? Do we follow an accepted method – TPI, TMMI? What change methodologies are there that we can use? What? Is it just automating test execution. What about planning, preparation, measurement and metrics, etc.? Where and When? So where in our organisations, large and small, do we do this, and when is the best time? And Who? Is this just a testing team initiative? Do we need help? Who else is involved? It is easy to ask the BIG questions but what we really want to know are the answers! This session will work through these questions to draw useful conclusions from the group’s collective experience. 2© Graham Thomas 2010

“To find fault is easy; to do better may be difficult” Plutarch (c.46 AD – c.120 AD ) Greek / Roman - historian, biographer, essayist What did they know 2000 years ago that we don’t know now? 3

Why?  To save money  To do testing quicker (take less time)  More Efficient  More Effective  Achieve Best organisational benefit  Speed to Market  Improve our skills  And our market value  More satisfying  More rewarding 4© Graham Thomas 2010

Necker Cube © Graham Thomas 20105

Necker Cube  So what did you see ? Up and down ? Left to Right ? Switched from one to the other ? When did the switch happen ?  It is a simple 4 frame animation. There is no switch ! It is all in your brain ! © Graham Thomas 20106

How?  TPI and TMMi  Central Improvement team  Change Program  Change Models Kübler-Ross Gartner Hype Cycle Plan, Do, Check, Act There are others...  Continuous improvement vs. Capability Levels  Where does it end? 7© Graham Thomas 2010

What?  You have Quality Centre... What more can you want?  Tools, Process, Metrics, Investment, Training... To start with  Specific improvement measures, e.g. JAN Capability Level One Two Three Four Five Processes P1.1 P1.2 P1.3 P1.4 P1.5 P1.6 P1.7 P1.8 P1.9 P1.10 CapabilityAssessment 8© Graham Thomas 2010 JAN Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH FEB Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH MAR Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH APR Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH MAY Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH JUN Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH JUL Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH AUG Processes Strategy Approach Planning Execution Reporting Closure People AA AB CD CH FT JT SR SS ST TH

Where?, When?  Where:- Central Improvement Team (Centre of Excellence) Top Down – Imposition Team by Team Everyone of us  When:- As soon as we can The next new project A Program that is big enough (and important enough) to make a difference Does timing even matter? 9 Gall-Peters Projection Doomsday Clock – 11:54pm © Graham Thomas 2010

Who? “You must be the change you wish to see in the world” Mahatma Ghandi (1869 – 1948) CChange Agent Leadership Skilled & Experienced Understand the process of change Understand and deal with how people are affected by change 10© Graham Thomas 2010

Conclusions My personal change journey  Don’t forget to change the people as well as the processes  Change can be difficult and painful  Just because people say they want to change doesn’t mean they do  There are many ways to avoid change  Change is often uncomfortable  We look back fondly on the old ways, remembering them as better than they actually were!  Understand your capacity for change and don’t exceed it  Remember it is often the case that the processes you are changing were designed and built by the people you are changing! © Graham Thomas ManualAutomaticRoadRailLaptopNetbook

Contact Details Graham Thomas Independent Software Testing Consultant   © Graham Thomas 2010