Welcome to the Ericsson journey towards an Agile WoW! 2011-04-08 Welcome to the Ericsson journey towards an Agile WoW! Authors: Anette Engbom Thomas Thunell Ludmila Ohlsson

Contents Background The Journey Test Infrastructure 2011-04-08 Contents Background The Journey Test Infrastructure Ericsson TTCN-3 Solution Conclusion

2011-04-08 Ericsson Ericsson is a world-leading provider of telecommunications equipment to both fixed and mobile networks. Fifth largest software company Headquarters: Stockholm, Sweden Employees: 90,500 (March, 2011)

2011-04-08 Background Ericsson is moving from Waterfall towards Agile way of working. Why? Products need to be delivered faster to the market We want to improve quality Cost reduction important What does it mean for testing? New ways of working High demand for Test Automation Quick iterations create new requirements on tools Will TTCN-3 work in Agile testing?

The Journey Strategy Analysis Evaluation Plan Execution Implementation Design

Strategy Identify your challenges Define: 2011-04-08 Strategy Identify your challenges Define: Test Strategy Tool Strategy Test Environment Strategy Outsourcing Strategy Point out your Processes & Methods

2011-04-08 Analysis Continuous discussion with customers, product management and teams Early prototyping Analysis on Tool and Test Environment requirements

Plan Define test scope Planning resources Identify testing risks 2011-04-08 Plan Define test scope Planning resources Identify testing risks Identified testing anatomy Identify features and functions Scheduling test

Design Explore automatic test design and test case generation 2011-04-08 Design Explore automatic test design and test case generation Frameworks that support fast test case generation Model Based Testing

Implementation and Preparation 2011-04-08 Implementation and Preparation Test Automation with TTCN-3 used to: Perform quality checks Launch and control other test equipment and tools Shorten preparation time for test activities

Execution Continuous integration Test Automation Test equipment usage 2011-04-08 Execution Continuous integration Test Automation Regression tests Smoke tests Test equipment usage Tools Stable and reliable Supportive in trouble shooting

Evaluation Test evaluation is usually very time consuming 2011-04-08 Evaluation Test evaluation is usually very time consuming Automatic log collection and processing Tools to support log analyzing Real time statistics generated from test tools Test reports

Community of Practice Test Infrastructure A working Test Infrastructure is necessary to enable our journey Community of Practice Tools Test Automation Dashboards Environment

2011-04-08 Tools Collaborative ALM (Application Lifecycle Management) is important Test Management and Test Automation Traffic generators “It took a while for the rest of the organization to realize that the new way of working had different requirements on the tool base we had”

Test Automation is more than tools 2011-04-08 Test Automation is more than tools Community Requirements Re-use Test Automation Framework SW developmentenvironment Test code Configuration Management Support Competence

Test Environment Test Environment is complex and the cost is very high 2011-04-08 Test Environment Test Environment is complex and the cost is very high Distributed labs across the whole world We need to control our lab utilization and usage

Test Dashboards Importance of measurements with introduction of Agile Dashboards as communication within teams Dashboard as message to Product Management Resource and risk handling Improvements

Ericsson TTCN-3 Solution 2011-04-08 Ericsson TTCN-3 Solution Aligned tools High need for test automation TTCN-3 environment to cover functional and load tests Agile way of working Decentralized teams Short sprints All test phases Strategies pointing at TTCN-3 Communities Of Practice Tool Reference groups, Area networks Common frameworks on TTCN-3 - Model Based Testing - Log analyzing support - Statistics

Conclusions from our Journey 2011-04-08 Conclusions from our Journey Quality in our products has improved Products are delivered faster to the market Cost is reduced Agile way of working is our way forward TTCN-3 fits well into the Agile way of working !!

Questions Optimizing across the value chain is fundamental to lean thinking. - Mary Poppendieck Communities of practice are groups of people who share a passion for something that they know how to do and who interact regularly to learn how to do it better.  - Etienne Wenger

2011-04-08