1. XDR Consulting Managing the Testing Process in an Open Source Environment Xavier Drozdzynski (XDR Consulting) Testing in OSS environment ? Software qualification approach Managing the test process using TestOpia TestOpia Enhancement Q&A Héphaïstos ConferenceParis, November 2006

2. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 2 Linus Torvalds : "Having enough eyes, all bugs seem shallow" OSS for Open Source Software  OSS projects are used in real industrial projects  OSS projects are used in Customer Oriented projects  OSS projects are used in End User Oriented projects  OSS projects are used in « Business Critical» projects  Many OSS projects have only a few contributors (Open Cemetery, how many hackers want to jump right into that code ? well some, but...) Testing in OSS environment ? What for ?

3. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 3 Software qualification approach Learning from traditional environment, ad hoc software development Software qualification project  Strategy / Structure / Culture  Process / People / Tools  Portfolio / Program / Project

4. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 4 Software qualification approach Qualification Approach based on : Risk / Functional / Customer / Chance EVALUATION Perform the Execution Amend change EXECUTION Carry out the plan Support and assist the team CONCEPTION Launching the project Analyse - Audit / Diagnostic First recommendations  Action PLAN BRING THE CHANGE PROJECT MANAGEMENT

5. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 5 Qualification Tools :  Load Performance tool : Open Sta, Stress Test,  Network analyser : Ethereal  Testing tool : WebInject, Jamelon, Sahi, Avignon.  Software management : Track+, OneOrZero, TestLink, QaTrack, Blitz, TestRunner, TestTopia  Version Management : CVS  Bug tracking : bugtracker, bugzilla,  Code analyser : windows leaks, WET, Flawfinder, BFBTester,  Data management : Dbmonster,  Data generator : Yagg, RecordEditor  Budget Management : Time Accounting Management Software  Planification Management : Open Gantt.  Dashboard / reporting : Pentaho  Document management : knowledge tree Software qualification approach

6. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 6  Software qualification approach Simple process Requirement / Test Plan / default tracking Reporting, dashboard, quality metrics  Tools : a perfect world Ready to use product or development ToolKit  What is the reality of tools Software qualification approach

7. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 7 TestOpia, “The place where test are happy”  Why TestOpia Based on Mozilla / Bugzilla Community  Description of main module Test Plan Execution Bug Tracking  Miscellaneous Ergonomy Support Reporting Managing the test process with TestOpia

8. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 8  Test Plan TEST PLAN Workflow Test case Action / Expected result Attributes requirement (edit field) category (type of) Component / tab (impact reference) Attachment Managing the test process with TestOpia

9. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 9 Case run Manual run Automated (ref to, parameters) work flow process( idle / passed / failed / running / paused / blocked) based on attributes build / product bug attached Managing the test process with TestOpia

10. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 10  Bug Tracking Bugzilla attributes flag / keyword product / os / version priority / status / dependency Managing the test process with TestOpia

11. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 11  Miscellaneous Blue print hyper link clone Tag / Build / Build coverage Reporting to be improved Managing the test process with TestOpia

12. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 12  TestOpia enhancement : Reporting, Dashboard, quality metrics Requirement Management Planification Customisation of the tools Be included in a Forge TestOpia Enhancement

13. XDR Consulting Héphaïstos Conférence Paris, November 2006 – XDR Consulting – Software Quality Page 13 And welcome to the TestOpia Demo Thank you for your attention Questions ? Contacts : Xavier Drozdzynski xavierd@xdr.biz www.xdr.biz (Q4 FY2006) Questions and Answers