Creating Quality Web Systems Robert Sabourin President AmiBug.Com, Inc. Montreal, Canada rsabourin@amibug.com April 21, 2019 © Robert Sabourin, 2001

Creating Quality Web Systems Overview: Introduction Fundamental Question Defintions and some Wisdom from the ages Reality – Like a Big Ship Government On-Line People, training getting back to basics April 21, 2019 © Robert Sabourin, 2001

Just In Time Testing Testing Turbulent Web Based Applications Robert Sabourin , Software Evangelist President AmiBug.Com Inc. Montreal, Quebec, Canada rsabourin@amibug.com April 21, 2019 © Robert Sabourin, 2001

AmiBug.Com, Inc. Software Development & SQA Consulting Services Training, Coaching and Professional Development Light Effective Process Team Building and Organization We help people to get things done! April 21, 2019 © Robert Sabourin, 2001

I am a Bug In the style of a children's book. Robert & Catherine Sabourin ISBN: 0-9685774-0-7 www.amazon.com www.fatbrain.com In the style of a children's book. Explains elements of software development process in a fun easy to read format. April 21, 2019 © Robert Sabourin, 2001

Finished? How do you know you are finished? April 21, 2019 © Robert Sabourin, 2001

Crosby on Quality “Quality is defined as conformance to requirements” “Quality is not a measure of GOODNESS” Phil B. Crosby, Quality is Free April 21, 2019 © Robert Sabourin, 2001

Deming Quality approach (PDCA) Plan, Do Check, and Act: Plan what you want to implement. Do the pilot implementation. Check the results of the pilot. Act on the results by tweaking the process before the next project. April 21, 2019 © Robert Sabourin, 2001

Edsger W. Dijkstra “Program testing can be used to show the presence of bugs, but never to show their absence” April 21, 2019 © Robert Sabourin, 2001

Ken Blanchard “Feedback is the breakfast of champions!” April 21, 2019 © Robert Sabourin, 2001

"No! Try not, Do. Or do not. There is no try." April 21, 2019 © Robert Sabourin, 2001

Philosophy We have precious little time to run tests! We must always be prepared! April 21, 2019 © Robert Sabourin, 2001

Time April 21, 2019 © Robert Sabourin, 2001

Getting Things Done Development BUG REQ FLOW FLOW Release Cycle - Who manages them? - How are they prioritized? - Where can I find them? - Are the communicated? - Do they get reprioritized? - Are business drivers known? - Are technical risks known? Getting Things Done Development BUG FLOW REQ FLOW - Are builds delivered? - Where do developers work? - Configuration management? - Source control? Baseline? - Transition? Periodic? - Smoke tests? - Owners:Dev IT DBA SQA? - Who manages them? - What are they? - Where can I find them? - When are they updated? - Why are they changing? - How are they evolving? - Do we observe turbulence? Release Cycle April 21, 2019 © Robert Sabourin, 2001

Getting Things Done Concern Being Prepared! - Information Flow Corporate information Key business drivers Sales Market Finance - Technology Flow Architecture Technology churn Tools Techniques Training - Requirement Flow Defined Understood Interrupt Poll Prioritize Turbulence Status Truffle - Bug Flow Defined Understood Business Technical Efficient Expedient Reassess - Test Objectives Quality Factors Technical Risk Failure Modes Importance - Test Strategy Plan Analytic Exploratory Checklists Parallel Chunking Scenarios Data - Test Organization Scheduling Staffing Outsourcing Contractors Students - Testing Lab Multi-tier Server Client Platforms Swap Pattern Synchronized - Test Status Bug charts Test Plan Elaboration Status Pass Fail Execution Status April 21, 2019 © Robert Sabourin, 2001

Spreading Effort Across Test Objectives Reality of all testing activities Amplified on Web Applications How do you cover risks? April 21, 2019 © Robert Sabourin, 2001

About Bugs Bugs are not Good or Bad April 21, 2019 © Robert Sabourin, 2001

About Bugs Some bugs are important and have a high priority! April 21, 2019 © Robert Sabourin, 2001

About Bugs Some bugs are dangerous and have a high severity! April 21, 2019 © Robert Sabourin, 2001

Bug Quadrants April 21, 2019 © Robert Sabourin, 2001

You know you are finished when (a perspective)… … the only bugs left are the ones that Project Stakeholders agree are acceptable (based on objective SQA input) ... April 21, 2019 © Robert Sabourin, 2001

You know you are finished when … … the only bugs left are the ones that Project Stakeholders agree are acceptable (based on objective SQA input) … At least for now! April 21, 2019 © Robert Sabourin, 2001

The Ferbec Allegoric Web Quality April 21, 2019 © Robert Sabourin, 2001

Does it scale? … April 21, 2019 © Robert Sabourin, 2001

Power – Scale! … April 21, 2019 © Robert Sabourin, 2001

Measures Metrics Innovation … April 21, 2019 © Robert Sabourin, 2001

Blend of technologies … April 21, 2019 © Robert Sabourin, 2001

Government On-Line Canada “By 2004, Canadians will be able to request and receive all key federal services through secure, interactive and timely on-line transactions.” www.gol-ged.gc.cap April 21, 2019 © Robert Sabourin, 2001

Government On-Line Training Observed Q3+Q4-2001 and Q1-2002 High percentage of students are experienced testers moving to GOL applications from Client Server or Mainframe applications High percentage have never used basic testing techniques such as: Equivalence Partitioning Boundary Analysis State Modeling Analytic Methods Any Code Coverage Techniques High percentage have never read more than one book about testing High percentage have never attended a course or conference about SQA or Testing or Software Engineering … but they all are enthusiastic and want to learn! April 21, 2019 © Robert Sabourin, 2001

What is needed! Training Get back to basics! Testing 101 courses and books all over the place Practical books Awareness of the many wonderful methods and techniques available in an objective and open minded approach Encourage a foundation in fundamentals before overly skill based approaches April 21, 2019 © Robert Sabourin, 2001

Creating Quality Web Systems Conclusion: Empower the team with relevant knowledge of business drivers and technical risks Focus on Fundamental Questions We are in the change business, things will change, it’s a fact! Tools and technologies evolve Ensure teams are well grounded in fundamentals Ensure teams have a Swiss army knife of methods and techniques Encourage flexibility, adapt, be context sensitive Different strokes for different folks apply situational techniques April 21, 2019 © Robert Sabourin, 2001

Testing Web and E-Commerce Applications It’s all about people! (and the occasional bug too) April 21, 2019 © Robert Sabourin, 2001

Thank You Questions? April 21, 2019 © Robert Sabourin, 2001