1. Creating Quality Web Systems
Robert Sabourin
President
AmiBug.Com, Inc.
Montreal, Canada
April 21, 2019
© Robert Sabourin, 2001

2. Creating Quality Web Systems
Overview:
Introduction
Fundamental Question
Defintions and some Wisdom from the ages
Reality – Like a Big Ship
Government On-Line
People, training getting back to basics
April 21, 2019
© Robert Sabourin, 2001

3. Just In Time Testing Testing Turbulent Web Based Applications
Robert Sabourin , Software Evangelist
President
AmiBug.Com Inc.
Montreal, Quebec, Canada
April 21, 2019
© Robert Sabourin, 2001

4. AmiBug.Com, Inc. Software Development & SQA Consulting Services
Training, Coaching and Professional Development
Light Effective Process
Team Building and Organization
We help people to get things done!
April 21, 2019
© Robert Sabourin, 2001

5. I am a Bug In the style of a children's book.
Robert & Catherine Sabourin
ISBN:
In the style of a children's book.
Explains elements of software
development process in a fun easy
to read format.
April 21, 2019
© Robert Sabourin, 2001

6. Finished? How do you know you are finished? April 21, 2019
© Robert Sabourin, 2001

7. Crosby on Quality “Quality is defined as conformance to requirements”
“Quality is not a measure of GOODNESS”
Phil B. Crosby, Quality is Free
April 21, 2019
© Robert Sabourin, 2001

8. Deming Quality approach (PDCA)
Plan, Do Check, and Act:
Plan what you want to implement.
Do the pilot implementation.
Check the results of the pilot.
Act on the results by tweaking the process before the next project.
April 21, 2019
© Robert Sabourin, 2001

9. Edsger W. Dijkstra
“Program testing can be used to show the presence of bugs, but never to show their absence”
April 21, 2019
© Robert Sabourin, 2001

10. Ken Blanchard “Feedback is the breakfast of champions!” April 21, 2019
© Robert Sabourin, 2001

11. "No! Try not, Do. Or do not. There is no try."
April 21, 2019
© Robert Sabourin, 2001

12. Philosophy We have precious little time to run tests!
We must always be prepared!
April 21, 2019
© Robert Sabourin, 2001

13. Time
April 21, 2019
© Robert Sabourin, 2001

14. Getting Things Done Development BUG REQ FLOW FLOW Release Cycle
- Who manages them?
- How are they prioritized?
- Where can I find them?
- Are the communicated?
- Do they get reprioritized?
- Are business drivers known?
- Are technical risks known?
Getting Things Done
Development
BUG
FLOW
REQ
FLOW
- Are builds delivered?
- Where do developers work?
- Configuration management?
- Source control? Baseline?
- Transition? Periodic?
- Smoke tests?
- Owners:Dev IT DBA SQA?
- Who manages them?
- What are they?
- Where can I find them?
- When are they updated?
- Why are they changing?
- How are they evolving?
- Do we observe turbulence?
Release
Cycle
April 21, 2019
© Robert Sabourin, 2001

15. Getting Things Done Concern Being Prepared! - Information Flow
Corporate information Key business drivers Sales Market Finance
- Technology Flow
Architecture Technology churn Tools Techniques Training
- Requirement Flow
Defined Understood Interrupt Poll Prioritize Turbulence Status Truffle
- Bug Flow
Defined Understood Business Technical Efficient Expedient Reassess
- Test Objectives
Quality Factors Technical Risk Failure Modes Importance
- Test Strategy
Plan Analytic Exploratory Checklists Parallel Chunking Scenarios Data
- Test Organization
Scheduling Staffing Outsourcing Contractors Students
- Testing Lab
Multi-tier Server Client Platforms Swap Pattern Synchronized
- Test Status
Bug charts Test Plan Elaboration Status Pass Fail Execution Status
April 21, 2019
© Robert Sabourin, 2001

16. Spreading Effort Across Test Objectives
Reality of all testing activities
Amplified on Web Applications
How do you cover risks?
April 21, 2019
© Robert Sabourin, 2001

17. About Bugs Bugs are not Good or Bad April 21, 2019
© Robert Sabourin, 2001

18. About Bugs Some bugs are important and have a high priority!
April 21, 2019
© Robert Sabourin, 2001

19. About Bugs Some bugs are dangerous and have a high severity!
April 21, 2019
© Robert Sabourin, 2001

20. Bug Quadrants
April 21, 2019
© Robert Sabourin, 2001

21. You know you are finished when (a perspective)…
… the only bugs left are the ones that Project Stakeholders agree are acceptable (based on objective SQA input) ...
April 21, 2019
© Robert Sabourin, 2001

22. You know you are finished when …
… the only bugs left are the ones that Project Stakeholders agree are acceptable (based on objective SQA input) …
At least for now!
April 21, 2019
© Robert Sabourin, 2001

23. The Ferbec Allegoric Web Quality
April 21, 2019
© Robert Sabourin, 2001

24. Does it scale? …
April 21, 2019
© Robert Sabourin, 2001

25. Power – Scale! …
April 21, 2019
© Robert Sabourin, 2001

26. Measures Metrics Innovation …
April 21, 2019
© Robert Sabourin, 2001

27. Blend of technologies …
April 21, 2019
© Robert Sabourin, 2001

28. Government On-Line Canada
“By 2004, Canadians will be able to request and receive all key federal services through secure, interactive and timely on-line transactions.”
April 21, 2019
© Robert Sabourin, 2001

29. Government On-Line Training Observed Q3+Q4-2001 and Q1-2002
High percentage of students are experienced testers moving to GOL applications from Client Server or Mainframe applications
High percentage have never used basic testing techniques such as:
Equivalence Partitioning
Boundary Analysis
State Modeling
Analytic Methods
Any Code Coverage Techniques
High percentage have never read more than one book about testing
High percentage have never attended a course or conference about SQA or Testing or Software Engineering
… but they all are enthusiastic and want to learn!
April 21, 2019
© Robert Sabourin, 2001

30. What is needed! Training Get back to basics!
Testing 101 courses and books all over the place
Practical books
Awareness of the many wonderful methods and techniques available in an objective and open minded approach
Encourage a foundation in fundamentals before overly skill based approaches
April 21, 2019
© Robert Sabourin, 2001

31. Creating Quality Web Systems
Conclusion:
Empower the team with relevant knowledge of business drivers and technical risks
Focus on Fundamental Questions
We are in the change business, things will change, it’s a fact!
Tools and technologies evolve
Ensure teams are well grounded in fundamentals
Ensure teams have a Swiss army knife of methods and techniques
Encourage flexibility, adapt, be context sensitive
Different strokes for different folks apply situational techniques
April 21, 2019
© Robert Sabourin, 2001

32. Testing Web and E-Commerce Applications
It’s all about people! (and the occasional bug too)
April 21, 2019
© Robert Sabourin, 2001

33. Thank You
Questions?
April 21, 2019
© Robert Sabourin, 2001