Adobe Quality Bands for Software Quality Measurement and Continuous Improvement Pooja, Lead Quality Engineer Nandan Jha, Senior Quality Engineering Manager Adobe Systems

Abstract Measuring software quality has always been a challenge and with enterprises having adopted agility in the project delivery and deployment, this has become all the more complex. The intent of the paper is to present a framework called Adobe Quality Bands which aims at defining a standard for product quality within segments. This is analogous to Stock market where we monitor market sentiment with technical and statistical methods. Sensex gives the sentiment of BSE. Adobe Quality Band (AQB) solves the problem of ‘Finding Benchmark’ in a system. For an enterprise, which is shipping numerous softwares, how do they arrive at a benchmark so that they can compare and improve. AQB solves this problem.

"What gets measured, gets managed." - Peter Drucker

Benchmarking

Problem Statement For large enterprises shipping multiple softwares, how do they arrive at a quality benchmark?

Analogous model

Problem Statement For large enterprises shipping multiple softwares, how do they arrive at a quality benchmark?

Adobe Quality Band

How are bands calculated?

Adobe Quality Band

Band Analysis P2- High% of withdrawn Bugs RCA of withdrawn bugs Duplicate bugs is the maximum contributor

Trend Analysis P1 +1% P2 -19% P3 +8% P4 +18% 2016 2015 Analysis: For P3 and P4, bugs went unnoticed due to issues with Jira search filters and had to be deferred. P1 +1% P2 -19% P3 +8% P4 +18%

Takeaways Quantifiable and actionable framework to measure software quality. Ease of adoption for other enterprises. Solves the problem of finding “benchmark” in a system. Enables SMART goal setting and measurably improve in the areas identified. "What gets measured, gets managed." - Peter Drucker

https://en.wikipedia.org/wiki/68–95–99.7_rule References & Appendix https://en.wikipedia.org/wiki/68–95–99.7_rule https://en.wikipedia.org/wiki/Standard_deviation http://www.statisticshowto.com/empirical-rule-2/ http://agilemanifesto.org/principles.html https://en.wikipedia.org/wiki/BSE_SENSEX https://www.appsruntheworld.com/top-10-enterprise-software- vendors-2016-market-overview-and-forecast/ http://www.investopedia.com/terms/f/freefloatmethodology.asp

Q&A

Author Biography Pooja: Pooja is a QE lead at Adobe with 7 years of experience in software testing and quality assurance. She is part of Globalization team and leading internalization and localization testing for Creative Cloud Mobile projects which include apps like PS Fix, PS Mix, Aviary, Creative Cloud etc. She is a certified scrum master and has been leading AQB initiative with Nandan in Adobe Globalization team. Nandan Jha: Nandan works with the Globalisation team at Adobe Systems and heads the International Quality Engineering (IQE) team for Adobe. IQE team is responsible for the testing of all localised release of all software products (100+) under the complete Adobe umbrella. He represents the software industry in "Uttar Pradesh Technical University, Board of Studies" (UPTU-BOS), a body of technical universities in the state of Uttar Pradesh, which evaluates and approves the syllabus for B.Tech (CS), B.Tech (IT) and MCA curricula.