Measuring Success How to use simple bug database queries and reports

Slides:



Advertisements
Similar presentations
Metrics and Databases for Agile Software Development Projects David I. Heimann IEEE Boston Reliability Society April 14, 2010.
Advertisements

Configuration Management
S-Curves & the Zero Bug Bounce:
Software Testing How has agile changed the game? Karen Greaves.
Process Database and Process Capability Baseline
Test Execution and Defect management. 2 Module Objectives Introduction to Test Execution Checklist of Test Execution Defect management Defect Classification.
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
Stoimen Stoimenov QA Engineer SitefinityLeads, SitefinityTeam6 Telerik QA Academy Telerik QA Academy.
1 Software Architecture CSSE 477: Week 5, Day 1 Statistical Modeling to Achieve Maintainability Steve Chenoweth Office Phone: (812) Cell: (937)
Software Quality Metrics
CMPUT Software QualityMajor Software Strategies - 1 © Paul Sorenson MAJOR SW STRATEGIES BASED HEAVILY ON ROBERT GRADY'S BOOK “Practical Software.
COMP2002 Lecturecopyright DMU 2001 COMP2002 Quality Basics.
Testing Metrics Software Reliability
I n t e g r i t y - S e r v i c e - E x c e l l e n c e Business & Enterprise Systems Introduction to Hewlett Packard (HP) Application Lifecycle Management.
How we build Redfin.com Matt Goyer Lead Product Manager.
Software Process and Product Metrics
Personal Software Process Software Quality CIS 376 Bruce R. Maxim UM-Dearborn.
JIRA Defect Tracking Tool Tool to Record, Track and Resolve Issues, Bugs, Defects, Improvements and New Feature Requests LIGO-G M.
Class Agenda – 10/24/2013 Recap Access part of the class. Learning objectives and methods for Excel part of class. Demonstrate using Lynda.com for extra.
Software Reliability Growth. Three Questions Frequently Asked Just Prior to Release 1.Is this version of software ready for release (however “ready” is.
The Frogs Lesson Using the available data to gain information A resource from CensusAtSchool
Spreadsheets Chapter 7. Objectives Define and describe spreadsheets, and their features and functions Describe how a spreadsheet might be integrated into.
Validation Metrics. Metrics are Needed to Answer the Following Questions How much time is required to find bugs, fix them, and verify that they are fixed?
© 2013 IBM Corporation Defect Analytics Marist/IBM Joint Studies Michael Gildein 09 June 2014.
The Joel Test 12 Steps to Better Code. Readings The Joel Test (by Joel Spolsky) 043.html.
Tracking The Problem  By Aaron Jackson. What’s a Problem?  A suspicious or unwanted behavior in a program  Not all problems are errors as some perceived.
CS4723 Software Validation and Quality Assurance Lecture 15 Advanced Topics Test Plans and Management.
Chapter 6 : Software Metrics
Software Test Metrics When you can measure what you are speaking about and express it in numbers, you know something about it; but when you cannot measure,
Test Metrics. Metrics Framework “Lord Kelvin, a renowned British physicist, is reputed to have said: ‘When you can measure what you are speaking about,
Top Down View of Estimation Test Managers Forum 25 th April 2007.
Software Quality Metrics
QUALITY ASSURANCE PRACTICES. Quality Plan Prepared and approved at the beginning of project Soft filing system approach followed. Filing location – –
Test status report Test status report is important to track the important project issues, accomplishments of the projects, pending work and milestone analysis(
CSC 480 Software Engineering Test Planning. Test Cases and Test Plans A test case is an explicit set of instructions designed to detect a particular class.
Carnegie Mellon Software Engineering Institute © 2006 by Carnegie Mellon University Software Process Performance Measures James Over Software Engineering.
Hussein Alhashimi. “If you can’t measure it, you can’t manage it” Tom DeMarco,
Introduction to Bugzilla. May 12, 2011 What is Bugzilla? Bugzilla is a defect- or issue-tracking system Allows individual or groups of developers effectively.
Test Planning The purpose of test planning  The areas to consider in planning.
Statistics Unit Check your understanding…. Can you answer these? What does the standard deviation of a sample represent? What is the difference between.
Applied Software Project Management SOFTWARE TESTING Applied Software Project Management 1.
CSC 480 Software Engineering
Peter Varhol Solutions Evangelist
Configuration Management
Why Metrics in Software Testing?
The EMT Oliver Keeble, SA3 CERN.
Starting to use it with the ACM problems
NCCU CS碩專班 軟體工程專題 Lecture 10 May 10, 2012 © 2004 EVOLUTION.
Information Technology Service Availability Metrics
SEVERITY & PRIORITY RELATIONSHIP
Quality Assurance: Early Work Items
Configuration Management
Chapter 4 Software Process and Project Metrics
Software Reliability PPT BY:Dr. R. Mall 7/5/2018.
CPSC 873 John D. McGregor GQM.
MANAGING APPLICATION SECURITY
Project Estimation Estimation determines how much money, effort, resources, and time it will take to build a specific system or product The software team.
DQA Sprint Review September 4, 2012.
Applications of Data Mining in Software Engineering
DATA COLLECTION, MANAGEMENT AND ANALYSIS
PX-Web 2017 v1 and The situation at Statistics Sweden right now
DEFECT SEVERITY Fundamentals
Software metrics.
Spreadsheets, Modelling & Databases
Metrics for process and Projects
Project Name - Testing Iteration 1 UAT Kick-off
Project Timeline using Microsoft Project
6. Software Metrics.
7th Grade Computers.
Chapter 11 – Project Dashboard
Presentation transcript:

Measuring Success How to use simple bug database queries and reports Some frequently used project-level measurements

Measure vs. Metric Measurements are compiled in an electronic spreadsheet, a database, or by hand Number of defects Metric: A calculated or composite indicator based on two or more measures, or a quantified measure of the degree to which a system, component, or process possesses a given attribute

Measure vs. Metric Metric: "a composite of measures that yields systematic insight into the state of processes or products and drives appropriate actions" average number of bugs per tester per day number of bugs found per area of the software ratio of Severity 1 bugs to Severity 4 bugs

Metric and Statistics Using the Information in the Bug Tracking Database Test manager or project manager want answers to these questions what types of bugs you're finding? what your bug find rate is? how many of your bugs have been fixed ? Which software tester has entered the most bugs? What areas of the software have the most bugs? Show a list of all the open Priority 1 bugs Does the software look like it's on track to meet the scheduled release date?

Metric and Statistics Performing queries is a powerful feature of a bug-tracking database Producing different charts is another way of getting information

Common Project-Level Metrics Management is fundamentally interested in the overall view of the project Software quality and reliability level Project on track to be ready as scheduled

Common Project-Level Metrics Chart that shows a breakout of the bugs found, separated into the major functional areas of the software

Common Project-Level Metrics

Common Project-Level Metrics