Kan Ch 7 Steve Chenoweth, RHIT

Slides:



Advertisements
Similar presentations
Time to failure Probability, Survival,  the Hazard rate, and the Conditional Failure Probability.
Advertisements

Introduction to modelling extremes
Sample size estimation
Reliability Engineering (Rekayasa Keandalan)
1 Defect Removal Effectiveness Kan ch 6 Steve Chenoweth, RHIT Left – Some defects are easier to remove than others. This is the cruise ship Costa Concordia,
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
1 In-Process Metrics for Software Testing Kan Ch 10 Steve Chenoweth, RHIT Left – In materials testing, the goal always is to break it! That’s how you know.
1 Exponential Distribution and Reliability Growth Models Kan Ch 8 Steve Chenoweth, RHIT Right: Wait – I always thought “exponential growth” was like this!
Stats for Engineers Lecture 11. Acceptance Sampling Summary One stage plan: can use table to find number of samples and criterion Two stage plan: more.
Probability distribution functions Normal distribution Lognormal distribution Mean, median and mode Tails Extreme value distributions.
©GoldSim Technology Group LLC., 2004 Probabilistic Simulation “Uncertainty is a sign of humility, and humility is just the ability or the willingness to.
Time-Dependent Failure Models
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Today Today: Chapter 5 Reading: –Chapter 5 (not 5.12) –Suggested problems: 5.1, 5.2, 5.3, 5.15, 5.25, 5.33, 5.38, 5.47, 5.53, 5.62.
Swami NatarajanJune 17, 2015 RIT Software Engineering Reliability Engineering.
SE 450 Software Processes & Product Metrics Reliability Engineering.
BCOR 1020 Business Statistics
Copyright 2007 Koren & Krishna, Morgan-Kaufman Part.2.1 FAULT TOLERANT SYSTEMS Part 2 – Canonical.
Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics IEEE Trans on PAMI, VOL. 25, NO.9, 2003 Kyong Chang, Kevin W. Bowyer,
Probability Distributions Random Variables: Finite and Continuous Distribution Functions Expected value April 3 – 10, 2003.
Market Risk VaR: Historical Simulation Approach
Probability Review (many slides from Octavia Camps)
1 Software Quality Metrics Ch 4 in Kan Steve Chenoweth, RHIT What do you measure?
Sequence comparison: Significance of similarity scores Genome 559: Introduction to Statistical and Computational Genomics Prof. James H. Thomas.
Week 51 Relation between Binomial and Poisson Distributions Binomial distribution Model for number of success in n trails where P(success in any one trail)
1 Quality Management Models Kan Ch 9 Steve Chenoweth, RHIT Right – To keep in mind – For Kan, this is part of Total Quality Management.
1 2. Reliability measures Objectives: Learn how to quantify reliability of a system Understand and learn how to compute the following measures –Reliability.
Quantitative Business Analysis for Decision Making Multiple Linear RegressionAnalysis.
Review of normal distribution. Exercise Solution.
S Neuendorf 2004 Prediction of Software Defects SASQAG March 2004 by Steve Neuendorf.
Objectives of Multiple Regression
Pop Quiz How does fix response time and fix quality impact Customer Satisfaction? What is a Risk Exposure calculation? What’s a Scatter Diagram and why.
INFO 631 Prof. Glenn Booker Week 2 – Reliability Models and Customer Satisfaction 1INFO631 Week 2.
1 Measurement Theory Ch 3 in Kan Steve Chenoweth, RHIT.
Probability distribution functions
Math 647 March 18 & 20, Probability Probability: Probability: Probability of exceedance: Pr[ X > x ] or Pr [X x ] or Pr [X < x ] Relative frequency/proportions:
Chapter 5 Statistical Models in Simulation
Ch4: 4.3The Normal distribution 4.4The Exponential Distribution.
Estimation Bias, Standard Error and Sampling Distribution Estimation Bias, Standard Error and Sampling Distribution Topic 9.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. 1 PROBABILITIES FOR CONTINUOUS RANDOM VARIABLES THE NORMAL DISTRIBUTION CHAPTER 8_B.
PARAMETRIC STATISTICAL INFERENCE
1 POP Quiz T/F Defect Removal Effectiveness and Defect Removal Models are not true Predictive Models Define DRE What is a Checklist? What is it for? What.
1 The Do’s and Don’ts of Software Process Improvement Steve Chenoweth, RHIT.
Biostatistics Case Studies 2007 Peter D. Christenson Biostatistician Session 3: Incomplete Data in Longitudinal Studies.
1 Pop Quiz What is an Orthogonal Defect? Which is more precise: predictive models or management models? Why? Essay: Why are metrics and models an important.
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
Chapter 12 Continuous Random Variables and their Probability Distributions.
Analysis Overheads1 Analyzing Heterogeneous Distributions: Multiple Regression Analysis Analog to the ANOVA is restricted to a single categorical between.
Fault-Tolerant Computing Systems #4 Reliability and Availability
Random Variable The outcome of an experiment need not be a number, for example, the outcome when a coin is tossed can be 'heads' or 'tails'. However, we.
Inference: Probabilities and Distributions Feb , 2012.
Statistics What is the probability that 7 heads will be observed in 10 tosses of a fair coin? This is a ________ problem. Have probabilities on a fundamental.
Review Normal Distributions –Draw a picture. –Convert to standard normal (if necessary) –Use the binomial tables to look up the value. –In the case of.
Ch8.2 Ch8.2 Population Mean Test Case I: A Normal Population With Known Null hypothesis: Test statistic value: Alternative Hypothesis Rejection Region.
1 Software Quality Engineering. 2 Quality Management Models –Tools for helping to monitor and manage the quality of software when it is under development.
Random Variables. Numerical Outcomes Consider associating a numerical value with each sample point in a sample space. (1,1) (1,2) (1,3) (1,4) (1,5) (1,6)
Lecture PowerPoint Slides Basic Practice of Statistics 7 th Edition.
AP Statistics.  If our data comes from a simple random sample (SRS) and the sample size is sufficiently large, then we know that the sampling distribution.
Confidence Intervals Chapter 6. § 6.1 Confidence Intervals for the Mean (Large Samples)
Mean and Variance for Continuous R.V.s. Expected Value, E(Y) For a continuous random variable Y, define the expected value of Y as Note this parallels.
Part.2.1 In The Name of GOD FAULT TOLERANT SYSTEMS Part 2 – Canonical Structures Chapter 2 – Hardware Fault Tolerance.
Chapter 4 Continuous Random Variables and Probability Distributions
Ch4.2 Cumulative Distribution Functions
Estimating µ When σ is Known
Statistics Lecture 12.
Volume 111, Issue 2, Pages (July 2016)
Estimating µ When σ is Known
Chapter 8: Estimating With Confidence
Copyright © 2015 Elsevier Inc. All rights reserved.
Presentation transcript:

Kan Ch 7 Steve Chenoweth, RHIT Left – Lord Rayleigh, pronounced like Riley. He was a famous physicist who, among other things, discovered Argon and explained why the sky was blue. And, it still is! The Rayleigh Model Kan Ch 7 Steve Chenoweth, RHIT Image from http://en.wikipedia.org/wiki/John_William_Strutt,_3rd_Baron_Rayleigh

It’s a Weibull distribution… Used in physics: It’s “Rayleigh” when m = 2. Kan p 189

The Rayleigh Model is widely used Lots of applications other than possibly the distribution of software bugs. E.g., it’s what you get when two uncorrelated random variables combine. See http://en.wikipedia.org/wiki/Rayleigh_distribution m = 2 Big batch of Weibulls Probability density function (PDF) Cumulative distribution function (CDF)

So, for Rayleigh… We have this, Where t = time and c = the “scale parameter,” and is a function of tm, the time at which the curve reaches its peak. (Set the derivative of f(t) = 0 to get: Kan p 189

For software Projects follow a life-cycle pattern described by the Rayleigh density curve. Used for: Staffing estimation over time Defect removal pattern – expected latent defects Kan p 191

IBM AS/400 Kan p 192

Assumes… Defect removal effectiveness remains relatively unchanged. Then – Higher defect rates in development are indicative of higher error injection, and It is likely that the field defect rate will also be higher. Given the same error injection rate, if more defects are discovered and removed earlier, fewer will remain in later stages. Then – Field quality will be better. Kan pp 192-3

Kan studied this A formal hypothesis-testing study, based on component data of the AS/400. Strongly supported his first assumption. Found proving the second assumption trickier. Kan pp 194-5

Implementation Kan says it’s “not difficult.” Adds elsewhere, “if you have an SAS expert handy.” If defect data (counts or rates) are reliable, Model parameters can be derived, then Just substitute data values into the model. Also built into software tools like SLIM (see p 200). Kan pp 195+

Kan’s example with STEER Kan p 202

Reliability Can judge by testing “confidence interval.” Which relates to sample size. Kan recommends – use multiple models, to cross-check results. Kan p 203

Validity Depends heavily on “data quality” Which is notoriously low related to software Usually better at back-end (testing) And, “Model estimates and actual outcomes must be compared and empirical validity must be established.” In our current state of the art, validity and reliability are “context specific.” Kan p 203

In Kan’s study… Kan pp 204-5 Rayleigh underestimated the tail!