What Does the Likelihood Principle Say About Statistical Process Control? Gemai Chen, University of Calgary Canada July 10, 2006.

Slides:



Advertisements
Similar presentations
Small differences. Two Proportion z-Interval and z-Tests.
Advertisements

Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 9 Inferences Based on Two Samples.
Statistics Review – Part II Topics: – Hypothesis Testing – Paired Tests – Tests of variability 1.
Is it statistically significant?
Review of the Basic Logic of NHST Significance tests are used to accept or reject the null hypothesis. This is done by studying the sampling distribution.
Likelihood ratio tests
Chapter 10: Sampling and Sampling Distributions
 Variable - a single quality characteristic that can be measured on a numerical scale.  When working with variables, we should monitor both the mean.
Chapter 4 Control Charts for Measurements with Subgrouping (for One Variable)
Copyright © Cengage Learning. All rights reserved. 9 Inferences Based on Two Samples.
originally developed by Walter A. Shewhart
QM Spring 2002 Business Statistics Introduction to Inference: Hypothesis Testing.
Software Quality Control Methods. Introduction Quality control methods have received a world wide surge of interest within the past couple of decades.
8-1 Quality Improvement and Statistics Definitions of Quality Quality means fitness for use - quality of design - quality of conformance Quality is.
Control Charts for Variables
Analysis of Variance Chapter 3Design & Analysis of Experiments 7E 2009 Montgomery 1.
Chapter 11 Multiple Regression.
Chapter 2 Simple Comparative Experiments
Sample Size Determination In the Context of Hypothesis Testing
Today Today: Chapter 8 Assignment: 5-R11, 5-R16, 6-3, 6-5, 8-2, 8-8 Recommended Questions: 6-1, 6-2, 6-4, , 8-3, 8-5, 8-7 Reading: –Sections 8.1,
Chapter 5 Continuous Random Variables and Probability Distributions
Chapter 11: Inference for Distributions
5-3 Inference on the Means of Two Populations, Variances Unknown
15 Statistical Quality Control CHAPTER OUTLINE
Chapter 51Introduction to Statistical Quality Control, 5th Edition by Douglas C. Montgomery. Copyright (c) 2005 John Wiley & Sons, Inc.
The Neymann-Pearson Lemma Suppose that the data x 1, …, x n has joint density function f(x 1, …, x n ;  ) where  is either  1 or  2. Let g(x 1, …,
Copyright © Cengage Learning. All rights reserved. 8 Tests of Hypotheses Based on a Single Sample.
Chapter 9.3 (323) A Test of the Mean of a Normal Distribution: Population Variance Unknown Given a random sample of n observations from a normal population.
Copyright © Cengage Learning. All rights reserved. 10 Inferences Involving Two Populations.
 Review homework Problems: Chapter 5 - 2, 8, 18, 19 and control chart handout  Process capability  Other variable control charts  Week 11 Assignment.
Statistical Analysis A Quick Overview. The Scientific Method Establishing a hypothesis (idea) Collecting evidence (often in the form of numerical data)
STA Lecture 161 STA 291 Lecture 16 Normal distributions: ( mean and SD ) use table or web page. The sampling distribution of and are both (approximately)
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Estimation Bias, Standard Error and Sampling Distribution Estimation Bias, Standard Error and Sampling Distribution Topic 9.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 9 Inferences Based on Two Samples.
Chapter 10 Quality Control.
 Review homework Problems: Chapter 5 - 2, 8, 18, 19 and control chart handout  Process capability  Other variable control charts  Week 11 Assignment.
1/23 Ch10 Nonparametric Tests. 2/23 Outline Introduction The sign test Rank-sum tests Tests of randomness The Kolmogorov-Smirnov and Anderson- Darling.
Copyright © Cengage Learning. All rights reserved. 14 Elements of Nonparametric Statistics.
Chapter 6. Control Charts for Variables. Subgroup Data with Unknown  and 
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
Math b (Discrete) Random Variables, Binomial Distribution.
STA Lecture 171 STA 291 Lecture 17 Chap. 10 Estimation – Estimating the Population Proportion p –We are not predicting the next outcome (which is.
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
Testing Differences between Means, continued Statistics for Political Science Levin and Fox Chapter Seven.
Hypothesis Testing Errors. Hypothesis Testing Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean.
Sampling and estimation Petter Mostad
Inferences Concerning Variances
Higher National Certificate in Engineering Unit 36 –Lesson 4 – Parameters used to Describe the Normal Distribution.
Copyright © Cengage Learning. All rights reserved. 15 Distribution-Free Procedures.
Confidence Interval Estimation For statistical inference in decision making: Chapter 9.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
1 Probability and Statistics Confidence Intervals.
Central Limit Theorem Let X 1, X 2, …, X n be n independent, identically distributed random variables with mean  and standard deviation . For large n:
Week 21 Order Statistics The order statistics of a set of random variables X 1, X 2,…, X n are the same random variables arranged in increasing order.
Les Jones IET 603. Shewhart Control Charts for: characteristics such as: length, width, temperature and volume. 1.Understand the statistical basis of.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Data Analysis. Qualitative vs. Quantitative Data collection methods can be roughly divided into two groups. It is essential to understand the difference.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Chapter 61Introduction to Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2012 John Wiley & Sons, Inc.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Construction Engineering 221 Probability and statistics Normal Distribution.
Sampling and Sampling Distributions
Statistical Quality Control, 7th Edition by Douglas C. Montgomery.
Copyright (c) 2005 John Wiley & Sons, Inc.
Statistical Inference
Sample Mean Distributions
Chapter 8: Inference for Proportions
IENG 486: Statistical Quality & Process Control
Presentation transcript:

What Does the Likelihood Principle Say About Statistical Process Control? Gemai Chen, University of Calgary Canada July 10, 2006

It is well know that given a random sample X 1, X 2, …, X n from, then is independent of and

Therefore, inference for  and  can be done using and separately.

From a statistical theory point of view, this supports the practice that process mean and variability are usually monitored by two different control charts.

For this presentation, let’s consider the widely used X-bar chart and the S chart.

Now let X denote a certain quality characteristic of a process, let  denote the process mean and let  denote the process standard deviation.

Suppose that X ij, i = 1, 2, … and j = 1, …, n, are measurements of X arranged in sub-groups of size n with i indexing the sub-group number.

We assume that X i1,…,X in is a random sample from a normal distribution with mean  + a  and standard deviation b , where a = 0 and b = 1 indicate that the process is in control.

Define sample mean and sample variance by

The 3-sigma X-bar chart plots the sample means against

with a Type I Error probability when the process is in control. For the S chart, we use a version with probability control limits, where

a probability is assigned to each tail so that the Type I Error probability is also when the process is in control.

The joint behaviour of the (X-bar, S) combination judged by average run length (ARL) is summarized in the following table.

a b ARL of (X-bar, S) Combination When n = 5

Some efforts have been made to use one chart by combining two existing charts, one for the mean and one for the variability.

For example, the Max chart by Chen & Cheng plots

where

Under the same in control ARL of 185.4, the Max chart has the identical ARL performance to the (X-bar,S) combination.

Can we design a control chart which by nature is meant to monitor both mean and variability simultaneously?

Here we report what we have tried. First, as any test of uniformity can be turned into a chart.

a b 0.25Inf ARL Based on Kolmogorov Test When n = 5

a b 0.25Inf ARL Based on Cramer-von Mises Test When n = 5

a b 0.25Inf Inf ARL Based on Anderson-Darling Test When n = 5

It looks that the popular tests of uniformity do not lead to efficient monitoring of the mean and variability changes, especially when the variability of the process decreases.

Next, we consider Fisher’s method of combining tests. Let

Then

a b 0.25Inf Inf ARL Based on Fisher’s Test When n = 5

We see that Fisher’s test leads to a chart that is better than the (X-bar, S) combination for monitoring mean changes and variability increases.

However, this chart can hardly detect any variability decreases.

Finally, we consider the likelihood ration test of the simple null H 0 : Mean   and SD   versus the composite alternative H 1 : Mean   and/or SD  .

a b ARL Based on Likelihood Ratio Test When n = 5

We see that the likelihood ratio test leads to a chart that has more balanced performance monitoring the mean and variability changes than the (X-bar, S) combination or any of the cases considered.

To understand better, let’s have a look at the likelihood ratio statistic

Conclusion : Mean  and standard deviation  are functionally related under the normality assumption, even though and are statistically independent.