Introduction to the EPA 7-Step DQO Process

Slides:



Advertisements
Similar presentations
Day 2 DQO Training Course Module 9 The EPA 7-Step DQO Process
Advertisements

Day 2 DQO Training Course Module 3 The EPA 7-Step DQO Process
1 Chapter 9 Hypothesis Testing Developing Null and Alternative Hypotheses Type I and Type II Errors One-Tailed Tests About a Population Mean: Large-Sample.
1 1 Slide Chapter 9 Hypothesis Tests Developing Null and Alternative Hypotheses Developing Null and Alternative Hypotheses Type I and Type II Errors Type.
1 1 Slide © 2009 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
1 1 Slide © 2003 South-Western/Thomson Learning™ Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
Hypothesis Testing Developing Null and Alternative Hypotheses Developing Null and Alternative Hypotheses Type I and Type II Errors Type I and Type II Errors.
1 1 Slide STATISTICS FOR BUSINESS AND ECONOMICS Seventh Edition AndersonSweeneyWilliams Slides Prepared by John Loucks © 1999 ITP/South-Western College.
Chapter 9 Hypothesis Testing
1 1 Slide MA4704Gerry Golding Developing Null and Alternative Hypotheses Hypothesis testing can be used to determine whether Hypothesis testing can be.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 9 Hypothesis Testing Developing Null and Alternative Hypotheses Developing Null and.
1 1 Slide IS 310 – Business Statistics IS 310 Business Statistics CSU Long Beach.
Probability & Statistical Inference Lecture 7 MSc in Computing (Data Analytics)
Jump to first page STATISTICAL INFERENCE Statistical Inference uses sample data and statistical procedures to: n Estimate population parameters; or n Test.
Pengujian Hipotesis Nilai Tengah Pertemuan 19 Matakuliah: I0134/Metode Statistika Tahun: 2007.
8 Statistical Intervals for a Single Sample CHAPTER OUTLINE
1 1 Slide © 2006 Thomson/South-Western Chapter 9 Hypothesis Testing Developing Null and Alternative Hypotheses Developing Null and Alternative Hypotheses.
Inferences About Process Quality
8-1 Introduction In the previous chapter we illustrated how a parameter can be estimated from sample data. However, it is important to understand how.
DQOs and the Development of MQOs Carl V. Gogolak USDOE Environmental Measurements Lab.
1 of 39 DQO Implementation Process: Flow Chart and Wall Charts 30 minutes DQO Training Course Day 2 Module 8 Presenter: Sebastian Tindall.
1 © Lecture note 3 Hypothesis Testing MAKE HYPOTHESIS ©
1 1 Slide © 2005 Thomson/South-Western Chapter 9, Part A Hypothesis Tests Developing Null and Alternative Hypotheses Developing Null and Alternative Hypotheses.
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Hypothesis Testing (Statistical Significance). Hypothesis Testing Goal: Make statement(s) regarding unknown population parameter values based on sample.
1 of 25 The EPA 7-Step DQO Process Step 5 - Define Decision Rules 15 minutes Presenter: Sebastian Tindall DQO Training Course Day 2 Module 14.
1 of 23 From Qualitative Concept to Practical Implementation Evolution of the Data Quality Objectives Concept DQO Training Course Day 1 Module 1 15 minutes.
1 1 Slide © 2005 Thomson/South-Western Chapter 9, Part B Hypothesis Tests Population Proportion Population Proportion Hypothesis Testing and Decision Making.
1 of 35 The EPA 7-Step DQO Process Step 4 - Specify Boundaries (30 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 4.
1 of 23 EPA Inspector General Audit Reports 15 minutes DQO Training Course Day 1 Module 2 Presenter: Sebastian Tindall.
INTRODUCTION TO THE DATA QUALITY OBJECTIVES PROCESS
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
1 1 Slide Slides Prepared by JOHN S. LOUCKS St. Edward’s University © 2002 South-Western/Thomson Learning.
1 1 Slide © 2004 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved OPIM 303-Lecture #7 Jose M. Cruz Assistant Professor.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
1 1 Slide © 2003 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
1 1 Slide IS 310 – Business Statistics IS 310 Business Statistics CSU Long Beach.
1 of 21 Introduction to the EPA 7-Step DQO Process DQO Training Course Day 1 Module 7 (30 minutes) Steps Presenter: Sebastian Tindall.
1 of 52 The EPA 7-Step DQO Process Step 4 - Specify Boundaries (60 minutes) (15 minute Afternoon Break) Presenter: Sebastian Tindall DQO Training Course.
1 of 39 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design DQO Case Study 45 minutes Presenter: Sebastian Tindall DQO Training Course Day 3 Module.
1 of 36 Managing Uncertainty with Systematic Planning for Environmental Decision Making 3-Day DOE DQO Training Day 1.
1 of 49 Key Concepts Underlying DQOs and VSP DQO Training Course Day 1 Module minutes (75 minute lunch break) Presenter: Sebastian Tindall.
1 of 45 How Many Samples do I Need? Part 1 Presenter: Sebastian Tindall 60 minutes (15 minute 1st Afternoon Break) DQO Training Course Day 1 Module 4.
1 of 40 The EPA 7-Step DQO Process Step 2 - Identify the Decisions Presenter: Sebastian Tindall (30 minutes) DQO Training Course Day 2 Module 12.
1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference.
1 of 37 Key Concepts Underlying DQOs and VSP DQO Training Course Day 1 Module 4 (60 minutes) (75 minute lunch break) Presenter: Sebastian Tindall.
1 of 50 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 60 minutes Presenter: Sebastian Tindall DQO Training Course Day 3 Module 16.
Chapter 8 Introduction to Hypothesis Testing ©. Chapter 8 - Chapter Outcomes After studying the material in this chapter, you should be able to: 4 Formulate.
1 of 39 The EPA 7-Step DQO Process Step 3 - Identify Inputs (45 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 3.
1 of 35 The EPA 7-Step DQO Process Step 2 – Identify the Decision Presenter: Sebastian Tindall 15 minutes (75 minute Lunch break) DQO Training Course Day.
1 9 Tests of Hypotheses for a Single Sample. © John Wiley & Sons, Inc. Applied Statistics and Probability for Engineers, by Montgomery and Runger. 9-1.
1 of 36 The EPA 7-Step DQO Process Step 6 - Specify Error Tolerances (60 minutes) (15 minute Morning Break) Presenter: Sebastian Tindall DQO Training Course.
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
1 of 27 The EPA 7-Step DQO Process Step 5 - Define Decision Rules (15 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 5.
1 of 86 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design (70 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 7.
1 of 10 Introduction to Visual Sample Plan & Applications DQO Training Course Day 3 Module 21 Presenter: Sebastian Tindall (60 minutes)
1 of 19 Managing Uncertainty with Systematic Planning for Environmental Decision-Making 3-Day DQO Training Day 2.
1 of 27 How Many Samples do I Need? Part 2 Presenter: Sebastian Tindall (60 minutes) (5 minute “stretch” break) DQO Training Course Day 1 Module 5.
1 of 31 The EPA 7-Step DQO Process Step 6 - Specify Error Tolerances 60 minutes (15 minute Morning Break) Presenter: Sebastian Tindall DQO Training Course.
Course Overview Collecting Data Exploring Data Probability Intro. Inference Comparing Variables Relationships between Variables Means/Variances Proportions.
1 of 48 The EPA 7-Step DQO Process Step 6 - Specify Error Tolerances 3:00 PM - 3:30 PM (30 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course.
Lec. 19 – Hypothesis Testing: The Null and Types of Error.
Hypothesis Testing Chapter Hypothesis Testing  Developing Null and Alternative Hypotheses  Type I and Type II Errors  One-Tailed Tests About.
Slides by JOHN LOUCKS St. Edward’s University.
Day 2 DQO Training Course Module 2 The EPA 7-Step DQO Process
CONCEPTS OF HYPOTHESIS TESTING
Introduction to Inference
Introduction to Inference
Discrete Event Simulation - 4
Presentation transcript:

Introduction to the EPA 7-Step DQO Process DQO Training Course Day 1 Module 8 Introduction to the EPA 7-Step DQO Process Steps 5 - 7 Presenter: Sebastian Tindall (25 minutes) (5 minute “stretch” break)

Step 5: Define Decision Rules Step Objective: This step combines Steps 1 - 4 to produce the following major elements to form decision rules: Parameter of interest Unit of Decision Making Action Level Alternative Actions Step 1: State the Problem Step 2: Identify Decisions Step 3: Identify Inputs Step 4: Specify Boundaries Step 5: Define Decision Rules Step 6: Specify Error Tolerances Step 7: Optimize Sample Design

Step 5- Define Decision Rules Information IN Actions Information OUT From Previous Step To Next Step Specify the Parameter of Interest Principal Study Question Step 2 Information Required to Resolve Decision Statement Step 3 Population of Interest Step 4 If/Then Decision Rule Statements Develop a Decision Rule Unit of Decision Making Step 4 Alternative Actions Step 2 Confirm the Action Level Basis for Defining Action Level Step 3

Background Major Elements of a Decision Rule: Population Parameter of Interest Population Parameter (ALWAYS UNKNOWN) Sample Statistic (Used to represent the Population Parameter) Environmental Variable Chemical/physical attribute in the population Levels measured (quantity) Unit of Decision Making (Step 4) Population (lives with Decision Unit) Geographic Area/Volume (Population Spatial Boundry) Timeframe (Population Temporal Boundry) Action Level (Step 3) Alternative Actions (Step 2)

Decision Rule Example If the [true mean (as estimated by the 90% UCL of the sample mean) concentration of cadmium] within [the concrete rubble in a container truck] is > [1 mg/kg], then [the waste rubble will be considered hazardous and will be disposed of in a RCRA facility]; if not [the waste rubble will be disposed of in a municipal landfill].

Step 6: Specify Error Tolerances Step Objective: To specify the decision maker’s tolerable limits on decision errors, which are used for limiting uncertainty in the data Since analytical data can only provide an estimate of the true condition of a site, decisions that are based on such data could potentially be in error Step 1: State the Problem Step 2: Identify Decisions Step 3: Identify Inputs Step 4: Specify Boundaries Step 5: Define Decision Rules Step 6: Specify Error Tolerances Step 7: Optimize Sample Design

Step 6- Specify Error Tolerances Information IN Actions Information OUT From Previous Step To Next Step Decision Rules Step 5 Determine the variability of the environmental variables Identify the decision errors Bounds of the Gray Region Choose the null hypothesis Specify the boundaries of the Gray Region Assign probability limits on either side of the Gray Region Decision Error Tolerances

Step 7: Optimize Sample Design Step 1: State the Problem Step Objective: Identify the most resource-effective data collection and analysis design that satisfies the DQOs specified in the preceding 6 Steps Step 2: Identify Decisions Step 3: Identify Inputs Step 4: Specify Boundaries Step 5: Define Decision Rules Step 6: Specify Error Tolerances Step 7: Optimize Sample Design

Types of Designs Simple Random Systematic Grid with random start Geometric Probability or “Hot Spot” Sampling Stratified Random Stratified Simple Random Stratified Systematic Grid with random start Statistical Methods for Environmental Pollution Monitoring, Richard O. Gilbert, 1987

Step 7- Optimize Sample Design Information IN Actions Information OUT From Previous Step To Next Step Review DQO outputs from Steps 1-6 to be sure they are internally consistent Decision Error Tolerances Develop alternative sample designs For each design option, select needed mathematical expressions Gray Region Select the optimal sample size that satisfies the DQOs for each data collection design option Check if number of samples exceeds project resource constraints Optimal Sample Design Go back to Steps 1- 6 and revisit decisions. Yes No

Begin with the End in Mind DATA Contaminant Concentrations in the Spatial Distribution of the Population Population Frequency Distribution Correct Equation for n (Statistical Method) , , ,  Alternative Sample Designs Optimal Sampling Design How Many Samples do I Need? The end

Iterative Process Steps 1- 6 Step 7 Optimal Design

Judgmental Sampling Statistical Sampling Judgmental Sampling Differences Allows inferences about a population with a known certainty Population inferences not plausible; no random component Allows for decision-error analysis No basis for decision-error analysis Useful in all phases of environmental decision making: scoping, characterization, remediation, verification Useful in scoping, emergency response, and waste designation

Summary Going through the 7-Step DQO Process should result in a defensible and cost-effective sampling program In order for the 7-Step DQO Process to be effective: All steps must be performed Inputs must be based on comprehensive scoping and maximum participation/contributions by decision makers Sample design must be based on the severity of the consequences of decision error

Summary(cont.) To succeed in a systematic planning process for environmental decision making, you need Statistical Support: One or more qualified statisticians, experienced in environmental data collection designs and statistical data quality assessments of such designs.

End of Module 8 Thank you Questions? We will now take a Third Afternoon 5-minute “Stretch” Break. Please be back in 5 minutes