Measurement Quality Objectives = Data Validation Requirements Excerpted from EPA QA Handbook Volume II (aka “Redbook”)

Slides:



Advertisements
Similar presentations
Radiochemical Methods and Data Evaluation
Advertisements

Quality is a Lousy Idea-
April 7: QA Systems, EPA definitions, PQAOs and common sense – Mike Papp April 14: Routine Quality Control and Data Management (1-pt QC, flow rate, and.
Contracting for Laboratory Services Ann Mullin Cleveland US Geological Survey Presented to the Environmental Protection Agency Science Advisory Board April.
ProEdit Procedure Management Writing a Verification Procedure For a Megger CM500 Combination Tester - Loop Function.
Institute for Tribal Environmental Professionals, Tribal Air Monitoring Support Center Guest Speaker: Mike Papp, OAQPS.
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Module 61 Module 6: Uncertainty Don’t just calculate—first think about sources of error, and don’t double-count errors.
QA Strategy Workgroup Ambient Air Quality System Training Ambient Air Monitoring Quality Systems Requirements Mike Papp- OAQPS.
PM-2.5 FEM Requirements for Met One BAM Glenn Gehring, Technology Specialist Tribal Air Monitoring Support (TAMS) Center
Why do we lose analyzer data? Monitor malfunction DAS malfunction Power outages Environmental problems Wildlife damage Vandalism Operator error.
Physics 270 – Experimental Physics. Let say we are given a functional relationship between several measured variables Q(x, y, …) What is the uncertainty.
SRPMIC Ozone Monitoring Sites Senior Center SiteHigh School Site Red Mountain Site Lehi Site.
Working together for clean air Approved Regional Method (ARM) Demonstration Puget Sound Clean Air Agency Mike Gilroy, Erik Saganic Puget Sound Clean Air.
Statistical Treatment of Data Significant Figures : number of digits know with certainty + the first in doubt. Rounding off: use the same number of significant.
Stat 321 – Day 24 Point Estimation (cont.). Lab 6 comments Parameter  Population Sample Probability Statistics A statistic is an unbiased estimator for.
Short Course on Introduction to Meteorological Instrumentation and Observations Techniques QA and QC Procedures Short Course on Introduction to Meteorological.
DQOs and the Development of MQOs Carl V. Gogolak USDOE Environmental Measurements Lab.
Multi-Agency Radiological Laboratory Analytical Protocols Manual: MARLAP Presentation to the Radiation Advisory Committee/Science Advisory Board April.
1 Guest Speaker: Bill Frietsche US EPA.  April 7: QA Systems, EPA definitions, PQAOs and common sense – Mike Papp  April 14: Routine Quality Control.
Presented by: Mike Hamdan South Coast Air Quality Management District Diamond Bar, CA Presented at: The Tribal Air Monitoring Training, Pechanga Reservation,
Quality Assessment 2 Quality Control.
Guest Speaker: Jeremy Howe Little River Band Of Ottawa Indians The Measuring Sticks of Air Monitoring.
Field Analysis Quality Control
What to compare against the validation templates (see templates in course webpage: Resources/Validation%20Templates%20from%20Red.
EPA Precursor Gas Training Workshop Precursor Gas Quality Assurance Implementation Dennis K. Mikel EPA Office of Air Quality Planning and Standards.
Quality assurance of sampling and analytical instruments
Quality Assurance/ Quality Control
AMP255 – Precision and Bias Data Report 2008 AQS Conference The AMP255 Precision and Bias Data Report August 22, 2008 Presented by Jonathan Miller EPA.
Introduction to Standard Reports. Standard Reports 2 How to get information out of AQS Standard Reports Site / Monitor Metadata Detail Data Reports “
Melinda Ronca-Battista, ITEP, TAMS Center Tribal Air Monitoring and QA Requirements for NAAQS- Comparable Data.
Quality WHAT IS QUALITY
1 Guest Speaker: Brandy Toft Leech Lake Ojibwe.  Overview of FRM/FEM/ARM status, requirements, and reporting  QC (routine checks, audits, and method-
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) Each has some error or uncertainty.
Scientific Methods Error Analysis Random and Systematic Errors Precision and Accuracy.
 April 7: QA Systems, EPA definitions, PQAOs and common sense – Mike Papp  April 14: Routine Quality Control and Data Management (1-pt QC, flow rate,
1 Saxony-Anhalt EU Twinning RO 04/IB/EN/09 State Environmental Protection Agency Wolfgang GarcheWorkshop European Standards Requirements of.
Automated CBC Parameters
Sigmafine 4.0 – The Next Generation ( UC2003 Ales Soudek) Sigmafine 4.0 The Next Generation Ales SoudekMay 2003.
Quality Control/ Quality Assurance Annabelle Allison ITEP/TAMS Center.
Quality Control – Part II Tim Hanley EPA Office of Air Quality Planning and Standards.
Emission Inventory Quality Assurance/Quality Control (QA/QC) Melinda Ronca-Battista ITEP/TAMS Center.
Control Chart Methodology for Evaluating CEMS Data
Appendix A: Calculations for Data Quality Assessment QC check statistics Precision calcs Bias calcs PM stats Reporting: quarterly and annual.
EPA’s Bioassessment Performance and Comparability “Guidance”
CARB Continuous PM 2.5 Monitoring Activity (BAM’s) Reggie Smith California Air Resources Board.
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Uncertainty and Equipment Error. Absolute uncertainty and recording data When you record measurements you should also record the absolute uncertainty.
An Overview of EPA’s Quality Assurance Guidance for Ambient Air Quality Monitoring Data Data Analysis and Interpretation February 12 – 14, 2008, Tempe,
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
 April 7: QA Systems, EPA definitions, PQAOs and common sense – Mike Papp  April 14: Routine Quality Control and Data Management (1-pt QC, flow rate,
IH&S 725 Dr. Myers, C.I.H. Quality assurance of sampling and analytical instruments Lecture Notes.
WHAT IS THE CHEROKEE NATION? Cherokee Nation Air Quality Data Management Concepts for Quality Data Collection Ryan Callison.
Module 11 Module I: Terminology— Data Quality Indicators (DQIs) Melinda Ronca-Battista ITEP Catherine Brown U.S. EPA.
 Remember Chemistry panel Quality Control:-  In a medical laboratory, it is a statistical process used to monitor and evaluate the analytical process.
Diagnostic clinical chemistry
Annual Air Monitoring Data Certification and Concurrence Process 1.
Quality is a Lousy Idea-
主讲人: 会计学院         陈丹 TEL:
Quality is a Lousy Idea-
QA101: 40 CFR 58 App. A - Gaseous Pollutants
Education and Training Statistics Working Group – 2-3 June 2016
Chapter 11 Quality Control.
Module 6: Uncertainty Don’t just calculate—first think about sources of error, and don’t double-count errors Presentation of Uncertainty: 1. Components.
Quality Control Lecture 3
QA/QC Gaseous Pollutants mini-course TAMS Center February 2009.
A New Tool for Evaluating Candidate PM FEM and PM2.5 ARM Monitors
Precision, Bias, and Total Error (Accuracy)
Quality Assessment The goal of laboratory analysis is to provide the accurate, reliable and timeliness result Quality assurance The overall program that.
Presentation transcript:

Measurement Quality Objectives = Data Validation Requirements Excerpted from EPA QA Handbook Volume II (aka “Redbook”)

 EPA has set Data Quality Objectives which are statements of DECISION ERROR:  Objective that decisions on attainment will be correct at least 95% of the time  Ozone, PM2.5, Pmcoarse, and Pb  The MQOs are derived from this decision error goal

 Are derived from EPA’s DQOs, and are PERFORMANCE REQUIREMENTS:  PM2.5 (auto and manual) goals for measurement uncertainty are 10% for total precision and +- 10% for total bias  Ozone precision goal is a 90% conf limit of 7% (%diff), and 95% conf limit for the absolute bias of 7%  Transl: 90 times out of 100 the %diff is <=7%

 Validation templates in Appendix D of Redbook  Validation templates include instrument/method-specific recommendations as well as MQOs  The MQOs are all calculated from the difference between your instrument’s indicated value and the known (audit) value = %diff (in CFR %diff is d i )  Both precision (wiggle) and bias (jump) are calculated from the %diffs  Use the DASC excel file to calculate (DASC EPA Prec and Bias Calculator.xls, in QC folder)

 11 separate tables  All gaseous, PM2.5 auto and manual, PM10 dichot, hi-vol, auto, LTP and STP  3 levels of data validation (review):  Critical  Operational  systematic

 Critical  Every point or subset of hourly values must meet each criterion  Operational  There might be a problem, and there must be justification for using these data  Systematic  Important for interpreting the set of data (e.g., 75% completeness )

 1-pt QC checks no longer called precision checks, because the results are used (by YOU) to calculate both precision and bias  Each check <= 7% is the CRITICAL criteria for each set of data since last passing check

 Completeness  Siting  Sample residence times  That EPA keeps up its end and gets the SRP that you compared against recertified

 CRITICAL:  hours in daily value  Flow rate avg <= 5% of  Flow rate variability CV <= 2%  One-point flow rate verification monthly +- 4% of transfer standard THIS FR VERIFICATION IS USED TO ESTIMATE BIAS (MQO)  BAM membrane check

 Leak checks, cleaning at intervals  Temp and pressure checks and calibration  Flow Rate verifications and, if needed, calibrations  COLLOCATED RESULTS  Every 12 days for 15% of sites  Results > 3 used to CALCULATE PRECISION (MQO) of a CV of 10%

 Completeness  Detection limits  Getting your standards recertified  Overall PRECISION for each site and PQAO based on collocated results  Overall BIAS for each site and PQAO based on PEP results (+- 10%)