Regulatory Perspectives on Data Quality Nick Mangus US EPA / OAR / Air Quality System (AQS) Team for the Earth Science Information Partners July 13, 2011.

Slides:

Advertisements

Similar presentations

Philbrown consultancy mobile ISO FOR SMALL BUSINESSES FIRST ISO 9001.

Advertisements

Why Lab. Certification? Laboratory certification tries to insure that the laboratory is qualified and capable of analyzing the sample and obtaining quality.

A Comprehensive Provincial Air Emissions Inventory to Support AEMERA, ESRD and the AER Richard Melick Emissions Inventory Scientist Air Policy.

Preventing and Resolving Reporting Errors Using Monitor Data Checking Software (MDC) Louis Nichols Clean Air Markets Division.

Sampling: Your data is only as good as your field technicians.

REDUCING BURDEN WHILE INCREASING QUALITY AT A GOVERNMENT AGENCY David A. Marker (Westat), Mary K. Dingwall (Westat), and Marla D. Smith (U.S. EPA) Presented.

Welcome to the AQS Monitor Metadata Webinar Dec. 13, 2013 You are connected to the on-line portion of the webinar. The audio is being hosted via a phone.

AQS Futures (Where is AQS Heading?) AQS Conference August 22, 2012 Robert Coats.

AQS Data Handling (Under the Hood) AQS Conference August 23, 2012 Robert Coats.

Quality Assurance for Tribal FIFRA Enforcement Grants David R. Taylor EPA Region 9 Quality Assurance Office.

How Will Georgia-Florida Wildfires Affect Regional Air Quality Planning? Wes Younger Georgia Environmental Protection Division.

Establish Verification Procedures (Task 11 / Principle 6)

AMTAC April 12 th, 2011 Meredith Kurpius EPA R9 1.

Laboratory Personnel Dr/Ehsan Moahmen Rizk.

Lecture 8. Quality Assurance/Quality Control The Islamic University of Gaza- Environmental Engineering Department Environmental Measurements (EENV 4244)

Importance of Quality Assurance Documentation and Coordination with Your Certified Laboratory Amy Yersavich and Susan Netzly-Watkins.

AQS Concepts. In This Section We Will Talk About AQS Concepts 2 AQS Background History AQS as part of a monitoring program Types of Information in AQS.

A History and Status of CEMS Applications in USEPA Regulations Dale Evarts US EPA December 16, 2002 Better Air Quality in Asian Cities 2002

Chapter 11 Quality Control.

Short Course on Introduction to Meteorological Instrumentation and Observations Techniques QA and QC Procedures Short Course on Introduction to Meteorological.

Quality Assurance/Quality Control Policy

Dimensions of Data Quality M&E Capacity Strengthening Workshop, Addis Ababa 4 to 8 June 2012 Arif Rashid, TOPS.

Chapter 10 Verification Procedures. Objective In this module, you will learn: u How to define verification u What functions are part of HACCP plan verification.

QA/QC FOR ENVIRONMENTAL MEASUREMENT

Smart Consumer Spending Advanced Curriculum. © Take Charge Today – August 2013– Smart Consumer Spending – Slide 2 Funded by a grant from Take Charge America,

1 AQS Ambient Monitoring Topics AQS Conference August 20, 2008 David Lutz.

EPA Precursor Gas Training Workshop Precursor Gas Quality Assurance Implementation Dennis K. Mikel EPA Office of Air Quality Planning and Standards.

Success of Market-Based Approaches The Success of Market-Based Approaches in Air Quality Management in the United States Kevin Rosseel Office of Atmospheric.

Quality Assurance/ Quality Control

Introduction to Standard Reports. Standard Reports 2 How to get information out of AQS Standard Reports Site / Monitor Metadata Detail Data Reports “

Introduction to EPA Quality System Requirements

Quality Control/ Quality Assurance Annabelle Allison ITEP/TAMS Center.

METHODOLOGY 28 supermarket chains in Pennsylvania were invited to participate in an on-line survey, which included questions about their current and future.

EPA Region 9 Meredith Kurpius August 19, Status of Tribal Air Monitoring Value of tribal monitoring Used to protect public health on tribal land.

1 Quality Assurance Project Plans Melinda Ronca-Battista, ITEP/TAMS Center.

| Data Validity and Usability in the RI/FS Process CHRISTINA MOTT FRANS, JOSH HOPP, CHRISTINE RANSOM.

Why Participate in the WLA? Utility Perspective Preparation Emergency Response Plan Resources.

USEPA REGION 4 Quality Management Plan ( For training purposes only)

REGULATORY PERSPECTIVE ON USING OPERATIONAL EXPERIENCE Thomas E. Murley Former Director of Nuclear Reactor Regulation USNRC Conference on Improving Nuclear.

Lecture 16 Coordination with PPC. Coordination An organized working together of muscles and groups of muscles aimed at bringing about a purposeful movement.

Data Management Concepts James Payne Environmental Protection Department Morongo Band of Mission Indians.

An Overview of EPA’s Quality Assurance Guidance for Ambient Air Quality Monitoring Data Data Analysis and Interpretation February 12 – 14, 2008, Tempe,

Environmental & Energy Law

Dirk Felton RTP, NC February 12-13, 2008 Air Quality Data Summit: Session: Inventory of Data Systems Data provider perspectives.

Chapter 1: Fundamental of Testing Systems Testing & Evaluation (MNN1063)

1 Quality Control for Field Operations. 2 Overview Goal To ensure the quality of survey field work Purpose To detect and deter interviewer errors and.

Quality control & Statistics. Definition: it is the science of gathering, analyzing, interpreting and representing data. Example: introduction a new test.

Error Detection and Correction in Data Collection Julia Challinor, RN, PhD Assistant Adjunct Professor of Nursing University of California, San Francisco.

Overview of EPA Quality System Requirements. Course Goals At the completion of this course, you will: Understand EPA's quality system requirements Understand.

WHAT IS THE CHEROKEE NATION? Cherokee Nation Air Quality Data Management Concepts for Quality Data Collection Ryan Callison.

1 Assuring the Quality of Data from the Child Outcomes Summary Form.

CM&C Inspections The Pre-Approval Inspection (PAI) in the US 27 May 2010.

1 Early Intervention Monitoring Wyoming DDD April 2008 Training.

MEASURE Evaluation Data Quality Assurance Workshop Session 3 Introduction to Routine Data Quality Assessment.

Annual Air Monitoring Data Certification and Concurrence Process 1.

Chapter 10 Verification Procedures.

Ensuring data quality and generating reliable estimates

Introduction to Data Quality

Maintaining quality data throughout the life of a project

GMP Inspection Process

An Introduction to Quality Assurance in Analytical Science

Back To Basics: PM2.5 NESCAUM MAC Meeting Newport, RI May 16-17, 2006

6.1 Quality improvement Regional Course on

Workshop on QA/QC 2-3 september 2004

Towards a data sharing policy for survey and monitoring data collected and/or stored by the SPC Coastal Fisheries Programme on behalf of member countries.

Panhandling & Other Lab Procedures Illinois EPA Checks

Environmental & Energy Law

Internal Control Internal control is the process designed and affected by owners, management, and other personnel. It is implemented to address business.

National Visitor Use Monitoring

Presentation transcript:

Regulatory Perspectives on Data Quality Nick Mangus US EPA / OAR / Air Quality System (AQS) Team for the Earth Science Information Partners July 13, /18/20151 U.S. Environmental Protection Agency

Nightmare Scenario 11/18/20152U.S. Environmental Protection Agency

Quality Data is Foundational for Policy First, know the quality Data Quality Objectives –Each purpose has associated DQOs –Prepare to respond to challenges Methods, Operation, Audits, etc. Quality Assurance Project Plans –SLT QAPPs –EPA Regional Review –EPA HQ QAPP Precision and Accuracy tests and reporting (“quality” metadata) Independent performance audits 11/18/20153U.S. Environmental Protection Agency There is nothing either good or bad, but thinking makes it so. - Hamlet

The Regulatory Data-Cycle 11/18/2015U.S. Environmental Protection Agency4 Monitor the Air Handle (QA, Flag) Data Acquire Data Report (Load) Data Analyze Regulate Store Disseminate FED SLT NGO

Data Management Issues I’m not a quality person I’m in data management: data comes first –Data Quality vs. Quality Data Think food quality vs. quality food Particular issues down the Value Chain –Custody –Movement –Changes –Calculations 11/18/20155U.S. Environmental Protection Agency

Custody and Movement Who can change the data? –AQS business model: data is forever owned by the submitter (e.g., not the feds) –When a question / complaint comes in, all we can do is pass it up the chain –We have sufficient metadata to know who’s touched it and (usually) why data is an outlier Movement: recent ETL example of rounding 11/18/20156U.S. Environmental Protection Agency AQS Data Mart ETL We spend a lot of time comparing values: random spot checks

Calculations We get hourly ozone data from a monitor We calculate: –Submitted value in standard units of measure –8-hour aggregates –Daily aggregates (of 1-hour and 8-hour values [2], for each standard [3 x ?], in/excluding flagged data [3]) –Quarterly aggregates (ditto) –Annual aggregates(ditto) –3-year aggregates (ditto); substitutions for missing data A lot can go wrong – software QA is essential 11/18/20157U.S. Environmental Protection Agency

Changes Regulatory changes drive data changes –Recent examples: Change the number of significant figures carried through calculations Change the substitution routines based on data completeness –Apply retroactively throughout history Analysis artifacts (speciation carbon) Old submittals 11/18/20158U.S. Environmental Protection Agency

Summary Quality is expensive / time consuming Pushing issues / metadata back up the chain is an unresolved issue (?) One mistake can tarnish a reputation that took 1,000 correct actions to create Your system is optional We have to work together to keep each other’s systems meaningful and viable 11/18/20159U.S. Environmental Protection Agency You want it bad, you get it bad. - Lillis

11/18/2015U.S. Environmental Protection Agency10 Note for reviewers. The following slides are not intended to be part of the presentation but are “hip pocket” slides intended only to be used in the case of particular questions being asked.

AQ Data Chain – One View 11/18/201511U.S. Environmental Protection Agency Disseminate Decide Evaluate Calculate Store Validate Verify Collect Design Purchase Deploy Operate Collect Analyze QA (flag) Report Data Owner (SLT) Data Custodian (EPA)

11/18/201512U.S. Environmental Protection Agency