1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference Center Rocky Mountain Room th Street Denver, CO Wednesday, October 30, 2002

2 of 32 Introduction, Objectives, and Agenda Presenter: Sebastian Tindall Day 2 DQO Training Course Module 0 (15 minutes)

3 of 32 n Make defensible decisions by managing uncertainty via systematic planning EM-3 DQO Mission: Introduction n Institutionalize the standardized Data Quality Objectives (DQO) Process (systematic planning) throughout the Department of Energy (DOE) complex

4 of 32 Day 2 Course Objectives n Learn –“How to” for each activity in each of the 7 steps of the DQO Process –Basic statistical concepts using hands-on examples and computer simulations –How to manage uncertainty in the sampling and analysis design process –New Environmental Protection Agency (EPA) “TRIAD” approach for implementation of sampling

5 of 32 The TRIAD Approach Systematic Planning Dynamic Work Plans Real-Time Measurement Technologies

6 of 32 Important “How To” Concepts n Scoping is the most important activity n Poor scoping promotes distrust between regulators and facility managers n Using an independent facilitator who has technical knowledge promotes agreement between different opinions n Interviews with decision makers promote consensus and resolution of global issues

7 of 32 n Global issues are those that do not require data to resolve but are crucial for success Important “How To” Concepts (cont.) n Global issues are those that include interpretation of regulations n Resolution of global issues ensures technical staff resolve disagreements between decision makers prior to developing sampling designs n Good decisions require defensible sampling and analysis designs

8 of 32 Statistical Concepts n Generate frequency distributions n Transform data from numerical to graphical n Generate histograms n Generate Probability Density Functions n Evaluate error consequences versus target error rates n Evaluate error rates & number of samples versus cost of analysis

9 of 32 How Many Samples do I Need? REMEMBER: HETEROGENEITY IS THE RULE!

10 of 32 Remember n Population is the TOTAL universe of objects within the decision unit THUS n The only way to make decisions without errors is to take a CENSUS n Can’t sample or “measure” the ENTIRE site n Population must therefore be sampled representatively

11 of 32 Uncertainty is additive! Analytical + Sub-sampling + Natural heterogeneity of the site = Total Uncertainty

12 of 32 Errors

13 of 32 To Control Sampling Error n Control sub-sampling methods and sample mixing methods n Take larger sample volumes n Reduce particle size n Specify methods that fit the sample size and particle size n Increase sample density by performing more on-site, rapid analyses

14 of 32

15 of 32 Sampling heterogeneity decreases as sampling density increases. REMEMBER: How Many Samples do I Need?

16 of 32 The following slides show today’s agenda with the content and times of each module

17 of 32 The EPA 7-Step DQO Process Step 1 - State the Problem Presenter: Sebastian Tindall Day 2 DQO Training Course Module 1 (60 minutes) (15 minute Morning Break)

18 of 32 The EPA 7-Step DQO Process Step 2 - Identify the Decisions Presenter: Sebastian Tindall (15 minutes) Day 2 DQO Training Course Module 2

19 of 32 The EPA 7-Step DQO Process Step 3 - Identify Inputs (45 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 3

20 of 32 The EPA 7-Step DQO Process Step 4 - Specify Boundaries (30 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 4

21 of 32 The EPA 7-Step DQO Process Step 5 - Define Decision Rules (15 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 5

22 of 32 The EPA 7-Step DQO Process Step 6 - Specify Error Tolerances (40 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 6

23 of 32 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design (70 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 7

24 of 32 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

25 of 32 The EPA 7-Step DQO Process Statistical Concepts and Demonstrations Presenter: Chuck Ramsey Day 2 DQO Training Course Exercises

26 of 32 Appendix A : –Thomas Grumbly DOE DQO directive, September 1994 Appendix B : –Timothy Fields EPA OSWER directive, June 1999 Appendix C : –Expedited Site Characterization Field Quality Assurance Meeting minutes, January 1994 Note: Appendices have been removed from the binders but can be found on our web site:

27 of 32 Appendix D : Effective Data –Deana Crumbling, U.S. EPA-HQ ES&T: Managing Uncertainty… White Paper: Triad Approach… White Paper: Applying Effective Data... White Paper: Relationship: SW-846, PBMS... White Paper: Clarifying DQO Terminology… –Dr. Bart Simmons, CAL/EPA DTSC Using Field Methods: Court decisions –Dr. Al Robbat, Tufts University Dynamic Work Plans & Field Analytics –Sebastian Tindall, BHI ESC M-Cubed Approach Culture Change Flow Chart

28 of 32 Appendix E : –List of Acronyms and Symbols used in course materials Appendix F : –U.S. EPA ORDER A2 CHG 2 May 5, 2000 (http)://

29 of 32 We want to help you: Do it! (Get the job done - right) Prove it! (Document what/why/how) Certified

30 of 32 Final Exam Preview Old answer - A painful elaboration of the obvious Hint: Answer has 3 items What is the DQO Process in a Nutshell?

31 of 32

32 of 32 End of Module 0 Thank you