2. 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference Center Rocky Mountain Room 999 18th Street Denver, CO 80202 Wednesday, October 30, 2002

3. 2 of 32 Introduction, Objectives, and Agenda Presenter: Sebastian Tindall Day 2 DQO Training Course Module 0 (15 minutes)

4. 3 of 32 n Make defensible decisions by managing uncertainty via systematic planning EM-3 DQO Mission: Introduction n Institutionalize the standardized Data Quality Objectives (DQO) Process (systematic planning) throughout the Department of Energy (DOE) complex

5. 4 of 32 Day 2 Course Objectives n Learn –“How to” for each activity in each of the 7 steps of the DQO Process –Basic statistical concepts using hands-on examples and computer simulations –How to manage uncertainty in the sampling and analysis design process –New Environmental Protection Agency (EPA) “TRIAD” approach for implementation of sampling

6. 5 of 32 The TRIAD Approach Systematic Planning Dynamic Work Plans Real-Time Measurement Technologies

7. 6 of 32 Important “How To” Concepts n Scoping is the most important activity n Poor scoping promotes distrust between regulators and facility managers n Using an independent facilitator who has technical knowledge promotes agreement between different opinions n Interviews with decision makers promote consensus and resolution of global issues

8. 7 of 32 n Global issues are those that do not require data to resolve but are crucial for success Important “How To” Concepts (cont.) n Global issues are those that include interpretation of regulations n Resolution of global issues ensures technical staff resolve disagreements between decision makers prior to developing sampling designs n Good decisions require defensible sampling and analysis designs

9. 8 of 32 Statistical Concepts n Generate frequency distributions n Transform data from numerical to graphical n Generate histograms n Generate Probability Density Functions n Evaluate error consequences versus target error rates n Evaluate error rates & number of samples versus cost of analysis

10. 9 of 32 How Many Samples do I Need? REMEMBER: HETEROGENEITY IS THE RULE!

11. 10 of 32 Remember n Population is the TOTAL universe of objects within the decision unit THUS n The only way to make decisions without errors is to take a CENSUS n Can’t sample or “measure” the ENTIRE site n Population must therefore be sampled representatively

12. 11 of 32 Uncertainty is additive! Analytical + Sub-sampling + Natural heterogeneity of the site = Total Uncertainty

13. 12 of 32 Errors

14. 13 of 32 To Control Sampling Error n Control sub-sampling methods and sample mixing methods n Take larger sample volumes n Reduce particle size n Specify methods that fit the sample size and particle size n Increase sample density by performing more on-site, rapid analyses

15. 14 of 32

16. 15 of 32 Sampling heterogeneity decreases as sampling density increases. REMEMBER: How Many Samples do I Need?

17. 16 of 32 The following slides show today’s agenda with the content and times of each module

18. 17 of 32 The EPA 7-Step DQO Process Step 1 - State the Problem Presenter: Sebastian Tindall Day 2 DQO Training Course Module 1 (60 minutes) (15 minute Morning Break)

19. 18 of 32 The EPA 7-Step DQO Process Step 2 - Identify the Decisions Presenter: Sebastian Tindall (15 minutes) Day 2 DQO Training Course Module 2

20. 19 of 32 The EPA 7-Step DQO Process Step 3 - Identify Inputs (45 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 3

21. 20 of 32 The EPA 7-Step DQO Process Step 4 - Specify Boundaries (30 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 4

22. 21 of 32 The EPA 7-Step DQO Process Step 5 - Define Decision Rules (15 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 5

23. 22 of 32 The EPA 7-Step DQO Process Step 6 - Specify Error Tolerances (40 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 6

24. 23 of 32 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design (70 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 7

25. 24 of 32 Closing Remarks Presenter: Sebastian Tindall (10 minutes) Day 2 DQO Training Course Module 8

26. 25 of 32 The EPA 7-Step DQO Process Statistical Concepts and Demonstrations Presenter: Chuck Ramsey Day 2 DQO Training Course Exercises

27. 26 of 32 Appendix A : –Thomas Grumbly DOE DQO directive, September 1994 Appendix B : –Timothy Fields EPA OSWER directive, June 1999 Appendix C : –Expedited Site Characterization Field Quality Assurance Meeting minutes, January 1994 Note: Appendices have been removed from the binders but can be found on our web site: http://www.hanford.gov/dqo/training/contents1.html

28. 27 of 32 Appendix D : Effective Data –Deana Crumbling, U.S. EPA-HQ ES&T: Managing Uncertainty… White Paper: Triad Approach… White Paper: Applying Effective Data... White Paper: Relationship: SW-846, PBMS... White Paper: Clarifying DQO Terminology… –Dr. Bart Simmons, CAL/EPA DTSC Using Field Methods: Court decisions –Dr. Al Robbat, Tufts University Dynamic Work Plans & Field Analytics –Sebastian Tindall, BHI ESC M-Cubed Approach Culture Change Flow Chart

29. 28 of 32 Appendix E : –List of Acronyms and Symbols used in course materials Appendix F : –U.S. EPA ORDER 5360.1 A2 CHG 2 May 5, 2000 (http)://www.hanford.gov/dqo/training/contents1.html)

30. 29 of 32 We want to help you: Do it! (Get the job done - right) Prove it! (Document what/why/how) Certified

31. 30 of 32 Final Exam Preview Old answer - A painful elaboration of the obvious Hint: Answer has 3 items What is the DQO Process in a Nutshell?

32. 31 of 32

33. 32 of 32 End of Module 0 Thank you