2. 1 of 37 Closing Remarks Presenter: Sebastian Tindall 15 minutes DQO Training Course Day 3 Module 23

3. 2 of 37 Module 25 Closing Remarks & Final Exam Objectives: n To summarize key points made today n To answer the “How many samples” question n “Final Exam” n Questions/feedback from the audience

4. 3 of 37 The DQO Process “A systematic planning process based on the scientific method for the unambiguous defining of n Environmental decision criteria n Data requirements n Error tolerances and the documentation / preservation of these details in a consistent, standardized format providing a defensible record of the decision” Merrick “Rick” Blancq US Army Corps of Engineers Portland District Merrick.P.Blancq@nwp01.usace.army.mil

5. 4 of 37 Systematic Planning Doesn’t Just “Happen” n Haphazard approaches yield haphazard results n Decision makers must provide input early & often n Need an implementation process n Successful implementation model evolved as the DQO Process was used

6. 5 of 37 Tools Make the Job Easier n Scoping Checklist n DQO e-Workbook (electronic template) –Standardized DQO Report format n DQO Web Site –DQO tools and materials –Latest version of all of today’s slides n Visual Sample Plan (VSP) –Download free software n Data Quality Assessment tools (coming!)

7. 6 of 37 Managing Uncertainty n We are forced to make environmental decisions based on estimates n Estimates always involve errors n Errors in estimates are not mistakes n If unmanaged, errors in estimates CAN lead to Decision Errors which ARE MISTAKES n Decision Errors must be managed –Identify –Quantify n Severe consequences of decision errors mandate a statistical basis

8. 7 of 37 Defensibility n Comes from doing good science n Requires documentation –“If it isn’t written down, it didn’t happen” n Use a standardized format n We must employ the scientific method to make defensible decisions

9. 8 of 37 How Many Samples do I Need? REMEMBER: HETEROGENEITY IS THE RULE!

10. 9 of 37 How many samples do I need? Begin With the End in Mind Optimal Sampling Design Alternative Sample Designs , , ,  Correct Equation for n (Statistical Method) Population Frequency Distribution Contaminant Concentrations in the Spatial Distribution of the Population The end DATA

11. 10 of 37 Logic to Assess Distribution and Calculate Number of Samples

12. 11 of 37 A Visual Decision Strategy

13. 12 of 37 Project Planning Documents n Work Plan n DQO Report n FSP n Quality Assurance Project Plan n HSP Must contain a clear presentation of (and the reasoning behind):

14. 13 of 37 Project Planning Documents General project decision goals More detailed, technical project goals/decision rules (DQOs), that will guide project decision-making Goals for data quality (MQOs) How sampling representativeness will be ensured, and how sampling uncertainty will be controlled List of analytical technologies and methods QC protocols and criteria to demonstrate that data of known quality will be generated Description how data will be assessed and interpreted according to the decision rules

15. 14 of 37 Analytical + Sampling & Sub-sampling + Natural heterogeneity of the site = Total Uncertainty Uncertainty is Additive! Remember the uncertainty is additive for all steps in sampling and analysis

16. 15 of 37 Keys to success –Sound technical basis –Complete and thorough documentation Do it! (Get the job done - right) Prove it! (Document what/why/how) Site Closed

17. 16 of 37 Managing Uncertainty Systematic Planning Dynamic Work Plan Real-Time Measurement Technologies

18. 17 of 37 Systematic Planning Managing Uncertainty with Systematic Planning for Environmental Decision Making http://www.doe.hanford.gov/dqo Sebastian Tindall Bechtel Hanford Inc. 3190 George Washington Way MS H9-03; Room 49 Richland, WA 99352 (509) 372-9195 sctindal@mail.bhi-erc.com

19. 18 of 37 Managing Uncertainty with Systematic Planning for Environmental Decision- Making DQO Training: 3 days DQA Training: 1 day Visual Sample Plan Primer: 3 hours DQO Applications BHI Training Courses: PNNL Training Course: Visual Sample Plan: 2.5 days (20 hours)

20. 19 of 37 Managing Uncertainty with Systematic Planning for Environmental Decision- Making Visual DQO: TBD Visual DQA: ver 2.0 - Visual Decision Suite (VDS) -Visual Decision Tutor (VDT) -Visual Population Creator (VPC) -Hands-On Statistics Toolbox (HOST) BHI Software Tools: PNNL Software Tools: Visual Sample Plan: ver 4.0

21. 20 of 37 Brent Pulsipher, Manager Statistical & Quantitative Sciences Pacific Northwest National Laboratory Richland, WA 99354 (509) 375-3989 brent.pulsipher@pnl.gov John Wilson, Programmer Statistical & Quantitative Sciences Pacific Northwest National Laboratory Grand Junction, CO 81503 (970) 270-2998 john.wilson@pnl.gov VSP Contacts

22. 21 of 37 Sampling for Environmental Activities Chuck Ramsey EnviroStat, Inc. PO Box 636 Fort Collins, CO 80522 970-689-5700 970-229-9977 fax chuck@envirostat.org www.envirostat.org

23. 22 of 37 Multi-Increment Sub-Sampling and Analyses Mark Boedigheimer CH2M HILL Applied Sciences Laboratory 2300 NW Walnut Blvd., Corvallis, OR 97330 541-752-4271 541-758-0245 Ext. 3125 Fax: 541-752-0276 mboedigh@ch2m.com

24. 23 of 37 DQO Consultants: Software for Environmental Statistics Jim Davidson Davidson and Davidson, Inc. 8390 Gage Blvd., Suite 205 Kennewick, WA 99336 (509) 374-4498; davidson@owt.com

25. 24 of 37 On-Site Environmental Sampling & Analyses J. Edward “Ned” Tillman Columbia Technologies 1450 So Rolling Rd Baltimore, MD 21227 410-536-9911 410-536-0222 (Fax) ntillman@columbiadata.com http://www.smart.columbiadata.com http://www.columbiadata.com

26. 25 of 37 Dynamic Work Plans A Guideline for Dynamic Workplans and Field Analytics: The Keys to Cost-Effective Site Characterization and Cleanup http://cluin.org/char1_edu.cfm#dyna_work Albert Robbat, Jr. Tufts University, Chemistry Department Center for Field Analytical Studies and Technology Medford, Massachusetts, 02155 tel: 617-627-3474 and fax: 617-627-3443

27. 26 of 37 DQO Consultants: Preparation & Facilitation Mitzi Miller Environmental Quality Management (EQM), Inc. 1777 Terminal Drive Richland, WA 99352 (509) 946-4985; Fax: (509) 946-4595 mitzim@eqminc.com

28. 27 of 37 DOE Sponsored Web Pages http:/www.hanford.gov/dqo/ http://dqo.pnl.gov/

29. 28 of 37 Program POCs Dr. Jeffrey W Day Department of Energy Office of Science Laboratory Management Division EMSL Richland, WA 99354 (509) 372-4629 Jeffrey_W_Day@rl.gov George Detsis Department of Energy EM-31 19901 Germantown Road Building 270 Germantown, MD 20874-1290 (301) 903-1488 george.detsis@hq.doe.gov Sebastian Tindall Bechtel Hanford Inc. 3190 George Washington Way MS H9-03; Room 49 Richland, WA 99354 (509) 372-9195 sctindal@mail.bhi-erc.com Brent Pulsipher Manager Statistical & Quantitative Sciences Pacific Northwest National Laboratories 3180 George Washington Way K6-08 Richland, WA 99354 (509) 375-3989 brent.pulsipher@pnl.gov

30. 29 of 37 Funding POCs Dr. Jeffrey W Day Department of Energy Office of Science Laboratory Management Division EMSL Richland, WA 99352 (509) 372-4629 Jeffrey_W_Day@rl.gov George Detsis Department of Energy EM-31 19901 Germantown Road Building 270 Germantown, MD 20874-1290 (301) 903-1488 george.detsis@hq.doe.gov Jo Ann Griffith Assistant Director OSWER USEPA Headquarters Ariel Rios Building; 5202G 1200 Pennsylvania Avenue, N. W. Washington, DC 20460 703-603-8774 griffith.joann@epa.gov Ken Skahn Contract Manager OSWER USEPA Headquarters Ariel Rios Building; 5202G 1200 Pennsylvania Avenue, N. W. Washington, DC 20460 703-603-8801 skahn.ken@epa.gov

31. 30 of 37 Credits Surajit Amrit, Bechtel-Jacobs, Knoxville, TN Mike Schwab, Bechtel Hanford, RL, WA Mark Byrnes, Fluor Hanford, RL, WA Roy Bauer, Fluor Hanford, Richland, WA Roger Ovink, CH2M Hill, Richland, WA Mitzi Miller, EQM, Richland, TN Debbie Carlson, PNNL, Richland, WA Susan Blackburn, SAIC, Richland, WA Tracy Friend, SAIC, Richland, WA

32. 31 of 37 Credits Dave Blumenkranz, SAIC, Richland, WA Gayelyn Gibson, EQM, Richland, WA Kelly Black, Neptune and Associates, Denver, CO Candy Hawk, Blue Sky Software, Richland, WA Al Robinson, EQM, Richland, WA Jeff Day, DOE-RL, Richland, WA Merrick “Rick” Blancq, USACE, Portland, OR Jim Davidson, D&D Inc., Kennewick, WA Chuck Ramsey, Envirostat, Ft Collins, CO

33. 32 of 37 FINAL EXAM What is the Question? What is the Population? What is the Confidence required? What is the DQO Process in a Nutshell?

34. 33 of 37 How Many Samples do I Need? REMEMBER: HETEROGENEITY IS THE RULE!

35. 34 of 37 “The bitterness of poor quality remains long after the sweetness of low price is forgotten” - Anonymous “If it isn’t written down, it didn’t happen”

36. 35 of 37 Summary  Use Classical Statistical sampling approach: Very likely to fail to get representative data in most cases  Use Other Statistical sampling approaches: Bayesian Geo-statistics Kriging  Use M-Cubed Approach: Based on Massive FAM  Use Multi-Increment sampling approach: Can use classical statistics Cheaper Faster Defensible: restricted to surfaces (soils, sediments, etc.) MASSIVE DATA Required 

37. 36 of 37 Class Feedback & Discussion What are your thoughts about the course? –Feedback –Questions –Concerns –Impressions –Suggestions

38. 37 of 37 End of Course Please take a few minutes to fill out and turn in all 3 of the course evaluation forms. Thank you for your attention this week. Thank you This concludes our presentation for Day 3