3. Question You see a trend or pattern in your environmental data that you didn’t expect. How might you explain this? 2

4. Blind Samples What is a “Blind” sample? A blind sample is a quality-control sample whose composition and origin is unknown except to those who are submitting the sample. It is disguised to appear like a regular environmental sample to the laboratory. Its purpose is to allow a realistic and uncensored measure of bias and variability of the entire laboratory process. 3

5. Blind Samples How do blind-samples results help data-users assess their environmental sample results from the NWQL? Blind samples are treated the same as environmental samples and are designed to capture the same sources of variability as environmental samples  Inorganic-from login through NWIS  Organic-from login through StarLIMS Blind samples and on-line QC samples are different 4

6. Blind Samples How do blind-samples results help data-users assess their environmental sample results from the NWQL? User accessible data sets  Blind-sample results are retrieved, posted, and available to the data-user Inorganic – Within 1-3 days of release from the NWQL Organic – Data reviewed when available. 5

7. Current products that help aid in data interpretation Time-series charts/box plots  To observe bias and variability over time Recovery versus concentration charts  To assess recovery and variability at different concentration ranges Blind-blank/false positive/false negative charts  To observe blank contamination and assess reporting levels 6

8. Current products that help aid in data interpretation Raw data Custom data packets Data-quality assessment reports 7

9. Time-series charts: IBSP 8

10. Question You see a trend or pattern in your environmental data that you didn’t expect. How might you explain this? 9

11. Time-series charts: IBSP 10

12. Time-series charts: IBSP 11

13. Time-series charts: OBSP 12

14. Time-series charts: OBSP 13

15. Box Plots: OBSP 14 BQS ORGANIC BLIND SAMPLES DETERMINATION: CYANAZINE, SCHEDULE: 2033 TESTIDCODE: 04041GCM35, MEASURED IN MICROGRAMS PER LITER 04/03/08 TO 12/22/11 Open Data Set

16. Recovery vs. Concentration: OBSP 15

17. Question You’re seeing unexpected results in your blank/low-level environmental sample data. How can you sort out these issues? 16

18. Blind-blank charts: IBSP ICPMS, Nickel, Water, Filtered, collision Test ID: 01065PLM10, Labcode: 3130 Open DataSet 17

19. Blind-blank charts: IBSP ICPMS, Aluminum, Water, Filtered Test ID: 01106PLM43, Labcode: 1784 Open DataSet 18

20. False positive charts: OBSP 19

21. False positive charts: OBSP 20 False Positives Listing for DIETHYL PHTHALATE

22. False positive charts: OBSP 21 False Positives Listing for 3-Chloropropene

23. Question You expected to see a certain compound in your sample and instead you received a < (less than) as your result. Are the concentrations in your samples too low to be quantified? 22

24. False negative charts: OBSP 23

25. False negative charts: OBSP 24 False Positives Listing for CHLORAMBEN, METHYL ESTER False Negatives Listing for CHLORAMBEN, METHYL ESTER

26. Question You think quality-control charts are OK, but you would really just like to have the data to work with it yourself. How can you easily obtain a subset of the QC data in a user-friendly format? 25

27. Raw data: IBSP/OBSP ICPMS, Nickel, Water, Filtered, collision Test ID: 01065PLM10, Labcode: 3130 Open DataSet 26

28. Raw data: IBSP/OBSP ICPMS, Nickel, Water, Filtered, collision Test ID: 01065PLM10, Labcode: 3130 Open DataSet 27

29. Raw data: IBSP/OBSP 28

30. Branch of Quality Systems bqs.usgs.gov Inorganic blind-sample project  Ted Struzeski Organic blind-sample project  Suranne Stineman 29

31. Question The website can be overwhelming with so many QC charts for so many parameters. Can you just have a summary of suspected data-quality issues? 30

32. Data-quality assessment reports Inorganic: Every-other-month Organic: Data reviewed when available Data Quality Assessment Report - August 2011 2060 Analyte NameOBSP NotesNWQL CommentCorrective Action Chloramben methyl ester The most recent two points are recovering slightly higher than the recoveries seen prior to these samples. The two samples are from two different OBSP spike mixes. Chloramben methyl ester has an interference peak which can cause it to be more difficult to quantitate at lower concentrations. The calculated LTMDL FY2012 has increased from 0.05 to 0.10 µg/L due to the presence of the interference. The LT-MDL was raised in FY12 for this compound. Also mentioned in the November 2010 report this analyte showed some false negatives all coming from one vendor. Since then, there have been multiple false negatives from 3 more different vendors. This is likely due to the problems in quantitation of this compound at low levels due to the presence of the interference. 31

33. Data-quality assessment reports 32

34. Moving Forward… Inorganic Blind Sample Project Method-to-method charts  To assess data-quality between methods Method A versus method B Filtered versus unfiltered Old method versus new method Concentration-dependent charts  To assess concentration-dependent bias and variability Percent RSD charts  To assess variability at a given concentration  To characterize overall method variability 33

35. Inorganic Blind Sample Project Potential Future Products  Analyte by different methods: ICP versus DA 34

36. Inorganic Blind Sample Project Potential Future Products  Analyte in different phases: filtered versus unfiltered – Example 1 35

37. Inorganic Blind Sample Project Potential Future Products  Analyte in different phases: filtered versus unfiltered – Example 2 36

38. Inorganic Blind Sample Project Potential Future Products  Analyte by different methods: old method versus new method 37

39. Inorganic Blind Sample Project Potential Future Products  Concentration-dependent recovery charts 38

40. Inorganic Blind Sample Project Potential Future Products  % Relative Standard Deviation chart 39

41. Math! %RSD = (SD/mean)*100 SD = %RSD(mean)/100 Let %RSD = 3 and concentration = 20 mg/L SD = 3(20)/100 SD = 0.6 40

42. 41 Analyte in multiple methods To assess data-quality performance across multiple methods Old method versus new method Chart of expected and reported concentration versus time To assess concentration-dependent bias over time Annual false positive and false negative summaries To assess potential contamination issues or interferences To assess confidence in low-concentration results Plot some “user defined limits” on the various charts To assess how blind-sample results compare to these limits Moving Forward… Organic Blind Sample Projects

43. Got Caffeine… 42

44. 43 Potential Future Products  Analyte by several different methods Organic Blind Sample Project

45. 44 Potential Future Products  Analyte by several different methods Organic Blind Sample Project

46. Potential Future Products  Expected and reported concentration versus time 45

47. April 08, 2010 to Jan 19, 2012 LS 1383TestIDCAS## spikedFalse negative# not spikedFalse positives Acenaphthylene34200GCM57208-96-8 210270 Acenaphthene34205GCM5783-32-9 210270 Anthracene34220GCM57120-12-7 21 0 272 Benzo[b]fluoranthene34230GCM57205-99-2 210270 Benzo[k]fluoranthene34242GCM57207-08-9 210270 Benzo[a]pyrene34247GCM5750-32-8 210271 bis(2-Chloroethyl)ether34273GCM57111-44-4 210270 bis(2-Chloroethoxy)methane34278GCM57111-91-1 210270 bis(2-chloroisopropyl) ether34283GCM57108-60-1 210270 Butylbenzyl phthalate34292GCM5785-68-7 210272 Chrysene34320GCM57218-01-9 210270 Diethyl phthalate34336GCM5784-66-2 210270 Dimethyl phthalate34341GCM57131-11-3 211273 46 Organic Blind Sample Project Potential Future Products  False positives and false negatives summary table

48. ------- = Recovery range (50% to 150%) Organic Blind Sample Project 47 Potential Future Products  User defined limits on an existing time series chart

49. Moving Forward… Inorganic & Organic Blind Sample Projects Modification to format of existing data-quality assessment reports Look into NWIS toolbox for IBSP and OBSP data analysis QA upcoming organic tissue and sediment methods Use more different types of matrices for the inorganic blind samples Provide information about the matrix for the inorganic blind samples 48

50. Moving Forward… Inorganic & Organic Blind Sample Projects Requesting input from the data users  What do you want to see?  What would be useful to you? 49

51. Branch of Quality Systems bqs.usgs.gov Inorganic blind-sample project  Ted Struzeski  bqs.usgs.gov/ibsp/  struzesk@usgs.gov  303.236.1872 Organic blind-sample project  Suranne Stineman  bqs.usgs.gov/obsp/  stineman@usgs.gov  303.236.1821 50