The U. S. Department of Energy’s Mixed-Analyte Performance Evaluation Program - MAPEP FY 2015 Review Anita Bhatt, Shane Steidley DOE Radiological and Environmental.

Slides:



Advertisements
Similar presentations
An Indispensable Quality Assurance Tool for Dairy Processing Plants.
Advertisements

Radiochemical Methods and Data Evaluation
Participation Requirements for a Patient Representative.
REDUCING BURDEN WHILE INCREASING QUALITY AT A GOVERNMENT AGENCY David A. Marker (Westat), Mary K. Dingwall (Westat), and Marla D. Smith (U.S. EPA) Presented.
ENVIRONMENTAL UNIT IN AN ICS STRUCTURE. EU Mission Statement The Environmental Unit is established to provide technical and scientific expertise and capabilities.
1 SOFTWARE TESTING Przygotował: Marcin Lubawski. 2 Testing Process AnalyseDesignMaintainBuildTestInstal Software testing strategies Verification Validation.
Robert D. Walla, Larry A. Hacker, Ph.D. Astrix Technology Group 1090 King Georges Post Rd Edison, NJ LIMS Selection In A Forensic Toxicology Laboratory.
Supplier SQM Participation. 2 | MDT Confidential What is SQM? Stands for Supplier Quality Managment –Formally referred to as SPACE and SPICE Is a system.
Community Governance Consensus Based Governance RECOMMENDATIONS.
Interpreting Your Lab Report & Quality Control Results
SOFTWARE QUALITY ASSURANCE Maltepe University Faculty of Engineering SE 410.
Laboratory Personnel Dr/Ehsan Moahmen Rizk.
Scientific method - 1 Scientific method is a body of techniques for investigating phenomena and acquiring new knowledge, as well as for correcting and.
Evaluating And Negotiating An IT Contract — The Buyer’s View Allan P. Weeks Attorney-At-Law Law Office of Allan Page Weeks Insert your logo in this area.
Laboratory Information Management Systems (LIMS) Lindy A. Brigham Div of Plant Pathology and Microbiology Department of Plant Sciences PLS 595D Regulatory.
QA/QC FOR ENVIRONMENTAL MEASUREMENT
An introduction to the National Voluntary Laboratory Accreditation Program Sally Bruce, Chief for the National Voluntary Laboratory Accreditation Program.
U.S. Department of Energy’s Consolidated Audit Program (DOECAP) U.S. Department of Energy’s Consolidated Audit Program (DOECAP) Dr. Todd L. Hardt DOECAP.
Carrie Lee Herndon Solutions Group WaterSmart Innovations ‘09 August 12, 2010.
Building a Case for Digital Migration Anna Stratton Director, Information Management Southwest Solutions Group 1 Created in partnership with ARMA International.
Session No. 3 ICAO Safety Management Standards ICAO SMS Framework
U.S. Department of Energy’s Analytical Services Program Systematic Planning and Data Assessment Tools and Training - SPADAT DOE Consolidated Audit Program.
Introduction to ISO New and modified requirements.
U.S. Department of Energy’s Consolidated Audit Program George E. Detsis Manager, Analytical Services Program Office of Corporate Safety Programs, HS-31.
Intern 2 Learn Program Overview. Intern 2 Learn What is Intern 2 Learn ? Intern 2 Learn is an undergraduate, student employment program designed to: Provide.
RESPONSIBILITY What is “Responsibility” to most people? Believe it or not, to most, It’s a Dirty Word. We see responsibility as a burden, obligation and.
American Association for Laboratory Accreditation Practical Solutions to Traceability and Uncertainty in Accreditation Presented to CITAC-NCSLI Joint Workshop.
QA/QC and QUALIFIERS LOU ANN FISHER CITY OF STILLWATER, OK
Certification and Accreditation CS Phase-1: Definition Atif Sultanuddin Raja Chawat Raja Chawat.
HOW TO ASSESS SUPPLIER RESPONSIBILITY (TECHNICALLY & FINANCIALLY) Mariel D’Eustachio Dave Avera 3/28/00.
Chapter 8: Preliminary Survey & Internal Control Review
Introduction The past, the present and the future.
Product Documentation Chapter 5. Required Medical Device Documentation  Business proposal  Product specification  Design specification  Software.
QUALITY ASSURANCE Quality Assurance of Reagents, Supplies, And Laboratory Water.
ERLN OPERATIONAL FRAMEWORK EPA Quality Management Conference Presented By: Sean Kolb Schatzi Fitz-James and Terry Smith, OEM Sean Kolb and Lisa Modigliani,
The U. S. Department of Energy’s Mixed-Analyte Performance Evaluation Program (MAPEP) FY 2014 Review Shane Steidley DOE Radiological and Environmental.
Laboratory Ethics – An Overview Part II What You Need To Know What You Need To Do.
SINTEF Telecom and Informatics EuroSPI’99 Workshop on Data Analysis Popular Pitfalls of Data Analysis Tore Dybå, M.Sc. Research Scientist, SINTEF.
ME551/GEO551 Introduction to Geology of Industrial Minerals Spring 2005 SAMPLING.
Quality Assurance How do you know your results are correct? How confident are you?
Code Blue Quality Assurance Management Created by HSG.
Management System Part I: Quality System. Management system Objectives To understand the importance of a management system to ensure effectiveness of.
Reclaimed Wastewater Quality Criteria, Standards, and Guidelines
Investigational Devices and Humanitarian Use Devices June 2007.
1 OSHA’s Approach to Nanotechnology: Developing a Searchable "Health Effects Matrix" Database for Nanomaterials Utilizing Existing Published Data Janet.
Mitigating Risk 2015 SEWP Acquisition Summit and Training 1 December 8-10, 2015.
MAPEP and the Role of the Cognizant Radiochemist in the Analytical Laboratory P.C. Temple Warwick, PhD RESL Office of Nuclear Energy U.S. Department of.
A Brief Overview of the Radioprotection Activities in the Joint Research Centre Ispra - Italy Nina JUDGE * and Francesco D’ALBERTI ** * Medical Service.
George E. Detsis Manager, Analytical Services Program (ASP) Office of Sustainable Environmental Stewardship Radiation Measurements Cross-Calibration (RMCC)
THE ROLE OF PROFICIENCY TESTING - A PERSPECTIVE FROM AN ACCREDITATION BODY Randall Querry American Association for Laboratory Accreditation (A2LA) November.
2016 MFRPS: Changes To Standard 10 Guy F. Delius, R. S. CSO Food and Drug Administration Office Of Partnerships Standards Implementation Staff February.
George E. Detsis Analytical Services Program Manager Radiation Measurements Cross Calibration IX Workshop Amman, Jordan October 20-22, 2014 U.S. Department.
DOECAP Laboratories Phased Audits U.S. Department of Defense 2016 Environmental Monitoring and Data Quality Workshop St. Louis, Missouri April 12-14, 2016.
Clinical Utility of EQA Dr. Angela Amayo UON27/11/2008.
Aroclor Analysis and the Challenge of Matrix Interference “Using a Holistic approach in the Laboratory to analyze uncommon matrices with Confidence and.
Leading Your District To Be All That It Can Be David Williams, Deputy Director Div. of Soil & Water Conservation 2016 Spring Area Meetings.
High Level Symposium to Enhance Regulator Expertise on Good Regulatory Practices and the WTO Agreement on Technical Barriers to Trade.
Technical External Management Requirements Technology Complexity Interfaces Reliability / Performance Quality Planning Controlling Funding / Resources.
Chapter 8 Selection. chapter 8 Selection Selection – the process by which an organization chooses from a list of applicants the person or persons who.
DOECAP Laboratories Phased Audits U. S
Proficiency Test Samples: What are We Really Testing?
2016 Analytical Services Program Workshop
SYSTEMS ANALYSIS Chapter-2.
DOE Radiological and Environmental
September 2017 Phillip Godorov Caitlin Farrell
Achieving ISO Compliance
Radiation Measurements Cross-Calibration (RMCC) Project Briefing for Patrick Ball United States of America Embassy Amman, Jordan George E. Detsis.
ME551/GEO551 Introduction to Geology of Industrial Minerals Spring 2007 SAMPLING.
SDWA Collaborative Efforts Overview
MECH 3550 : Simulation & Visualization
Presentation transcript:

The U. S. Department of Energy’s Mixed-Analyte Performance Evaluation Program - MAPEP FY 2015 Review Anita Bhatt, Shane Steidley DOE Radiological and Environmental Sciences Laboratory ASP Meeting 2015 Sept. 14, 2015

2 ASP Objectives Assure that data acquired from analytical environmental laboratories are valid, reliable and defensible. Provide quality assurance, risk reduction, & cost efficiencies for DOE site managers, workers, and the public. Defensible environmental data support confident decision- making and regulatory (milestones) compliance.

3 MAPEP Objectives Supports ASP objectives in addition to the DOE mission. Performance Evaluation Program.  Evaluates analytical work based on performance. Address specific analytical issues routinely encountered that affect the accuracy of the results. Tests the accuracy of analytical procedures on a variety of real samples being submitted to DOE for analysis.

4 RESL’s Established Quality Systems  Accredited to ISO/IEC-17025: General Requirements for Chemical Testing & External Dosimetry  Accredited to ISO/IEC-17043: General Requirements for Proficiency Testing Provider  Accredited to ISO/IEC-G34: General Requirements for Certified Reference Material Producer  NIST/RESL Radiological Traceability Program

5 MAPEP Criticism “In my opinion the MAPEP sessions came off with an arrogant tone” … “I think RESL MAPEP program is one of the best in the world – if not the best” … not notifying or providing any communication that changes were being initiated. … intention by RESL deceive (or trick) the participating laboratories without stating the changes to the uranium sample/standard… “MAPEP personnel need to stop telling labs how incompetent they are. … Feel free to provide my name with this comment”.

6 Job of the Analytical Chemist “The responsibility of an analytical chemist is to accurately determine the analyte of interest in the sample being submitted for analysis. Lately, there has been a trend to excuse poor performance and rationalize inadequate chemical procedures or inaccurate work as acceptable.” David S. Sill

7 Discussion In Last ASP “We don’t have insoluble forms of Plutonium in our samples…we know our source term and it only contains analytes that are leachable.”  How do they know???  It is impossible to determine the species of Plutonium without doing the analytical work.  Insoluble Plutonium can be formed in the analytical method itself. It does not have to be present in the original sample. – Muffling the organic sample, evaporation to dryness, etc.  The most stable form of Plutonium is the insoluble form.

8 Discussion In Last ASP “Deposited Plutonium on urban matrices does not require total dissolution.”  It is the chemical form (oxidation state) of the Plutonium, not its physical location that is important. – The Plutonium on the surface of concrete, glass, or building materials can be just as insoluble as if it were in the middle of the sample. – Leaching will not produce an accurate result on superficially contaminated urban matrices when insoluble Plutonium is present.

9 Discussion In Last ASP “Total dissolution is not economically or physically feasible for commercial labs...”  Bids should reflect what it actually costs to produce accurate results.  There are numerous dissolution techniques that produce accurate and reliable results without being economically burdensome.

10 Discussion In Last ASP “DOECAP Priority 1 finding hurts the reputation of the Laboratory.”  Repeated analytical failure generate Priority 1 finding.  Many laboratories that fail MAPEP claim the test is unfair as they are contractually obligated to use certain methods.  This situation is similar to DU, I-129, Sb, and False Positive testing problems encountered by MAPEP.  Problems are degenerating into personal attacks.

11 Discussion In Last ASP “Our customer (DOE) doesn’t want total numbers; they prefer leachable numbers…labs are contractually obligated to use leaching procedures…”  Is it acceptable to knowingly underestimate the amount of Plutonium in the environment or leave an unknown quantity of radioactive material undetected in the sample?  DOE does not condone the generation of inaccurate results.  Many data users don’t know that there are insoluble forms of radionuclides and may assume leachable results represent the total.

12 Specifics Suggestions Chemical dissolution techniques should address the common problems encountered in real world samples. Results obtained by acid leaching of the sample will not be accurate if insoluble compounds or insoluble matrix components are present, and there is no way to tell without proper analysis.

13 Specifics Suggestions Leaching techniques should only be used when proven to be effective and demonstrated to produce accurate results equal to total dissolution methods. MAPEP is performance based and does not mandate the use of specific analytical techniques. MAPEP evaluates analytical performance based on NIST Traceable reference values, and not experimentally determined consensus values.

14 Technical Assistance MAPEP provided technical assistance with sample dissolution techniques. U-234 Bias

15 Initial Participation in New Matrices When new matrices are offered, the participation is only ~20%.

16 MAPEP Series Overview MAPEP System Usage Agreement Technical Highlights  Uranium in Soil  False Positive/Sensitivity Tests  Sr-89/90 Air Filter  Tc-99 Soil Note  Pu-239 & Am-241 Reported by Mass Spectrometry

17 MAPEP System Usage Agreement Agree to abide by MAPEP’s System Usage Agreement or Export Control Agreement. Labs are required to update SUA after 6 months.

18 Uranium Results Reported By Alpha Spectrometry

19 MAS U-234 Letters of Concern

20 MAPEP Series 32 False Positives

21 False Positives Testing

22 MAPEP Series 32 Sensitivity Tests

23 Sr-89/90 Air Filter Sr-89/90 Activity Ratio SrF3112 SrF3245

24 Tc-99 Soil Letter of Concerns by Series

25 Performance Evaluation of Tc-99 in Soil TcO 4 - anion should be a completely water soluble species, unlike plutonium. However… It has been found that TcO 4 - is extremely insoluble in some soils. Treatment of the soils using alkaline fusion techniques and/or treatment with HF was necessary for accurate results.

26 Base Soil Analytical Values

27 Pu-239/240 Alpha Spec

28 MASS Determinations Mass determinations of Pu-239 and Am-241 were evaluated for the 1st time in MaW32 session.

29 Special Radiological Matrix XrM for Series 33 Special Radiological Matrix (XrM)  Undisclosed sample matrix and radionuclides.  Activity to be reported per sample.  Results will be evaluated based on bias from the known.  Acceptance flags will not be assigned to results. – Non punative, promote increased scientific capability, … Designed to encourage participants to test full analytical capabilities.  Thirty seven laboratories requested the XrM sample.

30 Performance Testing Material Ra-226 Based on customer requests, RESL is considering a Ra-226 Performance Testing Material.  Water ?  Soil, Vegetation, Filters ? Is there an interest in a Ra-226 standard? 

31 RESL Contacts Anita Bhatt, RESL Director – Shane Steidley, MAPEP Database – Guy Marlette, MAPEP Coordinator – Technical assistance can be requested from MAPEP chemists.

32 Public access Statistical summary Requires account /password Used for reporting/reviewing data Various search utilities, historical performance reviews, graphs, individual laboratory reports, sample descriptions, program information. MAPEP Websites

33 Send completed forms to Any questions contact MAPEP coordinator Guy Marlette ( ), MAPEP Application