3. Quality in Forensic Service Accuracy & Reliability Are Present, Just Like on CSI, Right? Massachusetts State Police Crime Laboratory Sudbury, Massachusetts Carl M. Selavka, Ph.D., D-ABC Director

4. And Now, A Word A Word From My Sponsor:

5. Disclaimers The opinions expressed in this presentation are those of the author and do not necessarily represent the official positions of the:

6. Disclaimed Agencies Commonwealth of Massachusetts Executive Office of Public Safety Department of State Police Crime Laboratory System

7. Disclaimed Agencies NIJAAFS DHHSASCLD ABCNEAFS FEPACACS

8. Disclaimed Agencies NCST&L (Participants, Attendees, Those Actually Awake)

9. ThatTitle

10. The Real Forensic World The Real Forensic World Quality is Easy, Right? Quality is Easy, Right? Structure from Chaos Structure from Chaos Legal Synergy Legal Synergy This is GOOD! This is GOOD! Presentation Summary Presentation Summary

11. From Crime Commission to Discovery From Crime Commission to Discovery On-Site First-Responders & Investigators On-Site First-Responders & Investigators Evidence Recognition, Presentation to Key Responders, Documentation, Collection & Transport Integrity Evidence Recognition, Presentation to Key Responders, Documentation, Collection & Transport Integrity Triage to Avoid Exhaustive Examinations Triage to Avoid Exhaustive Examinations The Examinations Themselves…. The Examinations Themselves…. The Real Forensic World

12. Interpretations of Elicited & Missing Data Interpretations of Elicited & Missing Data Contextual Elements Insure “Probative” Forensic Reports Contextual Elements Insure “Probative” Forensic Reports Iterative Evidentiary Management Yields “Non-Advocacy” Credibility Iterative Evidentiary Management Yields “Non-Advocacy” Credibility Presentation in Court Provides Forensic Defensibility Presentation in Court Provides Forensic Defensibility The Real Forensic World

14. Quality Assurance

15. Quality (Webster’s II – 1984) Quality (Webster’s II – 1984)  Essential Character  An Inherent Attribute  Degree of Excellence Assurance Assurance  A Statement Intended to Inspire Confidence Quality in Forensic Science

16. Ideal Lab Management Is Our QA Program Proper? Is Our QA Program Proper? Is the Personnel System OK? Is the Personnel System OK? Do We Use Good Science? Do We Use Good Science? Do We Report Correctly? Do We Report Correctly? Are We Defensible? Are We Defensible?

17. Infrastructure Accreditation Certification Standardization

18. Quality Control Quality Control QualityAssurance National NationalStandards

19. Infrastructure Accreditation

20. Quality Assurance A AA ASCLD/LAB

21. ASCLD / LAB American Society of Crime Laboratory Directors / Laboratory Accreditation Board

22. Other Accreditations ISO 17025 (Guide 25) ISO 17025 (Guide 25) NAME – Death Investigation NAME – Death Investigation IAI – Fingerprints IAI – Fingerprints AFTE – Firearms, TMs AFTE – Firearms, TMs ABFT – Toxicology ABFT – Toxicology

23. Other Accreditations NATA, SCC, NAMAS NATA, SCC, NAMAS See the URL for More: See the URL for More: www.ascld-lab.org  Click On “Resources”  Click “Forensic Links” and you’ll get 36 Recognized Sites!!

24. Why ASCLD / LAB? Objective Process Impartial Review Impartial Review Consensus Standards Consensus Standards Peer-Based Peer-Based

25. Infrastructure Accreditation Certification

26. Is the Personnel System OK? ABC (www.criminalistics.com) www.criminalistics.com ABFT (www.abft.org) www.abft.org IAI (www.theiai.org) www.theiai.org

27. Certification is NOT an End Unto Itself Certification is a passageway - a commitment to continued professional development

28. Proficiency Tests (PTs)

29. RecognizePossiblyDeviantResults

30. Differentiate Anecdotal Issues From Systemic Performance Improvement Opportunities Differentiate Anecdotal Issues From Systemic Performance Improvement Opportunities Document Corrective Actions Document Corrective Actions Reestablish Competency Reestablish CompetencyDocumentation That QA Guarantee…

31. Change the Examiner’sJob

32. Why Is This a Good Approach to Certification? Objective Process Objective Process Impartial Review Impartial Review Consensus Standards Consensus Standards Peer-Based Peer-Based

33. Accreditation – ASCLD/LAB & Others Accreditation – ASCLD/LAB & Others Certification Certification AAFS Forensic Specialties Accreditation Board  2004 NIJ Guide – Appendix C 9 FSAB-Recognized Programs 9 FSAB-Recognized Programs 14 Organizations Listed 14 Organizations Listed Quality in Forensic Science

34. Infrastructure Accreditation Certification Standardization

35. Do We Use Good Science? Do We Report Correctly? T/SWG - ___ ASTM

36. T / SWG Technical or Scientific Working Group for / on _____ (18 Total)

37. Technical WG = NIJ TWG-BSI TWG-BSI Bombing Scene Investigation TWG-CSI TWG-CSI Crime Scene Investigation TWG-DI TWG-DI Death Invesigation

38. TWG-DE TWG-DE Digital Evidence TWG-EYEE TWG-EYEE Eyewitness Evidence TWG-FASI TWG-FASI Fire/Arson Scene Investigation TWG-MFFI TWG-MFFI Mass Fatality Forensic ID

39. Scientific WG = FBI SWG-STAIN SWG-STAIN Bloodstain Pattern Analysis SWG-DE SWG-DE Digital Evidence SWG-DAM SWG-DAM DNA Analysis Methods

40. SWG-GUN SWG-GUN Firearms and Toolmarks SWG-FAST SWG-FAST Friction Ridge Analysis, Study and Technology SWG-IT SWG-IT Imaging Technologies

41. SWG-MAT SWG-MAT Materials Analysis SWG-MGF SWG-MGF Microbial Genetics & Forensics SWG-DOC SWG-DOC Forensic Document Exam

42. Scientific WG = DEA SWG-DRUG SWG-DRUG for the Analysis of Seized Drugs TWG-FEX TWG-FEX Fire & Explosions Investigations Technical WG = NCFS

43. ASTM American Society for Testing & Materials – Committee E30 on Forensic Sciences (Now ASTM International)

44. ASTM International 9 E30 Technical Groups 9 E30 Technical Groups 6 E30 Specialty Groups 6 E30 Specialty Groups 25 E30.01 Criminalistics Standards 25 E30.01 Criminalistics Standards

45. Objective Process Objective Process Impartial Review Impartial Review Consensus Standards Consensus Standards Peer-Based Peer-Based Why Is This a Good Approach to Standardization?

46. Accreditation – ASCLD/LAB & Others Accreditation – ASCLD/LAB & Others Certification – AAFS FSAB & Others Certification – AAFS FSAB & Others Standardization Standardization ASTM Committee E30 on Forensic Sciences NIJ, FBI, DEA and NCFS Sponsors  2004 NIJ Guide – Appendix D 19 Standardization Groups 19 Standardization Groups Quality in Forensic Science

47. Infrastructure Accreditation Certification Standardization QualityForensicServices

49. National Agencies? National Agencies? State Agencies? State Agencies?  NY, OK, TX Crime Laboratories  Exempt Categories Plentiful  Examiners = NO Municipal Agencies? Municipal Agencies? Local Governments? Local Governments? Required Quality Assurance NO!

50. What You Should Expect From Forensic Practitioners

51. Practical Quality Guarantees We Provide

52. FEPAC Forensic Science Education Programs Accreditation Commission

53. Infrastructure Accreditation Certification Standardization Quality Forensic Forensic Services Services Educational Harmonization

54. Accuracy is NOT Ensured Accuracy is NOT Ensured Reliability is NOT Ensured Reliability is NOT Ensured In Our Advocacy Process, Accuracy & Reliability Rest in the Eye of the Beholder In Our Advocacy Process, Accuracy & Reliability Rest in the Eye of the Beholder QA Take-Away:

55. Can You All Now Run With the Big Dogs? Yes, You Can.

57. Acknowledgements Acknowledgements NCST&L Organizing Committees & Leadership Team - Professor Carol Henderson - Professor Carol Henderson Massachusetts State Police - Colonel Robbins & Command Staff - Colonel Robbins & Command Staff - MSP Crime Lab System - MSP Crime Lab System