Quality in Forensic Service Accuracy & Reliability Are Present, Just Like on CSI, Right? Massachusetts State Police Crime Laboratory Sudbury, Massachusetts Carl M. Selavka, Ph.D., D-ABC Director

And Now, A Word A Word From My Sponsor:

Disclaimers The opinions expressed in this presentation are those of the author and do not necessarily represent the official positions of the:

Disclaimed Agencies Commonwealth of Massachusetts Executive Office of Public Safety Department of State Police Crime Laboratory System

Disclaimed Agencies NIJAAFS DHHSASCLD ABCNEAFS FEPACACS

Disclaimed Agencies NCST&L (Participants, Attendees, Those Actually Awake)

ThatTitle

The Real Forensic World The Real Forensic World Quality is Easy, Right? Quality is Easy, Right? Structure from Chaos Structure from Chaos Legal Synergy Legal Synergy This is GOOD! This is GOOD! Presentation Summary Presentation Summary

From Crime Commission to Discovery From Crime Commission to Discovery On-Site First-Responders & Investigators On-Site First-Responders & Investigators Evidence Recognition, Presentation to Key Responders, Documentation, Collection & Transport Integrity Evidence Recognition, Presentation to Key Responders, Documentation, Collection & Transport Integrity Triage to Avoid Exhaustive Examinations Triage to Avoid Exhaustive Examinations The Examinations Themselves…. The Examinations Themselves…. The Real Forensic World

Interpretations of Elicited & Missing Data Interpretations of Elicited & Missing Data Contextual Elements Insure “Probative” Forensic Reports Contextual Elements Insure “Probative” Forensic Reports Iterative Evidentiary Management Yields “Non-Advocacy” Credibility Iterative Evidentiary Management Yields “Non-Advocacy” Credibility Presentation in Court Provides Forensic Defensibility Presentation in Court Provides Forensic Defensibility The Real Forensic World

Quality Assurance

Quality (Webster’s II – 1984) Quality (Webster’s II – 1984)  Essential Character  An Inherent Attribute  Degree of Excellence Assurance Assurance  A Statement Intended to Inspire Confidence Quality in Forensic Science

Ideal Lab Management Is Our QA Program Proper? Is Our QA Program Proper? Is the Personnel System OK? Is the Personnel System OK? Do We Use Good Science? Do We Use Good Science? Do We Report Correctly? Do We Report Correctly? Are We Defensible? Are We Defensible?

Infrastructure Accreditation Certification Standardization

Quality Control Quality Control QualityAssurance National NationalStandards

Infrastructure Accreditation

Quality Assurance A AA ASCLD/LAB

ASCLD / LAB American Society of Crime Laboratory Directors / Laboratory Accreditation Board

Other Accreditations ISO (Guide 25) ISO (Guide 25) NAME – Death Investigation NAME – Death Investigation IAI – Fingerprints IAI – Fingerprints AFTE – Firearms, TMs AFTE – Firearms, TMs ABFT – Toxicology ABFT – Toxicology

Other Accreditations NATA, SCC, NAMAS NATA, SCC, NAMAS See the URL for More: See the URL for More:  Click On “Resources”  Click “Forensic Links” and you’ll get 36 Recognized Sites!!

Why ASCLD / LAB? Objective Process Impartial Review Impartial Review Consensus Standards Consensus Standards Peer-Based Peer-Based

Infrastructure Accreditation Certification

Is the Personnel System OK? ABC ( ABFT ( IAI (

Certification is NOT an End Unto Itself Certification is a passageway - a commitment to continued professional development

Proficiency Tests (PTs)

RecognizePossiblyDeviantResults

Differentiate Anecdotal Issues From Systemic Performance Improvement Opportunities Differentiate Anecdotal Issues From Systemic Performance Improvement Opportunities Document Corrective Actions Document Corrective Actions Reestablish Competency Reestablish CompetencyDocumentation That QA Guarantee…

Change the Examiner’sJob

Why Is This a Good Approach to Certification? Objective Process Objective Process Impartial Review Impartial Review Consensus Standards Consensus Standards Peer-Based Peer-Based

Accreditation – ASCLD/LAB & Others Accreditation – ASCLD/LAB & Others Certification Certification AAFS Forensic Specialties Accreditation Board  2004 NIJ Guide – Appendix C 9 FSAB-Recognized Programs 9 FSAB-Recognized Programs 14 Organizations Listed 14 Organizations Listed Quality in Forensic Science

Infrastructure Accreditation Certification Standardization

Do We Use Good Science? Do We Report Correctly? T/SWG - ___ ASTM

T / SWG Technical or Scientific Working Group for / on _____ (18 Total)

Technical WG = NIJ TWG-BSI TWG-BSI Bombing Scene Investigation TWG-CSI TWG-CSI Crime Scene Investigation TWG-DI TWG-DI Death Invesigation

TWG-DE TWG-DE Digital Evidence TWG-EYEE TWG-EYEE Eyewitness Evidence TWG-FASI TWG-FASI Fire/Arson Scene Investigation TWG-MFFI TWG-MFFI Mass Fatality Forensic ID

Scientific WG = FBI SWG-STAIN SWG-STAIN Bloodstain Pattern Analysis SWG-DE SWG-DE Digital Evidence SWG-DAM SWG-DAM DNA Analysis Methods

SWG-GUN SWG-GUN Firearms and Toolmarks SWG-FAST SWG-FAST Friction Ridge Analysis, Study and Technology SWG-IT SWG-IT Imaging Technologies

SWG-MAT SWG-MAT Materials Analysis SWG-MGF SWG-MGF Microbial Genetics & Forensics SWG-DOC SWG-DOC Forensic Document Exam

Scientific WG = DEA SWG-DRUG SWG-DRUG for the Analysis of Seized Drugs TWG-FEX TWG-FEX Fire & Explosions Investigations Technical WG = NCFS

ASTM American Society for Testing & Materials – Committee E30 on Forensic Sciences (Now ASTM International)

ASTM International 9 E30 Technical Groups 9 E30 Technical Groups 6 E30 Specialty Groups 6 E30 Specialty Groups 25 E30.01 Criminalistics Standards 25 E30.01 Criminalistics Standards

Objective Process Objective Process Impartial Review Impartial Review Consensus Standards Consensus Standards Peer-Based Peer-Based Why Is This a Good Approach to Standardization?

Accreditation – ASCLD/LAB & Others Accreditation – ASCLD/LAB & Others Certification – AAFS FSAB & Others Certification – AAFS FSAB & Others Standardization Standardization ASTM Committee E30 on Forensic Sciences NIJ, FBI, DEA and NCFS Sponsors  2004 NIJ Guide – Appendix D 19 Standardization Groups 19 Standardization Groups Quality in Forensic Science

Infrastructure Accreditation Certification Standardization QualityForensicServices

National Agencies? National Agencies? State Agencies? State Agencies?  NY, OK, TX Crime Laboratories  Exempt Categories Plentiful  Examiners = NO Municipal Agencies? Municipal Agencies? Local Governments? Local Governments? Required Quality Assurance NO!

What You Should Expect From Forensic Practitioners

Practical Quality Guarantees We Provide

FEPAC Forensic Science Education Programs Accreditation Commission

Infrastructure Accreditation Certification Standardization Quality Forensic Forensic Services Services Educational Harmonization

Accuracy is NOT Ensured Accuracy is NOT Ensured Reliability is NOT Ensured Reliability is NOT Ensured In Our Advocacy Process, Accuracy & Reliability Rest in the Eye of the Beholder In Our Advocacy Process, Accuracy & Reliability Rest in the Eye of the Beholder QA Take-Away:

Can You All Now Run With the Big Dogs? Yes, You Can.

Acknowledgements Acknowledgements NCST&L Organizing Committees & Leadership Team - Professor Carol Henderson - Professor Carol Henderson Massachusetts State Police - Colonel Robbins & Command Staff - Colonel Robbins & Command Staff - MSP Crime Lab System - MSP Crime Lab System