TrueAllele ® Interpretation of DNA Mixture Evidence 9 th International Conference on Forensic Inference and Statistics August, 2014 Leiden University,

Slides:



Advertisements
Similar presentations
DNA Identification: Mixture Weight & Inference
Advertisements

Overcoming DNA Stochastic Effects 2010 NEAFS & NEDIAI Meeting November, 2010 Manchester, VT Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics.
DNA Mixture Interpretations and Statistics – To Include or Exclude Cybergenetics © Prescription for Criminal Justice Forensics ABA Criminal Justice.
Finding Truth in DNA Mixture Evidence Innocence Network Conference April, 2013 Charlotte, NC Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA.
How Inclusion Interpretation of DNA Mixture Evidence Reduces Identification Information American Academy of Forensic Sciences February, 2013 Washington,
Creating informative DNA libraries using computer reinterpretation of existing data Northeastern Association of Forensic Scientists November, 2011 Newport,
Preventing rape in the military through effective DNA computing Forensics Europe Expo Forensics Seminar Theatre April, 2014 London, UK Mark W Perlin, PhD,
Coding a Safer Society through Computer Interpretation of DNA Evidence Cybergenetics © MATLAB Virtual Conference March, 2014 Mark W Perlin, PhD,
Probabilistic Software Workshop September 29, 2014 TrueAllele® Casework Mark W. Perlin, PhD, MD, PhD.
How TrueAllele® Works (Part 1)
Probabilistic Software Workshop September 29, 2014
TrueAllele ® Casework Validation on PowerPlex ® 21 Mixture Data Australian and New Zealand Forensic Science Society September, 2014 Adelaide, South Australia.
Using TrueAllele ® Casework to Separate DNA Mixtures of Relatives California Association of Criminalists October, 2014 San Francisco, CA Jennifer Hornyak,
Revolutionising DNA analysis in major crime investigations The Investigator Conferences Green Park Conference Centre May, 2014 Aylesbury, Buckinghamshire.
No DNA Left Behind: When "inconclusive" really means "informative" Schenectady County District Attorney’s Office January, 2014 Mark W Perlin, PhD, MD,
Challenging DNA Evidence The Fifth Judicial District of Pennsylvania Criminal Division February, 2015 Pittsburgh, PA Mark W Perlin, PhD, MD, PhD Cybergenetics,
Revolutionising DNA analysis in major crime investigations The Investigator Conferences Green Park Conference Centre May, 2014 Aylesbury, Buckinghamshire.
Solving Cold Cases by TrueAllele ® Analysis of DNA Evidence Finding Closure: The Science, Law and Politics of Cold Case Investigations October, 2014 Pittsburgh,
TrueAllele ® Mixture Interpretation Cybergenetics © th Annual DNA Technology Educational Seminar Centre of Forensic Sciences and the Promega.
DNA Mixture Statistics Cybergenetics © Spring Institute Commonwealth's Attorney's Services Council Richmond, Virginia March, 2013 Mark W.
Computer Interpretation of Uncertain DNA Evidence National Institute of Justice Computer v. Human June, 2011 Arlington, VA Mark W Perlin, PhD, MD, PhD.
TrueAllele ® Modeling of DNA Mixture Genotypes California Association of Crime Laboratory Directors October, 2014 San Francisco, CA Mark W Perlin, PhD,
How TrueAllele ® Works (Part 2) Degraded DNA and Allele Dropout Cybergenetics Webinar November, 2014 Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh,
Reanimating Zombie™ DNA Penn State Dickinson Law School September, 2012 State College, Pennsylvania Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh,
Separating Familial Mixtures, One Genotype at a Time Northeastern Association of Forensic Scientists November, 2014 Hershey, PA Ria David, PhD, Martin.
Cybergenetics Webinar January, 2015 Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics © How TrueAllele ® Works (Part 4)
Cracking the DNA mixture code – computer analysis of UK crime cases Forensics Europe Expo Forensic Innovation Conference April, 2014 London, UK Mark W.
Unleashing Forensic DNA through Computer Intelligence Forensics Europe Expo Forensic Innovation Conference April, 2013 London, UK Mark W Perlin, PhD, MD,
Rapid DNA Response: On the Wings of TrueAllele Mid-Atlantic Association of Forensic Scientists May, 2015 Cambridge, Maryland Martin Bowkley, Matthew Legler,
Getting Past First Bayes with DNA Mixtures American Academy of Forensic Sciences February, 2014 Seattle, WA Mark W Perlin, PhD, MD, PhD Cybergenetics,
Compute first, ask questions later: an efficient TrueAllele ® workflow Midwestern Association of Forensic Scientists October, 2014 St. Paul, MN Martin.
TrueAllele ® interpretation of Allegheny County DNA mixtures Cybergenetics © Continuing Legal Education Allegheny County Courthouse February,
Virginia TrueAllele ® Validation Study: Casework Comparison Presented at AAFS, February, 2013 Published in PLOS ONE, March, 2014 Mark W Perlin, PhD, MD,
TrueAllele ® Computing: All the DNA, all the time Continuing Professional Development Sydney, Australia March, 2014 Mark W Perlin, PhD, MD, PhD Cybergenetics,
Murder in McKeesport October 25, 2008 Tamir Thomas.
When Good DNA Goes Bad International Conference on Forensic Research & Technology October, 2012 Chicago, Illinois Mark W Perlin, PhD, MD, PhD Cybergenetics,
DNA Mapping the Crime Scene: Do Computers Dream of Electric Peaks? 23rd International Symposium on Human Identification October, 2012 Nashville, TN Mark.
Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics © Duquesne University October, 2015 Pittsburgh, PA What’s in a Match?
Open Access DNA Database Duquesne University March, 2013 Pittsburgh, PA Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics ©
Jack Ballantyne and Mark Perlin International Conference on Inference and Statistics, July , Seattle, WA.
Objective DNA Mixture Information in the Courtroom: Relevance, Reliability & Acceptance NIST International Symposium on Forensic Science Error Management:
DNA Identification: Quantitative Data Modeling Cybergenetics © Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA TrueAllele ® Lectures.
DNA-led investigation through computer interpretation of evidence Pennsylvania State Police Training Seminar Hershey, PA April, 2014 Mark W Perlin, PhD,
Data summary – “alleles” Threshold Over threshold, peaks are labeled as allele events All-or-none allele peaks, each given equal status Allele Pair 8,
Issues with DNA Evidence, Past and Future Washington County Bar Association March, 2016 Washington, PA Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh,
Separating DNA Mixtures by Computer to Identify and Convict a Serial Rapist Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Garett Sugimoto,
Understanding DNA Evidence Beaver County Courthouse March, 2016 Beaver, PA Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics ©
Four person DNA mixture
DNA: TrueAllele® Statistical Analysis, Probabilistic Genotyping
A Match Likelihood Ratio for DNA Comparison
Forensic Stasis in a World of Flux
Validating TrueAllele® genotyping on ten contributor DNA mixtures
Shedding Light on Inconclusive DNA: TrueAllele® Computer Analysis
How to Defend Yourself Against DNA Mixtures
Explaining the Likelihood Ratio in DNA Mixture Interpretation
DNA identification pathway
On the threshold of injustice: manipulating DNA evidence
Virginia TrueAllele® Validation Study: Casework Comparison
Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA, USA
Solving Crimes using MCMC to Analyze Previously Unusable DNA Evidence
Investigative DNA Databases that Preserve Identification Information
Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA, USA
DNA identification pathway
Probabilistic Genotyping to the Rescue for Pinkins and Glenn
DNA Identification: Mixture Interpretation
Exonerating the Innocent with Probabilistic Genotyping
Testifying about probabilistic genotyping results
David W. Bauer1, PhD Nasir Butt2, PhD Jeffrey Oblock2
Using probabilistic genotyping to distinguish family members
Presentation transcript:

TrueAllele ® Interpretation of DNA Mixture Evidence 9 th International Conference on Forensic Inference and Statistics August, 2014 Leiden University, The Netherlands Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics ©

TrueAllele ® Casework ViewStation User Client Database Server Interpret/Match Expansion Visual User Interface VUIer™ Software Parallel Processing Computers

On the Origin of TrueAllele CMU: stutter deconvolution American Journal of Human Genetics Cybergenetics: mixture deconvolution Journal of Forensic Sciences Scope: STR mixtures, degraded, kinship, database Data: (respect) use everything, add nothing Objective: never consider suspect reference General: same for evidentiary & investigative

Variation Under Domestication 8 12 locus peak size peak height Hypothesis: evidence and suspect share a common contributor Data analysis: simple threshold Single source DNA

Variation Under Nature victim other victim other Hypothesis: evidence and suspect share a common contributor Data analysis: patterns & variation

Struggle for Existence Likelihood ratio (LR) requires genotype probability LR = O( H | data) O( H ) Σx P{d X |X=x,…} P{d Y |Y=x,…} P{X=x} ΣΣx,y P{d X |X=x,…} P{d Y |Y=y,…} P{X=x, Y=y} = Bayes theorem + probability + algebra … genotype probability: posterior, likelihood & prior

Natural Selection Hierarchical Bayesian model induces a set of forces in a high-dimensional parameter space Mixture weight variables Genotype variables small DNA amounts degraded contributions K = 1, 2, 3, 4, 5, 6,... unknown contributors joint likelihood function Hierarchical mixture weight locus variables

Survival of the Fittest Markov chain Monte Carlo Sample from the posterior probability distribution Current state Next state? Transition probability = P{Next state} P{Current state}

Laws of Variation Hierarchy of successive pattern transformations Variance parameters Hierarchical (e.g., customized for DNA template or locus) Differential degradation Mixture weight Relative amplification PCR stutter PCR peak height Background noise genotype data

Difficulties of the Theory procedures & rules vs data-driven science comfort in certainty vs tackling uncertainty probability and likelihood ratios can use all the data to quantify uncertainty What is the aim of Forensic Science? comfort vs truth

Miscellaneous Objections too complex? black box? source code? insufficient validation?

Validation Studies Perlin MW, Sinelnikov A. An information gap in DNA evidence interpretation. PLoS ONE. 2009;4(12):e8327. Perlin MW, Legler MM, Spencer CE, Smith JL, Allan WP, Belrose JL, Duceman BW. Validating TrueAllele ® DNA mixture interpretation. Journal of Forensic Sciences. 2011;56(6): Ballantyne J, Hanson EK, Perlin MW. DNA mixture genotyping by probabilistic computer interpretation of binomially-sampled laser captured cell populations: Combining quantitative data for greater identification information. Science & Justice. 2013;53(2): Perlin MW, Belrose JL, Duceman BW. New York State TrueAllele ® Casework validation study. Journal of Forensic Sciences. 2013;58(6): Perlin MW, Dormer K, Hornyak J, Schiermeier-Wood L, Greenspoon S. TrueAllele ® Casework on Virginia DNA mixture evidence: computer and manual interpretation in 72 reported criminal cases. PLOS ONE. 2014;(9)3:e Perlin MW, Hornyak J, Sugimoto G, Miller K. TrueAllele ® genotype identification on DNA mixtures containing up to five unknown contributors. Journal of Forensic Sciences. 2015;in press.

Sensitive The extent to which interpretation identifies the correct person 101 reported genotype matches 82 with DNA statistic over a million True DNA mixture inclusions TrueAllele Casework on Virginia DNA mixture evidence: computer and manual interpretation in 72 reported criminal cases. Perlin MW, Dormer K, Hornyak J, Schiermeier-Wood L, Greenspoon S PLoS ONE (2014) 9(3): e92837

TrueAllele Sensitivity (5.42) 113 billion TrueAllele log(LR) match distribution

Specific The extent to which interpretation does not misidentify the wrong person 101 matching genotypes x 10,000 random references x 3 ethnic populations, for over 1,000,000 nonmatching comparisons True exclusions, without false inclusions

TrueAllele Specificity – log(LR) mismatch distribution 0

Reproducible MCMC computing has sampling variation duplicate computer runs on 101 matching genotypes measure log(LR) variation The extent to which interpretation gives the same answer to the same question

TrueAllele Reproducibility Concordance in two independent computer runs standard deviation (within-group) 0.305

Manual Inclusion Method Over threshold, peaks become binary allele events All-or-none allele peaks, disregard quantitative data Allele pairs 7, 7 7, 10 7, 12 7, 14 10, 10 10, 12 10, 14 12, 12 12, 14 14, 14 Analytical threshold

CPI Information CPI 6.83 (2.22) 6.68 million Combined probability of inclusion Simplify data, easy procedure, apply simple formula PI = (p 1 + p p k ) 2

Modified Inclusion Method Stochastic threshold Higher threshold for human review Analytical threshold Apply two thresholds, doubly disregard the data in 2010 in 2000

Modified CPI Information CPI 6.83 (2.22) 6.68 million 2.15 (1.68) 140 mCPI

Method Comparison CPI (5.42) 113 billion 6.83 (2.22) 6.68 million 2.15 (1.68) 140 mCPI TrueAllele

Method Accuracy Kolmogorov Smirnov test K-S p-value e e-25

Invariant Behavior Perlin MW, Hornyak J, Sugimoto G, Miller K. TrueAllele ® genotype identification on DNA mixtures containing up to five unknown contributors. Journal of Forensic Sciences. 2015;in press. no significant difference in regression line slope (p > 0.05)

Sufficient Contributors small negative slope values statistically different from zero (p < 0.01)

Admissibility Hearings California Pennsylvania Virginia United Kingdom Australia Appellate precedent in Pennsylvania

Westchester, NY: Daughter Rape Quantitative peak heights at locus D16S539 peak height peak size

How TrueAllele Thinks Consider every possible genotype solution Explain the peak pattern Better explanation has a higher likelihood One person’s allele pair Another person’s allele pair

Objective genotype determined solely from the DNA data. Never sees a comparison reference. Evidence Genotype 99.9% 0.02%0.08%

DNA Match Information Prob(evidence match) Prob(coincidental match) How much more does the child match the evidence than a random person? 14.5x 99.9% 6.9%

Match Information at 15 Loci

Likelihood Ratio Results A match between the blanket and the child is 68 quadrillion times more probable than coincidence. A match between the blanket and the father is 33 quadrillion times more probable than coincidence. Father pleaded guilty to rape and was sentenced to seven years in prison. Young daughters spared further torment.

Other Cases Mixtures of family members child rape homicide 3 person mixture 5 person mixture Over 200 case reports Many states & countries On-line in crime labs California Virginia Middle East

Investigative DNA Database Infer genotypes, and then match with LR World Trade Center disaster

DNA Mixture Crisis: MIX05 National Institute of Standards and Technology Two Contributor Mixture Data, Known Victim 31 thousand (4) 213 trillion (14)

DNA Mixture Crisis: MIX13

DNA Mixture Crisis: USA 375 cases/year x 4 years = 1,500 cases 320 M in US / 8 M in VA = 40 factor 1,500 cases x 40 factor = 60,000 inconclusive 1,000 cases/year x 4 years = 4,000 cases 320 M in US / 8 M in NY = 40 factor 4,000 cases x 40 factor = 160,000 inconclusive + under reporting of DNA match statistics DNA evidence data in 100,000 cases Collected, analyzed & paid for – but unused

The Rule of Science & Law unworkable rules vs validated science Why do we practice Forensic Science?

Learn More About TrueAllele Courses Newsletters Newsroom Presentations Publications TrueAllele YouTube channel