Conducting Modern Investigations Analytics & Predictive Coding for Investigations & Regulatory Matters.

Slides:



Advertisements
Similar presentations
Project Quality Plans Gillian Sandilands Director of Quality
Advertisements

Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Critical Reading Strategies: Overview of Research Process
Introduction to research. Topics to be discussed  What is research?  Why managers should know about research?  Business research.  Types of business.
a ADOPTION OF E-LEARNING BY THE ACADEMIC AND INDUSTRY STAFF
Client Relations, Expectations and Confidentiality Chris Carucci Matt Morrison © CLM Litigation Management Institute All rights reserved. The course.
Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Evaluation Research Kodi D. Havins AED 615 Fall 2006 Dr. Franklin.
ACCOUNTING ETHICS Lect. Victor-Octavian Müller, Ph.D.
The Experience Factory May 2004 Leonardo Vaccaro.
Rational Unified Process
Information Retrieval Concerned with the: Representation of Storage of Organization of, and Access to Information items.
IS Audit Function Knowledge
Information retrieval Finding relevant data using irrelevant keys Example: database of photographic images sorted by number, date. DBMS: Well structured.
Iterative development and The Unified process
Auditing A Risk-Based Approach To Conducting A Quality Audit
The Information Systems Audit Process
Continuous Auditing Applications for SAP/R3 Vincent Rykes City of Edmonton.
Purpose of the Standards
Release & Deployment ITIL Version 3
Know Before They Code Conducting Critical IT Risk Assessments.
Internal Auditing and Outsourcing
Get Off of My I-Cloud: Role of Technology in Construction Practice Sanjay Kurian, Esq. Trent Walton, CTO U.S. Legal Support.
Prof. A. Taleb-Bendiab Room 605 A. Taleb-Bendiab, Module: Research Methods,
Streamlining the Review Cycle Michael Oettli, nlg GmbH Santa Clara, October 10 th.
NATIONAL COMMUNICATIONS COMMISSION REGULATORY PRACTICES WORKSHOP MODULE: 4 INVESTIGATION.
1 Bonham, chapter 8 Knowledge Management. 2  8.1 Success Levels  8.2 Externally Focused KM  8.3 Internally Focused KM  8.4 PMO-Supported KM
Understanding Audit Risk Assessment
NO FRAUD LEFT BEHIND The Effect of New Risk Assessment Auditing Standards on Schools Runyon Kersteen Ouellette.
Evidence and Documentation
Marco Nasca Senior Director, Client Solutions TRANSFORMING DISCOVERY THROUGH DATA MANAGEMENT.
Corporate Responsibility and Compliance A Resource for Health Care Boards of Directors By Debbie Troklus, CHC and Michael C. Hemsley, Esq.
Analysis 360: Blurring the line between EDA and PC Andrea Gibson, Product Director, Kroll Ontrack March 27, 2014.
Modern Information Retrieval Computer engineering department Fall 2005.
A COMPETENCY APPROACH TO HUMAN RESOURCE MANAGEMENT
Sharing Session on Organizational Performance Jakarta, 3 September 2013.
Experimental Research Methods in Language Learning Chapter 16 Experimental Research Proposals.
SANAS ACCREDITATION DEES DHANRAJ BEE Lead Assessor.
Overall Quality Assurance, Selecting and managing external consultants and outsourcing Baku Training Module.
P RINCIPLES 1-7 FOR E LECTRONIC D OCUMENT P RODUCTION Maryanne Post.
Practice Management Quality Control
Technology Transfer Execution Framework. 2 © 2007 Electric Power Research Institute, Inc. All rights reserved. Relationship Between Your EPRI Value and.
UDFCT was established in July 2011, focusing on business consulting and training management. Its specialized in implementing the Learning Organization.
Conducting Clinical Risk Assessments And Implementing Compliance Practices Jane L. Stratton Chiron Corporation VP/Associate General Counsel Chief Compliance.
Company Confidential Registration Management Committee RMC Auditor Workshop Charleston, SC July 2015 The OASIS Feedback Process Empowering Communication.
International Atomic Energy Agency Roles and responsibilities for development of disposal facilities Phil Metcalf Workshop on Strategy and Methodologies.
Information Retrieval CSE 8337 Spring 2007 Introduction/Overview Some Material for these slides obtained from: Modern Information Retrieval by Ricardo.
IAEA International Atomic Energy Agency Methodology and Responsibilities for Periodic Safety Review for Research Reactors William Kennedy Research Reactor.
© 2014, TERIS, Applying Analytics: Effective & Efficient Data Management in Litigation and Beyond.
Achieving Semantic Interoperability at the World Bank Designing the Information Architecture and Programmatically Processing Information Denise Bedford.
© 2014 IBM Corporation IBM SPSS Modeler Gold on Cloud Jump Start Service.
Evidence and Documentation
An Overview THE AUDIT PROCESS. MAJOR PHASES IN AN AUDIT Client acceptance and retention Establish terms of the engagement Plan the audit Consider internal.
ICAJ/PAB - Improving Compliance with International Standards on Auditing Planning an audit of financial statements 19 July 2014.
Internal Audit Quality Assessment Guide
F8: Audit and Assurance. 2 Designed to give you knowledge and application of: Section A: Audit Framework and Regulation Section B: Internal audit Section.
Improving Compliance with ISAs Presenters: Al Johnson & Pat Hayle.
AUDIT STAFF TRAINING WORKSHOP 13 TH – 14 TH NOVEMBER 2014, HILTON HOTEL NAIROBI AUDIT PLANNING 1.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin 4-1 Chapter Four Audit Evidence and Audit Documentation Chapter.
AUDIT EVIDENCE AND FINANCIAL STATEMENT ASSERTIONS 1.
CPA Gilberto Rivera, VP Compliance and Operational Risk
Data Minimization Framework
Auditing & Assurance Services, 6e
LATIHAN MID SEMINAR AUDIT hiday.
How does a Requirements Package Vary from Project to Project?
ACCOUNTING ETHICS Conf.univ.dr. Victor-Octavian Müller.
ACCOUNTING ETHICS Conf.univ.dr. Victor-Octavian Müller.
ACCOUNTING ETHICS Conf.univ.dr. Victor-Octavian Müller.
ACCOUNTING ETHICS Conf.univ.dr. Victor-Octavian Müller.
ACCOUNTING ETHICS Lect. Victor-Octavian Müller, Ph.D.
Presentation transcript:

Conducting Modern Investigations Analytics & Predictive Coding for Investigations & Regulatory Matters

Presentation Roadmap A Definition We Can Use Current Landscape Amongst Stake Holders Necessities, Tips &Traps Demonstrating Success & Gaining Acceptance Q&A Page 2

What is Predictive Coding? Something needs to change The cost of review is superseding the merits of the matter Large data volumes are drowning out substantive case issues, strategy, claims, and defenses

Page 4

A review methodology that amplifies the expertise of human reviewers using advanced classification and search technology What is Predictive Coding?

What are Conceptual Relationships? FrequencyProximity Concepts

Conceptual Relationships to Attorney Decisions Attorney Decisions

The Current Landscape Stakeholders & Their Position with Predictive Coding Page 9

Timely Resolution Compromise Original Scope of Inquiry The Starting Place on a Matter Page 10

Original Scope of Inquiry Revised Requirements Follow Up Requests Timely Resolution Compromise Where Many Matters Go Page 11

Variety of Stakeholders Page 12 Inquiry Corporate Client Auditors Forensic Accountants U.S. Agency Local Regulators Outside Counsel

Varied Levels of Knowledge Page 13 Disparate Local Regulators U.S Agencies with Limits Corporate Clients Sophisticated U.S. Agency Auditors & Forensic Accountants

Necessities, Tips & Traps Something needs to change The cost of review is superseding the merits of the matter Large data volumes are drowning out substantive case issues, strategy, claims, and defenses

Workflow Overview ExpertiseDocumentation Predictive Coding Analytics & Clustering Search Manual Review

Project Planning Define project goals Customize workflow to case needs Define target metrics Estimate scope of responsiveness Gauge expectations with team Project Setup Refine data selection Tune Analytics index Identify themes in context Establish starting points for review Train subject matter experts Refine approach to project reports Project Planning and Setup

Technology Leveraged Review

Enhancing Predictive Coding Evaluating Content Some documents cannot go through predictive coding Clustering and Categorization Automatically sort documents by topics More effectively segregate non-relevant docs Concept Search Find more relevant documents and less junk Faster and more accurate than elaborate keyword searches Focus on where concepts intersect with similar ones

1.Clearly define what a successful outcome would be for you 2.Do not rely exclusively on statistics in lieu of substance 3.Understand that it takes time to build a proper index 4.Understand that you may not run all documents through the process 5.Retain the right subject-matter experts from the start 6.The team must be trained to review documents for a technology accelerated workflow 7.Reviewers will disagree and confuse the system, which can cause high overturn rates - resolving disagreements takes time and is itself a process 7 Key Expectations

Screening for Privileged Material Think of this document you have seen: relevant content not apparently privileged, but there’s one additional recipient Traditional search mechanism for lawyer names, firms and common privilege terms are still critical Page 20

Demonstrating Success Gaining Acceptance from Inquiring Parties Something needs to change The cost of review is superseding the merits of the matter Large data volumes are drowning out substantive case issues, strategy, claims, and defenses

Effective Reporting Maintaining Your Defensibility Kit for Predictive Coding Analytics index construction Supporting metrics Review workflow Assisted review reports Data profile reports Support for defense

Precision: How frequently were the document decisions correct? Recall: Were all of the potentially responsive documents part of the set? Demonstrating Success

Defensibility Kit End to End Documentation Assisted Review Reports Page 24

End to End Documentation Database Profile Metrics Page 25 Defensibility Kit

End to End Documentation Database Profile Metrics Page 26 Defensibility Kit

Summary Predictive Coding is within your reach Stakeholders can accept a technology leveraged approach Expertise, workflow, stable technology, & a multifaceted approach minimizes risks Supporting documentation & metrics can lead to buy-in Page 27

Remaining Questions & Answers?

Conducting Modern Investigations Thank you for attending