OJJDP Performance Measurement Training 1 Presented by: Dr. Kimberly Kempf-Leonard School of Social Sciences University of Texas at Dallas

Slides:

Advertisements

Similar presentations

Internal Assessment Your overall IB mark (the one sent to universities after the IB test) in any IB science course is based upon two kinds of assessments.

Advertisements

Quality assurance Kari Kuulasmaa 1 st EHES Training Seminar, February 2010, Rome.

Research Methods in Crime and Justice Chapter 4 Classifying Research.

Chapter 2: The Research Process

Secondary Data in Marketing Research External market data – trend analysis, competitive information, industry trends and leaders External Customer data.

CJ 526 Statistical Analysis Research methods and statistics.

Chapter 13 Survey Designs

Collecting Quantitative Data

Midterm Review Evaluation & Research Concepts Proposals & Research Design Measurement Sampling Survey methods.

McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Two THE DESIGN OF RESEARCH.

Different Approaches for Data Collection/Data Analysis Experiment Survey Quasi-Experiment Secondary Data Analysis Content Analysis Historical Comparative.

Chapter 10 Collecting Quantitative Data. SURVEY QUESTIONNAIRES Establishing Procedures to Collect Survey Data Recording Survey Data Establishing the Reliability.

Slide 5.1 Saunders, Lewis and Thornhill, Research Methods for Business Students, 5 th Edition, © Mark Saunders, Philip Lewis and Adrian Thornhill 2009.

Objectives for Session Nine Observation Techniques Participatory Methods in Tanzania Hand back memos.

Washington State Prevention Summit Analyzing and Preparing Data for Outcome-Based Evaluation Using the Assigned Measures and the PBPS Outcomes Report.

6-1 Chapter Six DESIGN STRATEGIES. 6-2 What is Research Design? A plan for selecting the sources and types of information used to answer research questions.

By Dr. Ahmed Mostafa Assist. Prof. of anesthesia & I.C.U. Evidence-based medicine.

The Study of Adult Development and Aging:

Formulating the research design

CORRELATIO NAL RESEARCH METHOD. The researcher wanted to determine if there is a significant relationship between the nursing personnel characteristics.

Survey Designs EDUC 640- Dr. William M. Bauer

Chapter Three Research Design. 3-2 Research Design: Definition A research design is a framework or blueprint for conducting the marketing research project.

Assessing Financial Education: A Practitioner’s Guide December 2010.

PRIMARY AND SECONDARY DATA

Business and Management Research

Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.

Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.

Professional Development Activity Log: Comparing Teacher Log and Survey Approaches to Evaluating Professional Development AERA Annual Meeting Montreal,

The Vocabulary of Research. What is Credibility? A researcher’s ability to demonstrate that the study is accurate based on the way the study was conducted.

Collecting Quantitative Data Creswell Chapter 6. Who Will You Study? Identify unit of analysis Specify population Describe sampling approach  Class =

THE OHIO LONGITUDINAL TRANSITION STUDY (OLTS) Lawrence Dennis, Office for Exceptional Children, Ohio Department of Education & Dr. Robert Baer, Center.

Key steps in conducting survey research Decide if a survey is the best design to use Short time, economical, dispersed population, anonymity Report what.

Chapter 1 Doing Social Research.

Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design Data analysis Special concerns in field.

Evaluating a Research Report

Chapter 29 conducting marketing research Section 29.1

L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.

Market Research Lesson 6. Objectives Outline the five major steps in the market research process Describe how surveys can be used to learn about customer.

Week 3 Methods and Theories for Studying Families.

Research Design.

Potential Errors In Epidemiologic Studies Bias Dr. Sherine Shawky III.

Research in Communicative Disorders1 Research Design & Measurement Considerations (chap 3) Group Research Design Single Subject Design External Validity.

1 The Theoretical Framework. A theoretical framework is similar to the frame of the house. Just as the foundation supports a house, a theoretical framework.

Nursing research Is a systematic inquiry into a subject that uses various approach quantitative and qualitative methods) to answer questions and solve.

Guidelines for Critically Reading the Medical Literature John L. Clayton, MPH.

Quasi Experimental and single case experimental designs

Quality Assessment of MFA’s evaluations Rita Tesselaar Policy and operations Evaluation Department Netherlands Ministry of Foreign Affairs.

Title of your Study Your Name Date of your defense.

AF5.3 L1-2 Processing and analysing data to support the evaluation process and draw conclusions Say what happened in an investigation.

Research Methods Observations Interviews Case Studies Surveys Quasi Experiments.

Basic Business Statistics, 8e © 2002 Prentice-Hall, Inc. Chap 1-1 Inferential Statistics for Forecasting Dr. Ghada Abo-zaid Inferential Statistics for.

Overview of Sociological Research/Formulating a Research Question September 9, 2015.

Logic Model, Monitoring, Tracking and Evaluation Evaluation (Section T4-2)

Overview of Sociological Research September 8, 2014.

Quantitative research Meeting 7. Research method is the most concrete and specific part of the proposal.

Goals of research Exploratory: new topic Descriptive: gathering information Explanatory: explain patterns, answer why Evaluation: assess outcomes Types.

Step 1 - Defining the Problem  Identify and clearly state what the problem is and what can be done to solve the problem.  Determine which problems are.

Agenda: Surveys –In-person, Paper, telephone, and web –Computer assisted –Instrument Design Administrative data WorkFirst Longitudinal Study Hands-on surveys.

The research process András István Kun. Different disciplines Research methodology is a supporting subject Different disciplines have different paradigms.

What is Research Design? RD is the general plan of how you will answer your research question(s) The plan should state clearly the following issues: The.

Introduction to General Epidemiology (2) By: Dr. Khalid El Tohami.

MEASURE Evaluation Data Quality Assurance Workshop Session 3 Introduction to Routine Data Quality Assessment.

Slide 5.1 Saunders, Lewis and Thornhill, Research Methods for Business Students, 5 th Edition, © Mark Saunders, Philip Lewis and Adrian Thornhill 2009.

UOP PSYCH 610 W EEK 5 I NDIVIDUAL A SSIGNMENT W EEK F IVE H OMEWORK E XERCISE Check this A+ tutorial guideline at

The aim of this study was to …….

Chapter 21: Completing the Research Process

Session: 9 On-going Monitoring & Follow Up

Qualities of a good data gathering procedures

Presentation transcript:

OJJDP Performance Measurement Training 1 Presented by: Dr. Kimberly Kempf-Leonard School of Social Sciences University of Texas at Dallas Program monitoring & tracking: Research design issues

OJJDP Performance Measurement Training 2 Purposes Quality Control Tracking of Subjects Measuring Variables

OJJDP Performance Measurement Training 3 Why are we doing this? Monitoring & Assessment Improve our juvenile justice system Convince other systems they can benefit from what we’ve done Describe… Explain… Evaluate… Predict…

OJJDP Performance Measurement Training 4 Quality Control of Output & Outcome measures Add a time dimension to data collection longitudinal data (6-12 months follow-up) Precise measures Reliable measures Valid measures Generalizable measures

OJJDP Performance Measurement Training 5 What does tracking & Follow-Up mean?

OJJDP Performance Measurement Training 6 Time-related problems with Subjects “Creaming” Attrition or “Mortality” Solution: assure sample represents total –Know characteristics of those missing

OJJDP Performance Measurement Training 7 Do you work with this system?

OJJDP Performance Measurement Training 8 Clear, relevant variables Consistency in measurement both times Representative subjects –Same subjects –sample chosen same way both times –Explain any attrition Simple data collection instrument

OJJDP Performance Measurement Training 9 What types of data are collected in longitudinal designs? All types! –Surveys (trends: multiple “waves” of cross-sectional designs) –Participant observation –Archival records –Experiments –Content analysis –Secondary data & primary data from a “follow-up”

OJJDP Performance Measurement Training 10