URBAN INSTITUTE Justice Policy Center National Youth Court Center Evaluation Workshop Janeen Buck Jeffrey Butts October 23, 2002 National Youth Court Seminar.

Slides:



Advertisements
Similar presentations
Chapter 11 Direct Data Collection: Surveys and Interviews Zina OLeary.
Advertisements

SEM A – Marketing Information Management
2.06 Understand data-collection methods to evaluate their appropriateness for the research problem/issue.
Conducting Interviews
Research methods – Deductive / quantitative
Statistical Studies: Statistical Investigations
Extended Project Research Skills 1 st Feb Aims of this session  Developing a clear focus of what you are trying to achieve in your Extended Project.
B121 Chapter 7 Investigative Methods. Quantitative data & Qualitative data Quantitative data It describes measurable or countable features of whatever.
CHAPTER 7 ASKING PEOPLE ABOUT THEMSELVES SURVEY RESEARCH.
Non-true-experimental Designs PSY 231 Research Methods in Psychology.
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 9 Surveys, Questionnaires, and Polls Most commonly used quantitative method Used for obtaining.
1 Major topics to be addressed  Types of research  Fundamental concepts.
CS Spring 5/3/ Presenter : Yubin Li Professor : Dr. Bamshad Mobasher Week 6: Descriptive Research.
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT OSMAN BIN SAIF Session 14.
© 2001 Dr. Laura Snodgrass, Ph.D.1 Non-experimental Methods Observation and Survey Research.
URBAN INSTITUTE Justice Policy Center The OJJDP Evaluation of Teen Courts (ETC) Project Janeen Buck Jeffrey Butts October 23, 2002 National Youth Court.
Business and Management Research
Copyright © 2010 Pearson Education, Inc. Chapter 2 Data.
Richard Philp New Zealand Inland Revenue Department Session No. 7 Conclusions for tax policy and revenue administration from compliance studies, perception.
Epistemology and Methods Survey Research & Interview Techniques May
Sociological Research Methods and Techniques
In what ways are our superstitions and beliefs in the supernatural different to Chinese people?  The following is an example to help with your Tangjia.
6. Implications for Analysis: Data Content. 1 Prerequisites Recommended modules to complete before viewing this module  1. Introduction to the NLTS2.
Chapter 6 Surveys and Sampling - Stangor. Surveys Survey – a series of self-report measures administered through either an interview or a written questionnaire.
Chapter 12: Survey Designs
Evaluation of a Rapid Policy Assessment and Response Intervention: Szczecin, Poland Background: Rapid Policy Assessment and Response (RPAR) is a community-level.
Research Design & the Research Proposal Qualitative, Quantitative, and Mixed Methods Approaches Dr. Mary Alberici PY550 Research Methods and Statistics.
CHAPTER 9 Survey Research. Basics  In Survey Research, the researcher selects a sample of respondents and administers a standardized questionnaire. Main.
Type author names here Social Research Methods Chapter 10: Self-completion questionnaires Alan Bryman Slides authored by Tom Owens.
March 2007 OSI PIPES STUDY 1 PARENTAL INFORMAL PAYMENTS STUDY (PIPES) Republic of Moldova Tbilisi 2007.
Research PHE 498. Define Research Research can be considered as systematic inquiry: A process that needs to be followed systematically to derive conclusions.
Is research in education important?. What is the difference between Qualitative and Quantitative Research Methods?
A Grant for Counseling Services for Gay and Lesbian People with Low Self-Acceptance Due to Harmful Exposure to Fundamentalist Christianity By Ann Russo.
Major Research Designs How Sociologists Gather their Data.
Parental Informal Payments to Education Latvia’s report.
September 2007 Survey Development Rita O'Sullivan Evaluation, Assessment, & Policy Connections (EvAP) School of Education, University of North Carolina-Chapel.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Outline 1. Definition 2. When and why to use surveys
URBAN INSTITUTE Justice Policy Center The views expressed are those of the authors and should not be attributed to The Urban Institute, its trustees, or.
Questionnaire Surveys Obtaining data by asking people questions and recording their answers Obtaining data by asking people questions and recording their.
Office of the State Minister of Reforms Coordination of Georgia /GORBI Monitoring Governance Reforms Pilot Survey in Tbilisi Schools.
Developing Measures Concepts as File Folders Three Classes of Things That can be Measured (Kaplan, 1964) Direct Observables--Color of the Apple or a Check.
©2012 McGraw-Hill Ryerson Ltd. Types of Data  Primary – Facts and observations that researchers gather for the purposes of a study.  Secondary – Data.
School Store Operations
CHAPTER OVERVIEW Deciding on a Method Tests and Their Development Types of Tests Observational Techniques Questionnaires.
Sociological Research Methods. The Research Process Sociologists answer questions about society through empirical research (observation and experiments)
Researching your contemporary issue From How to Write an Effective Special Study Dodson, Jarvis & Melhuish.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 9 Surveys, Questionnaires, and Polls Most commonly used quantitative method –Used.
Surveys.
Chapter 2 Doing Sociological Research. Chapter Outline The Research Process The Tools of Sociological Research Prediction, Sampling and Statistical Analysis.
Methods of Data Collection Survey Methods Self-Administered Questionnaires Interviews Methods of Observation Non-Participant Observation Participant Observation.
Research Methods Observations Interviews Case Studies Surveys Quasi Experiments.
Chapter 3 Studying Social Life: Sociological Research Methods.
Quantitative Data Collection Techniques In contrast to qualitative data quantitative data are numerical. Counted, calculated tallied and rated. Also ratings.
Chapter 5: Research. Research is the most important to PR because it is used to... Achieve credibility with management Define audiences and segment publics.
Research and Evaluation Center Assessment of the YouthBuild Mentoring Initiative Kathleen Tomberg, Research Analyst Research and Evaluation Center John.
Day #7, June 25 th CEP 955 Summer Hybrid, 2013 Jack Smith Michigan State University.
Understanding Sociological Research: Teacher Copy.
In what ways are our superstitions and beliefs in the supernatural different to Chinese people?  The following is an example to help with your Tangjia.
Agenda: Surveys –In-person, Paper, telephone, and web –Computer assisted –Instrument Design Administrative data WorkFirst Longitudinal Study Hands-on surveys.
Senior Capstone Class Fall  What is a survey? Tool designed to elicit information from an individual or group of individuals Measures attitudes,
Fact Finding (Capturing Requirements) Systems Development.
Madison MS SPF-SIG Community Survey Findings January 27, 2009.
Data Coaching Services Types of Data 1. 2 o Qualitative Data vs. o Quantitative Data o Where do student and teacher data fall within these categories?
Understanding Sociological Research: Teacher Copy.
The effects of workshop participation in scenario-planning workshops on propensity to collaborate Survey findings Lisa Rayle Master in City Planning Master.
The Individual Externship Program
Lecture 4: Approaches to Data Collection
Causes Of Contractors’ Failure In West Bank
Given that {image} {image} Evaluate the limit: {image} Choose the correct answer from the following:
Presentation transcript:

URBAN INSTITUTE Justice Policy Center National Youth Court Center Evaluation Workshop Janeen Buck Jeffrey Butts October 23, 2002 National Youth Court Seminar on Funding and Evaluating Teen Courts - Indianapolis, IN

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October Data Collection and Measurement Data –Qualitative vs. Quantitative –Sources Measurement –constructing questions –surveys and questionnaires Data collection –logistics and strategies –legal considerations

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October Data Sources and Methods Official Records (police, court, etc.) Face-to-face interviews Written surveys BenefitsProblems Often in database form Measures of official recidivism and program compliance Allows for large samples Database structures can be complex Restricted access Recidivism measures are biased Rich, personal data Measures of subjective perceptions and attitudes Useful for theoretically oriented evaluations Very expensive Requires prof. experience Increases respondent resistance and attrition Incentives ($$) needed Can be highly objective Measures of subjective perceptions and attitudes Good response rates Requires good design Requires prof. experience Limited range of variables

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October Measurement Issues Relevance and precision Simplicity Balance “Road-test” measures

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October 2002 Question Wording is an Art Question #1: I can always talk to my teachers about problems with my school work. Problem: Terms such as "always" and "never" create response bias. If respondents can talk to teachers 90% of the time, which answer should they choose? Strongly Don’t Strongly Disagree Disagree Know Agree Agree SD D DK A SA

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October 2002 Question Wording is an Art Question #2: Community work service and restitution payments are effective with youth. Problem: Which part are respondents answering, community service or restitution? They may agree with one and not the other, but the evaluator will never know. The question becomes useless from a research point of view. Strongly Don’t Strongly Disagree Disagree Know Agree Agree SD D DK A SA

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October 2002 Question Wording is an Art Question #3: The courtroom is hectic during teen court. Problem: Question employs a negative image. Respondents may think their courtroom is busy, but not “hectic.” Researchers won’t know what a “disagree” response actually means. Strongly Don’t Strongly Disagree Disagree Know Agree Agree SD D DK A SA

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October Data Collection, 5.4 Consent Developing a plan MOUs Informed consent –What? –Why? –When?

URBAN INSTITUTE Justice Policy Center National Youth Court Center: Evaluation Workshop October Working with an Evaluator Objectives and expectations Selection process –Request for Proposal (RFP) “Goodness of fit” Products and services