Evaluation research Using research methods in combinations Policy analysis.

Slides:



Advertisements
Similar presentations
RISK ANALYSIS.  Almost all of the things that we do involve risk of some kind, but it can sometimes be challenging to identify risk, let alone to prepare.
Advertisements

Copyright © 2014 by The University of Kansas Small Area Analysis.
Monitoring and Evaluation for HES Activities
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
Community-Oriented Defense Performance Indicators A Conceptual Overview Michael Rempel Center for Court Innovation Presented at the Community-Oriented.
Risk Assessment.
Preventing and Intervening in Delinquency through Integration and Coordination of Services.
The Honorable John R. Roach, Jr. 296 th Judicial District Court Alyse Ferguson, Esq. Attorney Director, MHMC Program.
Evaluation Research, aka Program Evaluation. Definitions Program Evaluation is not a “method” but an example of applied social research. From Rossi and.
PPA 502 – Program Evaluation
Evaluation. Practical Evaluation Michael Quinn Patton.
CRIM 309 Intake and Diversion. Intake Intake=Process of screening cases referred to the juvenile justice system Determines which cases will be formally.
STRATEGIC MANAGEMENT 1
For more information, please contact Jonny Andia at 1.
Problem solving in project management
How to Develop the Right Research Questions for Program Evaluation
1 RESEARCH DESIGN: What are you researching? Identifying a researchable question Assignment 1: Reviewing the Literature.
The 10 Key Components of Veteran’s Treatment Court Presented by: The Honorable Robert Russell.
Research and Evaluation Center Jeffrey A. Butts John Jay College of Criminal Justice City University of New York August 7, 2012 How Researchers Generate.
Onondaga County DMC Final Report December 13, 2011 Center for Community Alternatives Emily NaPier Juanita Gamble Co-Coordinators.
Sociology 3322a. “…the systematic assessment of the operation and/or outcomes of a program or policy, compared to a set of explicit or implicit standards.
SOCIAL WORKER III Tamara Ochoa Tamara started her social career over 20 years ago, with her formal education taken at CBC and WSU. She started working.
Where Results Begin. “We don’t have a health care delivery system in this country. We have an expensive plethora of uncoordinated, unlinked, economically.
Copyright © 2014 by The University of Kansas Using the Evaluation System to Answer Key Questions About Your Initiative.
Fundamentals of Planning
Macro Chapter 10 Dynamic Change, Economic Fluctuations, and the AD-AS Model.
1 Performance Measures Rebecca Stark, Court Administrator Austin Municipal Court.
Program Evaluation and Logic Models
 Task Force on Race  in the Criminal Justice System 
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Mental Capacity Act and the Deprivation of Liberty Safeguards Andrea Gray Mental Health Legislation Manager Welsh Government.
Workshop 6 - How do you measure Outcomes?
Chapter 16.3 Young People and the Courts. Causes of Juvenile Delinquency In most states, anyone under age 18 is considered a juvenile – not yet legally.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
Performance Budgeting and Results First – creating a strong state accountability system Gary VanLandingham Director, Results.
W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.
CEBP Research Institute: Past and current studies: Overview and findings CEBP Learning Institute May 27, 2010 Corinne Datchi-Phillips, Ph.D. Jeremy Kinser,
General Grant Writing Tips. Research the problem/need and the program before beginning the grant proposal Review research on similar problems/needs and.
Copyright © 2014 by The University of Kansas Refining the Program Intervention Based on Research.
Juvenile Delinquency Professor Brown. Unit 7: The History of Juvenile Justice and Police Work with Juveniles Unit Overview-This unit examines the history.
21/4/2008 Evaluation of control measures 1. 21/4/2008 Evaluation of control measures 2 Family and Community Medicine Department.
ATTORNEYS AND YOUTH AT RISK. Potential Areas For Increased Attorney Involvement Young Offenders (12 years and younger) Truant Youth Youth Aging Out of.
THIS PRESENTATION IS INTENDED AS ONE COMPLETE PRESENTATION. HOWEVER, IT IS DIVIDED INTO 3 PARTS IN ORDER TO FACILITATE EASIER DOWNLOADING AND VIEWING,
Child and Family Service Review CFSR 101. Child and Family Service Review CFSR stands for the Child and Family Service Review. It is the federal government’s.
Evaluating Ongoing Programs: A Chronological Perspective to Include Performance Measurement Summarized from Berk & Rossi’s Thinking About Program Evaluation,
National Center for Youth in Custody First Things First: Risk and Needs Assessment Data to Determine Placement and Services Alternatives.
Copyright 2010, The World Bank Group. All Rights Reserved. Uses of Statistics on Crime, Justice & Security Part 1 Crime, Justice & Security Statistics.
Nursing Process: The Foundation for Safe and Effective Care Chapter 5.
Copyright © 2014 by The University of Kansas Using the Evaluation System to Answer Key Questions About Your Initiative.
Easy Read Summary Mental Capacity Act Mental Capacity Act A Summary The Mental Capacity Act 2005 will help people to make their own decisions.
Chapter Thirteen – Organizational Effectiveness.  Be able to define organizational effectiveness  Understand the issues underpinning measuring organizational.
Program Evaluation Overview. Definitions of Program Evaluation systematic collection of information abut the activities, characteristics, and outcome.
This was developed as part of the Scottish Government’s Better Community Engagement Programme.
IDEV 624 – Monitoring and Evaluation Evaluating Program Outcomes Elke de Buhr, PhD Payson Center for International Development Tulane University.
Unit 6. Effective Communication and Collaboration This unit focuses on efforts to reduce juvenile delinquency through a collaborative process of community-based,
Juvenile Crime.  Juvenile: a person under the age of 18  Some states have it as 16, but regardless there are special laws that deal with juveniles who.
Improving Outcomes for Young Adults in the Justice System Challenges and Opportunities.
Macro Chapter 10 Dynamic Change, Economic Fluctuations, and the AD-AS Model.
INTRODUCING THE PSBA-GTO ACT FOR YOUTH CENTER OF EXCELLENCE IN CONSULTATION WITH HEALTHY TEEN NETWORK Planning for Evidence-Based Programming.
RE-AIM Framework. RE-AIM: A Framework for Health Promotion Planning, Implementation and Evaluation Are we reaching the intended audience? Is the program.
Education and Training Centre for Children - Need for Minimum Standards.
Introduction Social ecological approach to behavior change
Presented by Brian Chidampamba Katimba (LLB-Hons) OCG EXECUTIVE DIRECTOR
Sociologists Doing Research Chapter 2. Research Methods Sociologists attempt to ask the “why” and “how” questions and gather evidence which will help.
Note: In 2009, this survey replaced the NCA/Baldrige Quality Standards Assessment that was administered from Also, 2010 was the first time.
Nursing Process Applied to Community Health Nursing
Juvenile Crime *pgs Essential Question: What is juvenile crime and how does the system handle it?
OHS Staff Introduction Training
Chapter 16 Section 3 Juvenile Crime.
Presentation transcript:

Evaluation research Using research methods in combinations Policy analysis

Evaluation  Examining the effects of programs, policies and laws  Programs: providing services to clients  Policies: rules for handling clients, actions taken i.e., policy on deadly force for fleeing felons  Laws: what are the real impacts

Evaluation  People assumed that particular effects would take place  However, those effects may or may not happen  There may be unanticipated side effects to a change, both good and bad

Policy  Usually some issue is raised  Demands are made, and there is support and opposition  Goals should be formulated and ways established to attain those goals (objectives)  Policy output: the program, resources allocated

Policy  Then the impact is determined  Did the changes in policy outputs have an impact on the problem?  Hypothesis: If some policy action is taken, then we expect a particular result  To test the hypothesis, must do an evaluation

Evaluation components  Process evaluation and impact  Process  Needs assessment and monitoring part of the process evaluation  The first step should be needs assessment  Frequently this is not done

Needs assessment  Is the program/policy/intervention needed?  Is the problem serious? Will it “get better” on its own?  Who are the members of the target population? (those most in need of services, deterrents, etc.)  What are their characteristics?

Needs assessment  Programs will have little impact if they don’t affect the target population  Programs will have little effect if they do not take into account the characteristics of the target population

Needs assessment  i.e., a school based program will not help chronically truant delinquents  Adding 11 th and 12 th grade classes at a reform school will not be useful if very few delinquents at the school are functioning at even a 9 th grade level  Welfare to work requires child care

Needs assessment  There is a need to gather information to determine the characteristics of the target population  May not be readily apparent, as the target population might not be in the system  Assessment methods: records, key informants, gatekeepers, data collection

Needs  If the target population is not reached, even good programs, policies and laws may not have an impact  Weed and Seed example  Adolescent drug offender example

Needs  Establishment of goals and objectives  Exercise: what are the goals of a prison  Mechanisms (objectives, activities) for meeting those goals  Develop a list

In an evaluation  The research must ask  What does the program intend to accomplish?  How do existing staff determine whether they have attained their goals?  Have formal goals and objectives been identified and prioritized?

Evaluation  What performance measures are currently used?  Are they adequate, or must additional measures be developed as part of the evaluation?  It would be very useful if evaluators were included at the start of a program to establish measures, seldom happens

Monitoring (process)  What is actually happening in the intervention?  What happens on paper, theoretically, may be different from what actually happens  Who is actually served by the program?  Are they members of the target population?

Monitoring  If they are not, the program will probably have little impact  how are people selected for inclusion, or how do they decide to participate?  How do participants differ from members of the target population?  How do potential participants differ from nonparticipants?

Monitoring  How do staff feel about the program or policy?  Example: laws and prosecutors  Juvenile judges and juvenile justice programs  Is the program or policy actually being implemented?

Monitoring  Are all the components being addressed?  Example of drug courts  Program components and benchmarks, means of assessing whether program components are being met

Monitoring  Are there problems that were not anticipated?  i.e., lack of community support, resistance to the program or policy, reactions of criminal justice personnel, unexpected obstacles

Monitoring  Unanticipated side effects  Could be positive or negative  Positive: conditions improve for people not in the target population  Mental health centers, nutrition requirements for WIC  Negative: example of net widening  Program may do something else