E. D. Bell.  Kapp & Anderson (2010) argue that the program evaluation process has eight steps that are fluid, dynamic, and interdependent, i.e., they.

Slides:



Advertisements
Similar presentations
Research Strategies: Joining Deaf Educators Together Deaf Education Virtual Topical Seminars Donna M. Mertens Gallaudet University October 19, 2004.
Advertisements

1 of 20 Evaluating an Information Project From Questions to Results © FAO 2005 IMARK Investing in Information for Development Evaluating an Information.
Working with Black & Ethnic Minority Families WELCOME.
“We talk a lot and talk pretty well about race, but we don’t listen enough. And I’m hoping that if we listen to each other, we can begin to … make this.
O'Leary, Z. (2004) The Essential Guide to Doing Research. London: Sage. Chapter Four1 Exploring Power and Ethics in Research What responsibilities do I.
Reviewing and Critiquing Research
Choosing a research approach: What type of qualitative research should we use?
Research Methods for Business Students
THE QUALITATIVE RESEARCH APPROACH Chapter 3. WHAT IS THE INTERPRETIVE WAY OF THINKING? Multiple Realities Data versus Information Subjects versus Research.
Cultural Competencies: The Big Picture Melynda Huskey Office of the Vice President for Equity and Diversity.
1 Minority SA/HIV Initiative MAI Training SPF Step 3 – Planning Presented By: Tracy Johnson, CSAP’s Central CAPT Janer Hernandez, CSAP’s Northeast CAPT.
Chapter 1 The Working Director ©2013 Cengage Learning. All Rights Reserved.
Reality Check For Extension Programs Deborah J. Young Associate Director University of Arizona Cooperative Extension.
CULTURAL COMPETENCY.
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 3: Engaging stakeholders.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation Culturally Appropriate Data Collection Methods How.
Standards and Guidelines for Quality Assurance in the European
How to Develop the Right Research Questions for Program Evaluation
PARTICIPATING IN EX APPOINTMENT PROCESSES
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 2: Developing an evaluation plan.
TRAINING CURRICULUM What does cultural competency mean and why should I care? Sujata Warrier, Ph.D. For Asian & Pacific Islander Institute on Domestic.
Sustainable Tourism development
DOMESTIC VIOLENCE FAIRNESS AND CULTURAL CONSIDERATIONS
Consumer Perception of Culturally Competent Outpatient Services & Hospital Use Carol Carstens, PhD, LISW-S Meeting of the Ohio Community Support Planning.
What is Culture? Culture is shared values, norms, traditions, customs, history, and beliefs of a group of people. Culture has a multitude of aspects Cultural.
Organization Mission Organizations That Use Evaluative Thinking Will Develop mission statements specific enough to provide a basis for goals and.
MULTICULTURAL COUNSELLING IN COUNSELLOR TRAINING IN FINLAND Helena Kasurinen University of Eastern Finland.
Chapter 5 Serving Culturally Diverse Children and Families.
The Evaluation Plan.
Demystifying the Business Analysis Body of Knowledge Central Iowa IIBA Chapter December 7, 2005.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Working Definition of Program Evaluation
NURSING THE OLDEST OF ARTS.
University of Leeds Ethnicity and Cultural Diversity Network The Globe Centre, Accrington 22 nd September 2005.
Workshop 6 - How do you measure Outcomes?
Cultural Competence & Capacity Building By: Nate Hartman, Chris Hunter, Terry Martin, & Kristin Williams Chapter 9.
1 Michigan Department of Education Office of School Improvement One Common Voice – One Plan Michigan Continuous School Improvement (MI-CSI)
Qualitative Data Analysis Lecture 27 th. Recap 2.
Social Studies Grades What is Social Studies? “Social Studies provides coordinated, systematic study drawing on such disciplines as anthropology,
The Interactive Model Of Program Planning
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
1: Inter-Act, 13th Edition Orientation.
REVIEW OF TR PROGRAM DESIGN
Chapter 1 Introducing Organizational Behavior People Make the Difference.
11/3/2011 Exploring How Values, Identity and Gender Influence Evaluator Approach and Role.
Program Evaluation DR. MAJED WADI. Objectives  Design necessary parameters used for program evaluation  Accept different views of program evaluation.
Creswell Qualitative Inquiry 2e
AP United States History 2015 Changes to the class.
Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation
Copyright © 2014 by The University of Kansas Building Culturally Competent Organizations.
Influencing Policy through Research: Introduction to Principles and Tools Arnaldo Pellini:
UNIT THREE THEORITICAL BASES FOR TRANSCULTURAL NURSING CARE CAMPINHA-BACOTE'S MODEL OF CULTURAL COMPETENCE DR MAHMOUD MUSLEH.
CONTEXTUAL FACTORS OF EVALUATION PRACTICES Evaluation is a must in any program planning model Evaluation is a must in any program planning model There.
The Crossnore School New Employee Orientation CULTURAL COMPETENCY.
1 Introduction to Cultural Competence A Training Tool.
AES 2010 Kate McKegg, Nan Wehipeihana, Jane Davidson.
Authentic service-learning experiences, while almost endlessly diverse, have some common characteristics: Positive, meaningful and real to the participants.
Standards and Competences for Social work Education for working with children and youth Prof dr Nevenka Zegarac Ass MA Anita Burgund.
Occur when a societal condition is improved due to a participant’s action taken in the previous column. \ -Increased number and more diverse pool of youth.
Universal GO 4 IT Training. Welcome and Introductions.
Goal To increase awareness about cultural competence.
Evaluating with Perspective: Mobilizing Community Participation in Program Evaluation …its not too late!
MaryCatherine Jones, MPH, Public Health Consultant, CVH Team
14 Cultural Competence Training, Assessment, and Evaluation of Cultural Competence, and Evidence-Based Practices in Culturally Competent Agencies.
Program Evaluation Essentials-- Part 2
DOMESTIC VIOLENCE FAIRNESS AND CULTURAL CONSIDERATIONS
CONTEXTUAL FACTORS OF EVALUATION PRACTICES
TRAINING CURRICULUM What does cultural competency mean and why should I care? Sujata Warrier, Ph.D. For Asian Pacific Institute on Gender-Based Violence.
Summary Slide PROGRAM EVALUATION PA430 – Week 7 – 2/29-3/1/00.
Using Logic Models in Project Proposals
Presentation transcript:

E. D. Bell

 Kapp & Anderson (2010) argue that the program evaluation process has eight steps that are fluid, dynamic, and interdependent, i.e., they are not linear – they influence and shape one another throughout the evaluation process.

1. Identify the evaluation question 2. Conceptualize the evaluation question Conceptualize 3. Operationalize the evaluation question Operationalize 4. Pick and define the method 5. Select the sample 6. Collect the data 7. Analyze and manage the data 8. Utilize the information to improve program performance

Kapp & Anderson (2010) make this point The steps of the evaluation process need to be framed with an appreciation of two fundamental notions: (1). The use of information for service improvement is primary, and (2). The context for evaluation is an agency where evaluation must compete with many enterprises for attention. (p. 29)

 Given these notions, the agency needs to implement the following steps concurrently with the implementation of the program evaluation: 1. Define the program 2. Support users 3. Implement and report design of the evaluation (Kapp & Anderson, 2010)

“ The process of conducting research and the evaluation of programs and the outcomes associated with these activities have the potential to be helpful or harmful to individuals, groups, organizations, and the broader society” (Kapp & Anderson, 2010, p. 39).

So, if you were a participant in a study, what would you want to know? If you were a program director, how would you want the evaluators to conduct themselves? If the evaluation of your program found a number of faults, how would you want these to be reported? (Kapp & Anderson, 2010, p. 59)

 Guiding Principles for Evaluators Guiding Principles for Evaluators  Systematic inquiry  Competence  Integrity/Honesty  Respect for people  Responsibilities for general public welfare

“ The process of program evaluation does not take place in a social and cultural vacuum devoid of gender, race, ethnicity, and other consideration” (Kapp & Anderson, 2010, p. 107).

Kapp & Anderson (2010) describe four attributes: 1.Awareness and acceptance – that generates respectful treatment and no prejudgment of abilities, performance, and competency. 2.Self-awareness – that helps you understand how your culture shapes what you see and provides the ability to examine, control, and change assumptions, false beliefs, and stereotypes

3. Dynamics of differences – historical and cultural differences influence how you see and define reality, e.g., see Emmett Till. This story that I saw in Jet magazine as a young person still influences how I see and understand reality. Click on the link “The Picture of Emmett Till”.Emmett Till 4. Knowledge of individual cultures – of the stakeholders who are involved with the program being evaluated.

5. Adaption of skills – The evaluator must be able to determine if her or his methods are culturally appropriate and respectful of the persons and programs that are being evaluated.

 Review Kapp & Anderson (2010) pp. 111 – 131.

“ With most evaluation projects, one of the first things to address is the way the program is supposed to operate” ( Kapp & Anderson, 2010, p. 133).  Develop the logic model of how the program is supposed to work (Program Development and Evaluation, University of Wisconsin – Extension for resource tools)Program Development and Evaluation, University of Wisconsin – Extension

 Interview Stakeholders  Board of Directors  Clients  Community Partners  Funders  Management  Staff (Kapp & Anderson, 2010).

 Use Logic Model Questionnaire (Kapp & Anderson, 2010, p. 139)  Given the first draft of the logic model for the agency what areas of the model require additional information, i.e., what are the potential evaluation questions.  Select one of the areas as the evaluation question for your evaluation plan