EVALUATION THEORY AND MODEL Theory and model should have symbiotic relationship with practice Theory and model should have symbiotic relationship with.

Slides:



Advertisements
Similar presentations
Using the CDC Evaluation Fwork to Avoid Minefields on the Road to Good Evaluation Presented to: 2002 National Asthma Conference October 24, 2002 By: Thomas.
Advertisements

Chapter 3 Striving for Integrity in the Research Process Zina OLeary.
Good Evaluation. Good Evaluation Should … be simple be fair be purposeful be related to the curriculum assess skills & strategies set priorities use multiple.
The Robert Gordon University School of Engineering Dr. Mohamed Amish
EDUCATIONAL RESEARCH It is a systematic enquiry made public (Stenhouse, 1975) It is the process of arriving at dependable solutions to problems through.
Introduction to Monitoring and Evaluation
From Research to Advocacy
Johns Hopkins University School of Education Johns Hopkins University Evaluation Overview.
Measuring Value: Using Program Evaluation to Understand What’s Working -- Or Isn’t Juliana M. Blome, Ph.D. , MPH Office of Program Analysis and Evaluation.
What You Will Learn From These Sessions
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
Program Evaluation Essentials. WHAT is Program Evaluation?
 Systematic determination of the quality or value of something (Scriven, 1991)  What can we evaluate?  Projects, programs, or organizations  Personnel.
Dissemination and Critical Evaluation of Published Research Peg Bottjen, MPA, MT(ASCP)SC.
Decision-Making and Strategic Information Workshop on M&E of PHN Programs July 24-August 11, 2006 Addis Ababa.
© Tefko Saracevic, Rutgers University 1 EVALUATION in searching IR systems Digital libraries Reference sources Web sources.
PPA 502 – Program Evaluation
Reporting and Evaluating Research
1-1 Chapter One RESEARCH IN BUSINESS. 1-2 What is Business Research? A systematic Inquiry whose objective is to provide information to solve managerial.
Evaluation. Practical Evaluation Michael Quinn Patton.
WRITING A RESEARCH PROPOSAL
Research Methods for the Social Sciences: Ethics Ryan J. Martin, Ph.D. Thomas N. Cummings Research Fellow March 9, 2010.
EVAL 6000: Foundations of Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation Getting started with evaluation.
RESEARCH DESIGN.
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 2: Developing an evaluation plan.
CHAPTER 13, qualitative data analysis
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Disciplinary Influences
Reporting & Ethical Standards EPSY 5245 Michael C. Rodriguez.
Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition, or past practice. The importance.
Too expensive Too complicated Too time consuming.
Program Evaluation EDL 832 Jeffrey Oescher, Instructor 6 June 2013.
How to Write a Critical Review of Research Articles
Joint Committee on Standards for Educational Evaluation Evaluation Standards Joan Kruger Spring 2008.
WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.
1 Research Methodology Model. 2 Hypothesis a prediction of what is the case (fact) based on theory Conclusions Observation (s): Phenomena; Problem (Tree)
Research PHE 498. Define Research Research can be considered as systematic inquiry: A process that needs to be followed systematically to derive conclusions.
Monitoring & Evaluation Presentation for Technical Assistance Unit, National Treasury 19 August 2004 Fia van Rensburg.
ScWk 242 Course Overview and Review of ScWk 240 Concepts ScWk 242 Session 1 Slides.
Quantitative and Qualitative Approaches
Literature Review. Outline of the lesson Learning objective Definition Components of literature review Elements of LR Citation in the text Learning Activity.
HMP Evaluation Overview and Tools UNE-CCPH June 22, 2011 Presenters: Kira Rodriguez Michelle Mitchell Patrick Madden Pamela Bruno-MacDonald.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
Unpacking the Elements of Scientific Reasoning Keisha Varma, Patricia Ross, Frances Lawrenz, Gill Roehrig, Douglas Huffman, Leah McGuire, Ying-Chih Chen,
Copyright © 2014 by The University of Kansas A Framework for Program Evaluation.
Evaluation Approaches, Frameworks & Designs HSC 489 – Chapter 14.
CES 20th Annual Conference Keun-bok Kang (CNU) & Chan-goo Yi (ETRI) ; Taejon, Korea A DESIGN OF THE METAEVALUATION MODEL A DESIGN OF THE METAEVALUATION.
Writing a literature review, Stewart McKinney,2008.
ACM 4063 Communication Research
Ch 10 Methodology.
Evidence-Based Practice Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition,
Quantitative Research Qualitative Research? A type of educational research in which the researcher decides what to study. A type of educational research.
Session VI Evaluation & Wrap Up. Evaluation Activities directed at collecting, analyzing, interpreting, and communicating information about the effectiveness.
S519: Evaluation of Information Systems Understanding Evaluation Ch1+2.
Data Driven Planning and Decision-making for Continuous School Improvement: Developing a Program Evaluation Plan Leadership for Innovative Omani Schools.
Understanding the Research Process
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 5 Research Ethics All researchers, even students, have a responsibility to conduct ethical research.
CONTEXT Major International Evaluations Niels Dabelstein.
CHAPTER ONE EDUCATIONAL RESEARCH. THINKING THROUGH REASONING (INDUCTIVELY) Inductive Reasoning : developing generalizations based on observation of a.
Literature Reviews and Research Overview
Chapter 9: Reporting and Evaluating Research
Chapter 5 Research Ethics
Data is your friend: how to incorporate evaluation into your research
EVALUATION THEORY AND MODEL
Business Retention and Expansion
A Framework for Program Evaluation
TECHNOLOGY ASSESSMENT
Evaluation Research Defined as the process of making judgments about the merits, value, or worth of any component of education. (e.g. best text books to.
Presentation transcript:

EVALUATION THEORY AND MODEL Theory and model should have symbiotic relationship with practice Theory and model should have symbiotic relationship with practice Theory connotes a body of knowledge that organizes, categorizes, describes, predicts, explains, and otherwise aids in understanding and controlling a topic Theory connotes a body of knowledge that organizes, categorizes, describes, predicts, explains, and otherwise aids in understanding and controlling a topic Model is an extension of theory which includes the "how to" components Model is an extension of theory which includes the "how to" components

There are more then fifty recognized program evaluation models are found in the literature There are more then fifty recognized program evaluation models are found in the literature House (1978):System analysis, behavioral objectives, decision-making, goal-free, art criticism, accreditation, adversary, and transaction. House (1978):System analysis, behavioral objectives, decision-making, goal-free, art criticism, accreditation, adversary, and transaction. Guba and Lincoln (1989). 4 generations characterized by different methodologies: (a) measurement oriented, (b) description oriented, (c) judgment oriented, and (d) negotiation oriented, Guba and Lincoln (1989). 4 generations characterized by different methodologies: (a) measurement oriented, (b) description oriented, (c) judgment oriented, and (d) negotiation oriented,

Stufflebeam and Shinkfield (1985) classified evaluation models into three broad types Stufflebeam and Shinkfield (1985) classified evaluation models into three broad types Pseudo-evaluation Pseudo-evaluation Quasi-evaluation Quasi-evaluation True evaluation True evaluation

In sum, Stufflebeam and Shinkfield (1985) and Guba and Lincoln (1989) advocate the use of formal, systematic, and comprehensive approaches of program evaluation. In sum, Stufflebeam and Shinkfield (1985) and Guba and Lincoln (1989) advocate the use of formal, systematic, and comprehensive approaches of program evaluation.

Evaluation Standards The Joint Committee on Standards for Educational Evaluation (1981) developed four categories of standards The Joint Committee on Standards for Educational Evaluation (1981) developed four categories of standards utility standards utility standards feasibility standards feasibility standards propriety standards propriety standards accuracy standards. accuracy standards.

Utility Standards to ensure that an evaluation will serve the practical information needs of given audiences to ensure that an evaluation will serve the practical information needs of given audiences the standards include audience identification, evaluator credibility, information scope and selection, valuational interpretation, report clarity, report dissemination, report timeliness, and evaluation impact. the standards include audience identification, evaluator credibility, information scope and selection, valuational interpretation, report clarity, report dissemination, report timeliness, and evaluation impact.

Feasibility Standards to ensure that an evaluation will be realistic, prudent, diplomatic, and frugal to ensure that an evaluation will be realistic, prudent, diplomatic, and frugal Considerations involved are practical procedures, political viability, and cost effectiveness. Considerations involved are practical procedures, political viability, and cost effectiveness.

Propriety Standards to ensure that an evaluation will be conducted legally, ethically, and with due regard for the welfare of those involved in the evaluation, as well as those affected by its results to ensure that an evaluation will be conducted legally, ethically, and with due regard for the welfare of those involved in the evaluation, as well as those affected by its results these standards are formal obligation, conflict of interest, full and frank disclosure, the public's right to know, rights of human subjects, human interactions, balanced reporting, and fiscal responsibility. these standards are formal obligation, conflict of interest, full and frank disclosure, the public's right to know, rights of human subjects, human interactions, balanced reporting, and fiscal responsibility.

Accuracy Standards to ensure that an evaluation will reveal and convey technically adequate information about the features of the object being studied that determine its worth or merit to ensure that an evaluation will reveal and convey technically adequate information about the features of the object being studied that determine its worth or merit these standards are object identification, context analysis, described purposes and procedures, defensible information sources, valid measurement, reliable measurement, systematic data control, analysis of quantitative information, analysis of qualitative information, justified conclusions, and objective reporting. these standards are object identification, context analysis, described purposes and procedures, defensible information sources, valid measurement, reliable measurement, systematic data control, analysis of quantitative information, analysis of qualitative information, justified conclusions, and objective reporting.