CONTEXTUAL FACTORS OF EVALUATION PRACTICES

Slides:



Advertisements
Similar presentations
Quality Assurance Review Team Oral Exit Report District Accreditation Forsyth County Schools February 15, 2012.
Advertisements

1 Department of State Program Evaluation Policy Overview Spring 2013.
The BYU Idaho Self-Study Overall Characteristics 200 page maximum 200 page maximum Abundant use of graphical displays Abundant use of graphical displays.
CFSAN’s Peer Review for Risk Assessments Robert L. Buchanan, Sherri Dennis, and Marianne Miliotis.
Quantitative vs. Qualitative Research Method Issues Marian Ford Erin Gonzales November 2, 2010.
© 2013 by Nelson Education Ltd.
1 Dissertation Process 4 process overview 4 specifics –dates, policies, etc.
Creating Research proposal. What is a Marketing or Business Research Proposal? “A plan that offers ideas for conducting research”. “A marketing research.
What is Business Analysis Planning & Monitoring?
Needs Assessment: Collecting information, making decisions, and accomplishing results Ryan Watkins, Ph.D. George Washington University Maurya West Meiers.
LOGO Internal Quality Assurance Model: Evidence from Vietnamese Higher Education Tang Thi Thuy, Department of International and Comparative Education,
UNIT D MARKETING INFORMATION MANAGEMENT 7.02 Interpret information to make effective business decisions.
Chapter 11: Qualitative and Mixed-Method Research Design
INTERNATIONAL LABOUR ORGANIZATION Conditions of Work and Employment Programme (TRAVAIL) 2012 Module 13: Assessing Maternity Protection in practice Maternity.
TRAINING EVALUATION WHAT? WHAT? WHY? WHY? HOW? HOW? SO WHAT? SO WHAT?
United States Department of Agriculture Food Safety and Inspection Service 1 National Advisory Committee on Meat and Poultry Inspection August 8-9, 2007.
Methods: Pointers for good practice Ensure that the method used is adequately described Use a multi-method approach and cross-check where possible - triangulation.
E. D. Bell.  Kapp & Anderson (2010) argue that the program evaluation process has eight steps that are fluid, dynamic, and interdependent, i.e., they.
Unit 1 – Preparation for Assessment 1.2 Discuss approaches to auditing the capabilities and capacity of an college in or der to evaluate its readiness.
Evaluation Practices Training providers flourish starting 1992 with the passing of HRD Act Training providers flourish starting 1992 with the passing of.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Quality Assurance Review Team Oral Exit Report District Accreditation Bibb County Schools February 5-8, 2012.
Building and Recognizing Quality School Systems DISTRICT ACCREDITATION © 2010 AdvancED.
Vocabulary 1 Research Process. 1. Problem definition: the purpose of the study should be taken into account; the relevant background info; what info is.
“Outcomification”: Development and Use of Student Learning Outcomes Noelle C. Griffin, PhD Director, Assessment and Data Analysis Loyola Marymount University.
Methodology and Sample: CrossMedia Research™ Based on potential exposure to campaign  Using responses from consumers as to their media consumption across.
Copyright © Allyn & Bacon 2008 Mixed Method and Action Research Designs Chapter 12 This multimedia product and its contents are protected under copyright.
Idaho Energy Plan Proposal (RFI) Energy Policy Institute (EPI)
Quality Assurance Review Team Oral Exit Report District Accreditation Murray County Schools February 26-29, 2012.
Context Evaluation knowing the setting Context Evaluation knowing the setting.
 2007 Johns Hopkins Bloomberg School of Public Health Introduction to Program Evaluation Frances Stillman, EdD Institute for Global Tobacco Control Johns.
 Research Questions. Consider…  Being able to EVALUATE research is the first step in becoming a researcher. This said…read, read, read…every study that.
The BYU Idaho Self-Study Overall Characteristics 200 page maximum 200 page maximum Abundant use of graphical displays Abundant use of graphical displays.
CONTEXTUAL FACTORS OF EVALUATION PRACTICES Evaluation is a must in any program planning model Evaluation is a must in any program planning model There.
Quality Assurance as An Empowerment Tool for Women: A Case from Saudi Arabia INQAAHE Conference, 2009 Dr. Eqbal Z. Darandari King Saud University NCAAA.
1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.
Teacher Assessment in Lithuania Dalia Brazienė, The Senior specialist of Culture, Education and Sports Department of Kaunas Region, Lithuania 12 / 04 /
Building a Leadership- Driven Organization through People and Process Survey data report Tonya M. Peterson Cardinal Stritch University.
Research agenda for the BSA Focusing on the Game Plan Daniel Warren, Ph.D. Team Lead, Research & Evaluation BSA National Service Center.
Incorporating Perspectives of Consumers and Frontline Staff: Presentation at the American Evaluation Association Conference Denver, Colorado Understanding.
Action Research for School Leaders by Dr. Paul A. Rodríguez.
Qualitative Research Methodology
HSTS114 Official, Social & Economic Statistics
Training processes for extension education

Human Capital Development
BSc Computing and Information Systems Module: M2X8630 Research and Development Methods Research Methodologies.
Research Project Title:
Issues in use Sources of secondary data ICPSR
Alternative Assessment (Portfolio)
© 2013 by Nelson Education Ltd.
AN INTRODUCTION TO EDUCATIONAL RESEARCH.
Collaborative Design for Smart Pupils STEM – IMPACT EVALUATION
Standards and Guidelines for Conducting Cognitive Interviews
Presented by: Gail V. Barrington, PhD, CMC
ISO 9001:2015 Quality Management System
Wear and Acceptability Test
a Cross-Cultural Study between Kazakhstan and China
Quantitative vs. Qualitative Research Method Issues
Learning Module 11 Case Study Research.
Chapter 1 Organizational Behavior and Opportunity
School PR 100A Setting the Foundation: Research, Evaluation & Strategic Planning.
Evaluation Practices Training providers flourish starting 1992 with the passing of HRD Act The Act requires companies to contribute 1% of monthly payroll.
Closing the Gap? Critical perspectives of the implementation of Indigenous self-determination in health policy. Madeline E News Nura Gili, Centre for.
Wear and Acceptability Test
Using Logic Models in Project Proposals
TLQAA STANDARDS & TOOLS
Establishing HTA Impact Evaluation From Day One Ruth Louise Poole
Wear and Acceptability Test
Evaluating Staff Development Initiatives
Presentation transcript:

CONTEXTUAL FACTORS OF EVALUATION PRACTICES Evaluation is a must in any program planning model There is a gap between model and practice of program evaluation In general evaluation models suggest: Formal Systematic Comprehensive

Purpose of the Study To identify how contextual factors shape evaluation practices

Specific Research Questions What are the evaluation practices of different adult and continuing education agencies in Malaysia What are the contextual factors involved in the evaluation practices of the agencies

RESEARCH METHODOLOGY Qualitative multiple case study Purposive Sampling Three types of organization Panel of experts Four criteria

Data Collection Data Analysis Triangulation Semi structured interview guide Official documents Data Analysis Within case Cross-case

Findings Type of organization: Agency A – Continuing education Agency B – Agricultural extension Agency C – Entrepreneurial development

Numbers of respondents Agency A – 4 Agency B – 4 Agency C – 8 Evaluation unit Agency A - Publication & Consultancy Bureau Agency B – Research & Evaluation Unit Agency C – Every departments conduct own evaluation activities

Evaluation activity Agency A – Informal process evaluation & end of course evaluation Agency B – Periodic evaluation throughout the program & oral evaluation Agency C – Periodic, informal evaluation throughout program and seminar

Contextual Factors Importance of evaluation to the organization * Mission of public organizations * Organizational structure of the organizations * Management’s attitude toward evaluation

Ability of the evaluators Culture of the clientele Tradition bound evaluation practices

Conclusions Minimalist formal evaluation approaches * Reaction level * Monitor input * Findings are not fully utilized

Not comprehensive nor systematic The four contextual factors * Interconnected * Collectively influence practice