CONTEXTUAL FACTORS OF EVALUATION PRACTICES Evaluation is a must in any program planning model There is a gap between model and practice of program evaluation In general evaluation models suggest: Formal Systematic Comprehensive
Purpose of the Study To identify how contextual factors shape evaluation practices
Specific Research Questions What are the evaluation practices of different adult and continuing education agencies in Malaysia What are the contextual factors involved in the evaluation practices of the agencies
RESEARCH METHODOLOGY Qualitative multiple case study Purposive Sampling Three types of organization Panel of experts Four criteria
Data Collection Data Analysis Triangulation Semi structured interview guide Official documents Data Analysis Within case Cross-case
Findings Type of organization: Agency A – Continuing education Agency B – Agricultural extension Agency C – Entrepreneurial development
Numbers of respondents Agency A – 4 Agency B – 4 Agency C – 8 Evaluation unit Agency A - Publication & Consultancy Bureau Agency B – Research & Evaluation Unit Agency C – Every departments conduct own evaluation activities
Evaluation activity Agency A – Informal process evaluation & end of course evaluation Agency B – Periodic evaluation throughout the program & oral evaluation Agency C – Periodic, informal evaluation throughout program and seminar
Contextual Factors Importance of evaluation to the organization * Mission of public organizations * Organizational structure of the organizations * Management’s attitude toward evaluation
Ability of the evaluators Culture of the clientele Tradition bound evaluation practices
Conclusions Minimalist formal evaluation approaches * Reaction level * Monitor input * Findings are not fully utilized
Not comprehensive nor systematic The four contextual factors * Interconnected * Collectively influence practice