Assessment of Your Program Why is it Important? What are the Key Elements?

Why Conduct Evaluations? Required by NSF Provides Information to Help Improve Project Provides Information to Assess Project Effectiveness Communicates Project to Stakeholders

Needs Assessment/ Baseline Data Project Implementation Project Evaluation Project Planning/ Modification

Types of Evaluation Formative Evaluation assesses ongoing project activities and implementation Summative Evaluation assesses project’s success in meeting goals and objectives

Steps in Evaluation 1.Build Conceptual Model (Logic Model) 2.Develop Evaluation Questions and Define Measureable Outcomes 3.Develop Evaluation Design 4.Data Collection 5.Data Analysis 6.Reporting and Dissemination

Conceptual Model (Logic Model) InputsActivitiesOutputs Outcomes Short and Long Term

Evaluation Questions and Measureable Outcomes Identify Key Stakeholders Formulate Questions of Interest Define Measureable Outcomes

Develop Evaluation Design Select Methodological Approach Define Data Collection Instruments and their Psychometric Properties Determine Who Will be Studied (Power Analyses)

Methodological Approaches Quantitative –Comparison Groups and Randomization –Surveys Qualitative –Document Analysis –Focus Groups Mixed Methods Advisory Board

Data Collection and Analysis IRB Systematic Collection with Adequate Training Data Analysis Aligned with Questions

Reporting Varies Depending on Use Value of Oral and Written

Culturally Responsive Considers Context in all Stages of Evaluation –Planning –Implementation –Data Analysis –Reporting and Dissemination

Campus Resources Collaborative Assessment and Program Evaluation Services (CAPES) Florida Survey Research Center (Department of Political Science) Faculty in: –Department of Statistics –Division of Biostatistics –Research and Evaluation Methods in Education