1. Assessment of Your Program Why is it Important? What are the Key Elements?

2. Why Conduct Evaluations? Required by NSF http://www.nsf.gov/pubs/2002/nsf02057/nsf02057.pdf Provides Information to Help Improve Project Provides Information to Assess Project Effectiveness Communicates Project to Stakeholders

3. Needs Assessment/ Baseline Data Project Implementation Project Evaluation Project Planning/ Modification

4. Types of Evaluation Formative Evaluation assesses ongoing project activities and implementation Summative Evaluation assesses project’s success in meeting goals and objectives

5. Steps in Evaluation 1.Build Conceptual Model (Logic Model) 2.Develop Evaluation Questions and Define Measureable Outcomes 3.Develop Evaluation Design 4.Data Collection 5.Data Analysis 6.Reporting and Dissemination

6. Conceptual Model (Logic Model) InputsActivitiesOutputs Outcomes Short and Long Term

7. Evaluation Questions and Measureable Outcomes Identify Key Stakeholders Formulate Questions of Interest Define Measureable Outcomes

8. Develop Evaluation Design Select Methodological Approach Define Data Collection Instruments and their Psychometric Properties Determine Who Will be Studied (Power Analyses)

9. Methodological Approaches Quantitative –Comparison Groups and Randomization –Surveys Qualitative –Document Analysis –Focus Groups Mixed Methods Advisory Board

10. Data Collection and Analysis IRB Systematic Collection with Adequate Training Data Analysis Aligned with Questions

11. Reporting Varies Depending on Use Value of Oral and Written

12. Culturally Responsive Considers Context in all Stages of Evaluation –Planning –Implementation –Data Analysis –Reporting and Dissemination

13. Campus Resources Collaborative Assessment and Program Evaluation Services (CAPES) Florida Survey Research Center (Department of Political Science) Faculty in: –Department of Statistics –Division of Biostatistics –Research and Evaluation Methods in Education