1. The Proposed Evaluation of the Freshman Scholars Program at San Diego State University – Imperial Valley Campus Alissa M. Ramos California State University, San Bernardino

2. SDSU-IV Freshman Scholars -Was created in 2003 -11 freshman in Cohort 1 -Now: at full capacity (70 students) and a waiting list -Scholarship program for the first 2 years of college: -registration fees - tuition

3. SDSU-IV Freshman Scholars -The program was created to give graduating high school seniors of the Imperial Valley an alternative pathway towards a bachelor’s degree, especially for those who could not or chose not to leave for personal or cultural reasons to a four year university.

4. Purpose of Evaluation The evaluation will focus on the success of the program: – Sustainability – Retention rate – Graduation rate – Program satisfaction from stakeholders

5. Purpose of Evaluation The proposed evaluation will provide the president, provost, and the board of San Diego State University-Main campus with the recommendation to continue or eliminate the Freshman Scholars program at SDSU-IV

6. Type of Evaluation Summative Evaluation – “strives to provide with information to serve decisions or assist in making judgments about the program’s continuation” (Fitzpatrick, Sanders, & Worthen, 2011, p. 21)

7. Model Stufflebeam’s CIPP model Context, Input, Process, & Product Evaluation – “the structure helps administrator/stakeholders make good decisions” (Fitzpatrick, Sanders, & Worthen, 2011, p.173) – Summative Evaluation “to sum up the program’s merit, worth, integrity, and significance” (Fitzpatrick, Sanders, & Worthen, 2011, p.175)

9. Methods CIPP ConceptResearch QuestionMethodological ApproachTime Frame Context EvaluationWhat is the current state of the Freshman Scholars program? -objectives, needs, problems, political climate, & program goals Historical and current program documents: catalog, handbook, and website. Interview with Freshman Scholars Program director, SDSU-IV Dean, SDSU President, & SDSU Provost Continual Input EvaluationWhat comparison program exists to the Freshman Scholars? -theoretical position, resources, & perceptions Comparison program: Focus Groups, Observations, Interviews, program documents Continual Process EvaluationHow is the Freshman Scholars program meeting the needs of students? -barriers, needs, satisfaction Surveys, Focus Groups, Retention Data, Graduation Rates, Scholarship Data 1 month Product EvaluationWhat should be done to the program in response to the findings? -measure & interpret worth & significance Outcomes and Outputs1 month

10. Methods Items for data collection – Student Program Survey (5-point Likert Scale: 5-Excellect to 1-Poor) Current Program Processes – Program staff, admission process, scholarship awarded » Ex. How would you rate the following within the Freshman Program: the advising/registration process? Course Curriculum and Instruction – Instruction of courses, assignments, faculty » Ex. How would you rate the following within the Freshman Program: the instructional support the faculty that teach you provide? Location and Maintenance – campus » Ex. How would you rate the following within the Freshman Program: the overall safety of the campus?

11. Methods Items for data collection – Interview questions

12. Methods Items for data collection – Focus Groups

13. Methods Items for data collection – Focus Groups

14. Methods Items for data collection – Focus Groups

15. Methods Items for data collection – Observations

16. Methods Analysis – Qualitative: Focus Groups, Interviews, Observations – Atlas Ti All recordings and field notes will be transcribed Identify codes (In vivo) Reduce the codes to themes Relate categories Relate categories to analytic framework in literature Create a point of view (scenes, audience, readers) Display the data Creswell, 2012

17. Methods Analysis – Quantitative: Surveys & Reports – SPSS T-test for independent samples (differences between to groups: SDSU-IV vs. CSUSB-PDC) ANOVA (differences between a number of variables) ANOVA (differences between groups: different cohorts in SDSU-IV)

18. Thank you