Conclusion & Implications

Slides:



Advertisements
Similar presentations
Disaggregate to Appreciate Making SENSE of Texas’ Entering Community College Students 2012 TAIR Conference Corpus Christi, TX.
Advertisements

Student Satisfaction Geneva College Student Satisfaction Inventory (SSI: Noel-Levitz) 1997 to 2013.
The three experiences our grounded with two core learning outcomes and are built upon as the student moves through the leadership continuum. Foundation.
From Community College Student to University Student: Transitioning the Transfer EOP 40 th Anniversary Conference Lea J. Manske & Kim Huynh Student Support.
DIT STUDENT SATISFACTION SURVEY 2010 Dr Rachel O Connor Mark Russell Campus Life & Student Retention Office DUBLIN INSTITUTE OF TECHNOLOGY.
The Personal Development Plan (PDP)
Entering Community College Students: Consciously Creating Critical Connections 2012 FYE Conference San Antonio, TX.
Aspiring Eagle Scholars Program: A Model for Success North Carolina Central University 10/24/07.
WEST VIRGINIA UNIVERSITY Institutional Research WEST VIRGINIA ADVENTURE ASSESSMENT Created by Jessica Michael & Vicky Morris-Dueer.
Basic Workshop For Reviewers NQAAC Recognize the developmental engagements Ensure that they operate smoothly and effectively” Ensure that all team members.
Summer 2014 Glenville State College Forensics Science Student and Teacher Post Evaluation Results.
Partnering for Student Success The Bridge to Clemson University Program Sue Whorton Clemson University National Institute for the Study of Transfer Students.
UENR conference Gill, Cal Poly March 15, 2008 College of Agriculture Food, and Environmental Sciences Faculty Mentoring Faculty Program Samantha Gill Natural.
Gallaudet University 2015 There’s No Place Like Home: Assessing Climate Prepared by OAQ/Office of Institutional Research October 20,
Exploring Non-Cognitive Influences on College Success with New First-year Advisees Kristin Douglas Associate Dean of the College Mary Windeknecht Director.
Meeting Transfer Student Needs Through Peer Mentorships, Transfer Housing, and Family Involvement Alyssa Mustard, Graduate Assistant for Family & Transfer.
Assessing the Effect of Resident Assistant Training on Implementing Programs at SUNY Buffalo Christine Matos, MPA Project· Dr. Suparna Soni –Project Advisor.
Undergraduate Research Opportunity Program
“Excuse Me Sir, Here’s Your Change”
Development of Self-Determination and Social Skills of College-Bound Students with Visual Impairments Report on an Intervention Program Designed to Improve.
Summary of VCU Student Satisfaction Fall 2012
Portfolio Development
Program Review Presentation April 2012
iStart: New Student Days
Assessment Basics PNAIRP Conference Thursday October 6, 2011
Individualized research consultations in academic libraries: Useful or useless? Let the evidence speak for itself Karine Fournier Lindsey Sikora Health.
ePortfolios and the First-Year
First-Year Experience Seminars: A Benchmark Study of Targeted Courses for Developmental Education Students.
Bridges To Success “Effective Advising in Guided Pathways: Executing advising plans that transform departments and institutions to help students achieve.
Prebriefing: The Final Frontier
Bridging the Gap for Students at Risk: A Data-Driven Case
Librarian Led Technology Sessions Participation in EBM Conference
The following is a presentation prepared for NASFAA’s 2016 National Conference in Washington, DC July 10 – 13, 2016.
THE FIRST YEAR EXPERIENCE
Evaluation of An Urban Natural Science Initiative
NSF LSAMP National Meeting Evaluation Presentation
Human Development Department Excellence is a CHOICE.
BSI-SSSP-Equity Integrated Planning Meeting #2
Assessment planning: It’s the parts that make up the whole!
How to Assess Common Reading Programs
Strengths-Based Advising
Dr. Mark Allen Poisel July 16, 2013
Aidyn L. Iachini a, Allie Riley b, and Dawn Anderson-Butcher b
Derek Herrmann & Ryan Smith University Assessment Services
Your Institutional Report Step by Step
Helping US Become Knowledge-Able About Student Engagement
Providing Customized Training on Quality Online Design and Delivery
AVID College Completion Project
Portfolio Development
19 - Full time faculty completed the survey
Michele Hansen, Steven Graunke, Robbie Janik
TAPS Academy Evaluation
Access Center Assessment Report
Imagine Success Engaging Entering Students Innovations 2009
Topic Principles and Theories in Curriculum Development
Strategies Increasing Student Retention & Success
Faculty Role in Student Success
Student Satisfaction Results
Student Equity Planning August 28, rd Meeting
SENSE: Survey of New Student Engagement
Predicting Transition and Adjustment to College: Minority Biomedical and Behavioral Science Students’ First Year of College Sylvia Hurtado, June C. Chang,
Committee # VI: Medical Students: Student Services/Learning Environment.
Research and Advising Case study: Maastricht University/University College Maastricht Advisors' Forum: Using Research to Empower Advising NACADA Annual.
STUDENTS AS PEER MENTORS:
Assessing Administrative and Educational Support Services
Michele Hansen, Steven Graunke, Robbie Janik
Learning Community II Survey
Portfolio Development
The Impact of Peer Learning on Assessment Literacy and Feedback Orientation
WP Research and Evaluation Manager
Presentation transcript:

Conclusion & Implications Using a comparison group to evaluate program impact: Summer Bridge participant outcomes Norma León, Student Support & Equity Programs Summer Bridge others in college,” “I feel I will be able to connect with faculty in college,” and “I see people as friendly and approachable in college.” The connectedness scale was adapted from Lee, Draper, and Lee’s (2001) social connectedness scale. A composite scale was built from the 9 items. All learning outcomes and connectedness item responses were set with a Likert type 5-point scale where 1 = Strongly Disagree, and 5 = Strongly Agree. The closeness to the campus was measured with one item adapted from Aaron, Aaron, and Smollan’s (1992) inclusion of other in the self scale. Rather than measuring closeness with another individual, this scale was adjusted to measure closeness with the institution. Participants selected the pair of circles that best represented their connection to the campus from the following: The three LOs where SB participants and non-participants did not differ significantly were: “I can describe what plagiarism is,” “I know the consequences for not following university policies,” and “I know what it means to be accountable for my own education.” These LOs are broad in nature, and students should have a good sense of them through prior experience as students in general. Connectedness: A statistically significant t-test analysis (t = 5.79, df = 211, p < .001) indicated that SB participants had higher means (M = 4.29) in the connectedness scale than non-participants (M = 3.78), therefore, SB participants had a better outlook about their connection with people at Cal Poly Pomona. Closeness to campus: A statistically significant t-test analysis (t = 4.77, df = 210.05, p < .001) indicated that SB participants also had a higher mean (M = 3.84) than non-participants (M = 3.28) on the closeness to campus scale, meaning that they included Cal Poly Pomona in their sense of self to a greater extent. Living on campus: Ninety-seven students indicated they were going to live on campus in Fall 2015, 38 of them were SB participants and 59 were not. A statistically significant t-test analysis (t = 2.33, df = 88.31, p < .05) indicated that SB participants felt better overall (M = 4.31) about being able to manage living on campus than non-participants (M = 4.02). Summer Bridge (SB) is a summer transition program designed to assist incoming EOP first-year students in their transition from high school to college. Students take a five-week course, live on campus for the first three weeks and commute for the last two weeks, participate in faculty lectures, workshops, peer networking activities, an academic advising seminar that covers key topics for a successful transition (e.g., curriculum requirements, registration, BroncoDirect, financial aid, university policies, student success behaviors), tutoring, study time, residence life programming activities intended to build community, all while learning about Cal Poly Pomona. SB fulfills the university’s mandatory orientation requirement. SB covers all topics included in orientation programs, and coordinates with Orientation Services so that participants can join a college advising session and experience Bronco Spirit Night. Living on campus items included “I feel comfortable about living in the residence hall,” “I feel I can resolve conflicts in the residence hall if they come up,” and “I feel confident about living away from home.” The response scale was the same as the learning outcomes and connectedness scale. A composite scale was built from the 5 items. Results Purpose of Assessment Two hundred and forty (240; 91%) students responded to the survey, but only 213 (80%) completed the survey through the end (some questions did not apply to all students). 96 participated in SB 117 did not (113 of them participated in an Orientation Program) Learning Outcomes (LOs): SB participants felt they knew, understood, could list or could describe more information related to learning outcomes than non-participants. T-test analyses showed that SB participant’s means were significantly higher than non-participants on all learning outcomes except on three. Below are examples of items with statistical significance of p ≤ .001: In past years, pre and post assessments were implemented to determine if students met predetermined learning outcomes. Every year, learning outcome results were highly positive. Students demonstrated learning everything that was intended for them to learn in the program. To expand our understanding of the impact of Summer Bridge, an assessment was designed to compare the acquired knowledge and sense of belonging/connectedness of SB participants with similar non-participants. The research questions were: Do SB participants learn more than similar non-participants? Do SB participants develop a stronger sense of belonging to the campus than similar non-participants? Comfort about living on campus was also measured. Methodology Conclusion & Implications Fall 2015 incoming EOP students (265 total) were sent a survey through CampusLabs (the Student Affairs assessment platform) in mid-August. The survey contained 24 learning outcome based items, 9 items that composed a connectedness scale, 1 item for closeness to the campus, 5 items related to living on campus, and other demographic and SB related questions. The focus of this assessment report is on the items that can be compared between SB participants and non-participants (learning outcomes, connectedness, closeness to campus, and living on campus items). Learning outcome items covered a variety of areas. For example, “I can list three important advising tools that will help me plan my courses so that I can meet graduation requirements,” “I can describe what plagiarism is,” “I can interpret my Award Summary information on BroncoDirect,” and “I know where to go at Cal Poly Pomona for assistance with writing assignments.” Connectedness items included, “I see myself as someone who can connect with In general, this assessment showed that, when compared to similar students who did not participate in Summer Bridge, SB participants had more confidence than non-participants in their knowledge and ability to describe and list information related to being a successful student at Cal Poly Pomona in 21 of 24 pre-identified LOs. SB participants also had stronger feelings of connectedness and closeness to campus. When looking only at students who were going to live on campus during their first year, SB participants felt more confident in their ability to manage study demands, conflicts, making friends, and being away from home, than non-participants. Almost all students who did not participate in SB had attended an Orientation program, therefore, the impact of SB can be said to go above and beyond what students gain through orientation. This assessment shows the value of using a comparison group to evaluate the impact of a program. When possible, program evaluations should include such groups for a greater understanding of program impact. For this SB in particular, survey items will be reviewed to assess if modifications would yield improvements.