2009 Student Opinion Survey Results Prepared by Dr. Steven Perry Vice President for Student Development Dr. Patricia Francis, Associate Provost for Institutional Assessment and Effectiveness For Internal Use Only

Using SOS Data Discover current levels of satisfaction Monitor trends over time Target programs and policies for improvement Encourage dialogue about quality of student life and learning Link with other data to test hypotheses, evaluate programs Disaggregate the data for subpopulations (e.g., race, gender, FTFT/transfer students, etc.)

Examples: Encourage dialogue about quality of learning 2006 to 2009: gains of .23 to .34 (p < .000) How Often Have You: Been Required to Think Critically in Completing Assignments Worked with Other Students on Class Assignments Received Feedback on Quality of Work Had to Make Judgments About Value of Information. Etc. Had Discussions with Faculty Outside Class

Examples: Using SOS Results to Make Improvements Developing Leadership Skills Personal security and safety on this campus 2006 = 3.10 2009 = 3.58 Possible influence = LEAD@Oneonta 2006 = 3.90 2009 = 4.31 Possible influences = NYAlert, siren, video monitoring

Administration 2009 2006 Via Web N= 1339 (1261 used in analysis) Female= 64.6% Freshmen= 12.1%* Senior= 33.5%* AALANA=12.3% Response Rate = 27% * similar to sector averages During Class N= 676 Female= 60.3% Freshmen= 29.6% Senior= 22.8% AALANA=13.3% Response Rate = 72.5%

Two Ways to Look at Data Look at our high and low mean scores in each section* Compare our 2009 scores with 2006 scores *SOS items are rated using a 1-5 Likert scale Focus on our own performance Longitudinal data How same students rated our programs and services More data, but less meaningful

Results: High and Low Scores

ACADEMIC ENVIRONMENT, EXPERIENCES, FACILITIES, 15 Items Highest Scores Library Services Library Resources Class Size Considering the Type of Class Availability of Instructors Outside Class Quality of Instruction Lowest Scores Academic Advising in your Major General Academic Advising College Computer Network Availability of Courses in your Major Availability of Internships

ACADEMIC EXPERIENCES: 14 Items Highest Scores Gone to Class with Course Readings and Assignments Completed Been Required to Think Critically in Completing Assignments Had Out-of-Class Assignments that Required a Written Response Received Feedback on Quality of Work Experienced disruptive classroom behavior and had faculty who came to class unprepared ranked 4 and 3, respectively. While not significant these should be of some concern.

ACADEMIC EXPERIENCES: 14 Items Lowest Scores Been Involved in Community Service through a Program at College Had Faculty Members Who Communicated Ineffectively (2.76) Experienced Classroom Behavior by Other Students that was Disruptive to Learning (2.59) Observed Student Dishonesty when Completing Assignments or Exams (2.31) 2=Rarely and 3=Sometimes

COLLEGE SERVICES, FACILITIES AND ENVIRONMENT: 46 Items Highest Scores Library Facilities Freedom from Harassment on Campus Personal Safety /Security Opportunities for Involvement in Campus Clubs/Activities Campus Acceptance of Individual Differences Athletic and Recreational Facilities Recreation and Intramural Programs Campus Openness to Opinions of Others Study Areas (Not Including Studios) Faculty Respect for Students Non-teaching Staff Respect for Students

COLLEGE SERVICES, FACILITIES AND ENVIRONMENT: 46 Items Lowest Scores Health Services Purposes for Which Student Activity Fees Are Used Student Input in College Policies/Plans College Help in Finding Part-Time Jobs College Food Services Parking Facilities

COLLEGE EXPERIENCES: 7 Items All Scores Comparing the Cost to the Quality of Education, this College is a Good Value (4.11) The Rules Governing Student Conduct Are Clear to Me (4.10) Academic Advising Is Available to Me When I Need It (4.06) Acts of Racial Prejudice are Rare on this Campus (4.01) This College Has Helped Me Meet the Goals I Came Here to Achieve (3.95) Developed Mentoring Relationship with Faculty (3.67) Difficult to Finance My College Education (3.11)

COLLEGE OUTCOMES: 15 Items Highest Scores Acquiring Knowledge and Skills Needed for a Career Acquiring Information, Ideas, and Concepts Acquiring Knowledge and Skills for Intellectual Growth throughout your Life Acquiring Knowledge and Skills for Further Academic Study

COLLEGE OUTCOMES: 15 Items Lowest Scores Using Computer and Information Technology Effectively Understanding/Appreciating Ethnic/Cultural Diversity and Individual Differences Understanding Political and Social Issues Understanding your Rights and Responsibilities as a Citizen

Results: 2009 vs. 2006

Comparing 2006 and 2009 Scores for Significant Changes Down-sampling by class used to create more comparable data files Subjects selected randomly Sample sizes: 2009 = 522 2006 = 654

Comparing 2006 and 2009 Scores for Significant Changes 99 items comparable to 2006 survey Significant improvement on 90 items Comparable scores on 8 items Significant drop on 1 item Had out-of-class assignments that required a written response

Largest Mean Score Improvement (>.40) Job placement services Campus help finding part-time jobs Speaking clearly and effectively Developing leadership skills Personal security and safety on this campus Personal counseling services

OVERALL COLLEGE IMPRESSIONS AND PLANS 2009 2006 Difference Is your current plan to graduate from this college? 4.74 4.55 0.19*** If you could start over, would you choose to attend this college again? 4.16 3.97 What is your overall impression of the quality of education at this college? 3.88 3.74 0.14*** How satisfied are you with this college in general? 4.05 0.11** Compare 2006 and 2009

Two Notable Local Items RESULTS: Two Notable Local Items

Effect of Interim Progress Reporting System on My Academic Effort Low or very low=30.2% Average=27.4%

Study Abroad Thinking About Study Abroad Frequency Valid Percent   Frequency Valid Percent Plan to Participate 184 15.82% Unfamiliar with Services 109 9.37% Believe it is Unaffordable for Me 260 22.36% Requirements Restrict My Ability to Participate 178 15.31% Not Seriously Considered or Discussed it with Family or Advisors 210 18.06% Not Interested 222 19.09% Total 1163 100.00%

Written Comments 282 written comments (22%) Most mentioned topics: Positive: Overall satisfaction with college (47) Negative: Parking (30) Dining (29) Interim progress reports (18)

Comparing Oneonta to 12 Other Campuses in Our Sector Compared to our Sector on all 101 items Significantly higher on 96 items Comparable scores on 5 items Significantly lower on 0 items

Rank Among Sector Colleges Highest score on 35 items Top three scores on 88 items Lowest sector ranks 10: Difficult to finance education 7: Health services * 7: Faculty members who communicated ineffectively in class 7: Observed student dishonesty ** 6: Campus food services * or ** = Significantly higher mean score

Observations and Conclusions Use caution when interpreting data Improvements at every administration since 1994, but never this dramatic Despite our efforts, it may be difficult to sustain these results Complacency may be our worst enemy Comparing to other campuses is especially risky

Some Areas for Possible Further Review and/or Action Academic Services Internships Interim progress reports Academic Experiences Classroom communication Classroom disruption Classroom dishonesty Study abroad College Services… Parking Food services Part-time jobs

Some Areas for Possible Further Review and/or Action College Experiences Financing education Outcomes Understanding/Appreciating Ethnic/Cultural Diversity and Individual Differences Understanding Political and Social Issues Understanding your Rights and Responsibilities as a Citizen

Next Steps Disaggregate the data for subpopulations Examples: Race Gender FTFT/transfer students Please discuss additional data analysis ideas or requests with Patty Francis or Steve Perry

Questions and Comments Thank You Questions and Comments