IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Understanding IUPUI Students: National Survey of Student Engagement Results Presented by: Michele J. Hansen, Ph.D., Director of UC Assessment

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Presentation Overview Background and Purposes of NSSE IUPUI Student Engagement IUPUI Strengths IUPUI Areas in Need of Improvement Students’ Use of Time Special Analysis: Student Engagement in Seminars/Learning Communities Discussion and Next Steps

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement What is NSSE? National survey that assesses the extent to which undergraduate students are involved in educational practices empirically linked to high levels of learning and development. Specifically designed to assess the extent to which students are engaged in empirically derived effective educational practices and what they gain from their college experiences.

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement What Does The College Student Report Cover? Student Behaviors in College Institutional Actions And Requirements Institutional Actions And Requirements  Student Reactions to College Student Background Information Student Background Information Student Learning & Development

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement NSSE Project Scope Almost 900 different colleges and universities 50 states, Puerto Rico, and Canada Data from more than 620,000 students YearColleges/ Universities

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Urban Peer Comparison Institutions University of Akron University of Nebraska - Omaha University of Wisconsin - Milwaukee Wright State University of Missouri - St. Louis University of Massachusetts - Boston University of Toledo

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement NSSE Administration Administrated to a random sample of 1,000 first- year and 1,000 senior students. IUPUI over-sampled several groups of first-year students including those involved in Learning Communities, first-time, full-time students and all those in campus housing. Where possible, each school's senior class was sampled in order to generate comparative analyses for these schools.

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI NSSE Administration A total of 1,683 first-year and 3,156 senior IUPUI students were included in the initial sample. Responses were received from 446 first-year (27% response rate) and 1,017 seniors (32% response rate). Administered as a "mixed mode" survey including both a web and mail format for responding. Administered every other year (in spring)--- alternates with CSSPS

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement NSSE 2004 Response Rates IUPUI response rate = 30% 40% overall for all NSSE 2004 institutions 40% for Paper mode institutions 41% for Web-only institutions Response rates ranged from 9% to 89%

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 2004 College Student Engagement What percentage of our students participate in community service or volunteer work? First-Year 39% Senior 43%

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 2004 College Student Engagement What percentage of IUPUI students did not spend any time during the week participating in co-curricular activities? First-Year 70% Senior 69%

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 2004 College Student Engagement What percentage of IUPUI students work for pay off campus more than 20 hours per week? First-Year 32% Senior 45%

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 2004 College Student Engagement What percentage of IUPUI students participated in a learning community or some other formal program where groups of students take two or more classes together? First-Year 38% Senior 26%

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 2004 College Student Engagement What percentage of IUPUI students discussed ideas from readings or classes with faculty members outside of class (often or very often)? First-Year 14% Senior 20%

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement What Really Matters in College Student Engagement The research is unequivocal: students who are actively involved in both academic and out-of- class activities gain more from the college experience than those who are not as involved. Pascarella & Terenzini. (1991). How college affects students.

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Effective Educational Practices Student-faculty contact Active learning Prompt feedback Time on task High expectations Cooperation among students Respect for diverse talents and ways of learning Chickering and Gamson. (1987). Seven principles of good practice in undergraduate education.

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 2004 Effective Educational Practice What percentage of IUPUI students received prompt feedback from faculty on academic performance— written or oral (% often or very often)? First-Year 51% Senior 59%

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Distinctive Strengths for IUPUI Freshmen Prepared two or more drafts of a paper or assignment before turning it in Worked with other students on projects during class Participated in a community-based project as part of a regular course Used to communicate with an instructor Number of problem sets that take you more than an hour to complete Participate in a learning community or some other formal program where groups of students take two or more classes together

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Distinctive Strengths for IUPUI Freshmen Spending significant amounts of time studying and on academic work Using computers in academic work Using computing and information technology Writing clearly and effectively Speaking clearly and effectively Working effectively with others

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI Freshmen Distinctively Low Had serious conversations with students who are very different from you in terms of their religious beliefs, political opinions, or personal values Number of written papers or reports of fewer than 5 pages [IUPUI students wrote fewer “short” papers] Exercised or participated in physical fitness activities Practicum, internship, field experience, co-op experience, or clinical assignment

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI Freshmen Distinctively Low Participating in co-curricular activities (organizations, campus publications, student government, social fraternity or sorority, intercollegiate or intramural sports, etc.) Relaxing and socializing (watching TV, partying, exercising, etc.) [IUPUI students socialize less] Working for pay off campus [IUPUI students work more hours] Attended an art exhibit, gallery, play, dance, or other theatre performance Voting in local, state, or national elections

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Distinctive Strengths for IUPUI Seniors Prepared two or more drafts of a paper or assignment before turning it in Worked with other students on projects during class Used an electronic medium (list-serv, chat group, Internet, etc.) to discuss or complete an assignment Used to communicate with an instructor

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Distinctive Strengths for IUPUI Seniors Participate in a learning community or some other formal program where groups of students take two or more classes together Number of problem sets that take you less than an hour to complete Using computing and information technology Using computers in academic work

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI Seniors Better than Urban Peers and Doc-Intensive Worked on a paper or project that required integrating ideas or information from various sources Synthesizing and organizing ideas, information, or experiences into new, more complex interpretations and relationships Memorizing facts, ideas, or methods from your courses and readings so you can repeat them in pretty much the same form [IUPUI coursework emphasizes less memorization] Writing clearly and effectively

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI Seniors Distinctively Low Number of written papers or reports between 5 and 19 pages Exercised or participated in physical fitness activities Practicum, internship, field experience, co-op experience, or clinical assignment Participating in co-curricular activities (organizations, campus publications, student government, social fraternity or sorority, intercollegiate or intramural sports, etc.)

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI Seniors Distinctively Low Providing care for dependents living with you (parents, children, spouse, etc.) [IUPUI students spend more time caring for dependents] Relaxing and socializing (watching TV, partying, exercising, etc.) [IUPUI students socialize less] Attending campus events and activities (special speakers, cultural performances, athletic events, etc.) Voting in local, state, or national elections

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Average Hours Per Week Spent in Academic and Non-Academic Pursuits Freshmen

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 2004 IUPUI Freshmen: Percent of Time Engaged in Academic and Non-Academic Activities 0%20%40%60%80%100% Campus/Vicinity Resident African American Overall First-Generation Commuter Preparing for class (studying, reading, writing, rehearsing, and other activities related to your academic program) Participating in co-curricular activities (organizations, campus publications, student government, etc.) Working for pay on campus Relaxing and socializing (watching TV, partying, exercising, etc.) Commuting to class Providing care for dependents living with you (parents, children, spouse, etc.) Working for pay off campus

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 0%20%40%60%80%100% Campus/Vicinity Resident Hispanic African American Overall First-Generation Commuter Preparing for class (studying, reading, writing, rehearsing, and other activities related to your academic program) Participating in co-curricular activities (organizations, campus publications, student government, etc.) Working for pay on campus Relaxing and socializing (watching TV, partying, exercising, etc.) Commuting to class Providing care for dependents living with you (parents, children, spouse, etc.) Working for pay off campus 2002 Freshmen: Percent of Time Engaged in Academic and Non-Academic Activities

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement 0%20%40%60%80%100% Campus/Vicinity Resident Overall Commuter First-Generation African American Hispanic Preparing for class (studying, reading, writing, rehearsing, and other activities related to your academic program) Participating in co-curricular activities (organizations, campus publications, student government, etc.) Working for pay on campus Relaxing and socializing (watching TV, partying, exercising, etc.) Commuting to class Providing care for dependents living with you (parents, children, spouse, etc.) Working for pay off campus 2002 Seniors: Percent of Time Engaged in Academic and Non-Academic Activities

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement NSSE 2004 IUPUI Freshmen Results Thinking about your overall experience at this institution, how would you rate the quality of relationships with faculty and administrative personnel and offices?

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement NSSE 2004 IUPUI Senior Results Thinking about your overall experience at this institution, how would you rate the quality of relationships with faculty and administrative personnel and offices?

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI NSSE 2002 & NSSE 2004 Thinking about your overall experience at this institution, to what extent does the college provide the support you need to succeed academically?

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI NSSE 2002 & NSSE 2004 Thinking about your overall experience at this institution, to what extent does the college encourage you to attend campus events and activities (speakers, performances, athletics, etc.)?

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement IUPUI NSSE 2002 & NSSE 2004 Thinking about your overall experience at this institution, to what extent does the college encourage contact between students from different economic, social, and racial or ethnic backgrounds?

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Differences in Student and Faculty Perceptions

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Comparison of IUPUI Results with NSSE Sample To what extent has your experience at this institution contributed toward your knowledge, skills, and personal development in acquiring a broad education (% very much)?

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Comparison of IUPUI Results with NSSE Sample To what extent has your experience at this institution contributed toward your knowledge, skills, and personal development in acquiring a broad education (% very much)?

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement NSSE 2004 Disappointing Finding 17% of first-year students reported that they did not complete any papers between 5 and 19 pages. 13% of seniors students reported that they did not complete any papers between 5 and 19 pages.

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Overall Perceptions of IUPUI 81% of first-year students reported that if they could start over again would go to same institution now attending. 76% of seniors reported that if they could start over again would go to same institution now attending.

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement First-Year Student Engagement Index

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Senior Student Engagement Index

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement First-Year Seminar Impact on Engagement

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Engagement and Themed Learning Communities Worked on a paper or project that required integrating ideas or information from various sources NMeanStd. Deviation TLC Participants Non- Participants

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Engagement and Themed Learning Communities Worked with classmates OUTSIDE OF CLASS to prepare class assignments NMeanStd. Deviation TLC Participants Non- Participants

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Using NSSE Data Discover current levels of engagement (institution, major field, year in school) Determine if current levels are satisfactory (criterion reference, normative, or peer comparison) Target areas for improvement Modify programs and policies accordingly Teach students what is required to succeed Monitor student & institutional performance Areas of Effective Educational Practice Areas for Institutional Improvement

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Internal Campus Uses Institutional Improvement Peer Comparison Student Affairs Academic Advising Faculty Development Academic Affairs 1st Year & Senior Experience Learning Communities Institutional Research Enrollment Management Learning Assessment

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement External Campus Uses Public Accountability Prospective Students Alumni State Policy Makers Accrediting Bodies Fund Raising Performance Indicators Focus on Right Things Media Governing Boards Parents

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement

IUPUI Council on Retention and Graduation – October 13, 2005 National Survey of Student Engagement Use and Validity of Self-Reports Validity of Self-Reporting Improves When… Requested information is known to respondents Questions are clear and unambiguous Respondents take questions seriously and thoughtfully Answering does not threaten, embarrass, or violate privacy or compel a socially desirable response