10 Years of Student Engagement Results: Lessons Learned & High Impact Practices Jillian Kinzie Indiana University, Center for Postsecondary Research

Slides:



Advertisements
Similar presentations
Now That They Stay, What Next?: Using NSSE Results to Enhance the Impact of the Undergraduate Experience.
Advertisements

Maximizing Your NSSE & CCSSE Results
Gallaudet Institutional Research Report: Annual Campus Climate Survey: 2010 Pat Hulsebosch: Executive Director – Office of Academic Quality Faculty Senate.
Prepared by: Fawn Skarsten Director Institutional Analysis.
National Survey of Student Engagement (NSSE) Comparisons of the survey results for UPRM Office of Institutional Research and Planning University of Puerto.
2003 Community College Survey of Student Engagement (CCSSE) SVC Office of Institutional Research Dr. Maureen Pettitt, Director Leslie Croot, M.S., Analyst.
You will be familiar with the five NSSE benchmarks and the survey items that make up each benchmark. You will be familiar with the comparison groups.
DATA UPDATES FACULTY PRESENTATION September 2009.
Indiana State University Assessment of General Education Objectives Using Indicators From National Survey of Student Engagement (NSSE)
Student Engagement In Good Educational Practices Findings From the 2004 and 2007 National Surveys of Student Engagement Cathy Sanders Director of Assessment.
2012 National Survey of Student Engagement Jeremy D. Penn & John D. Hathcoat.
Shimon Sarraf, Research Analyst Center for Postsecondary Research, Indiana University Bloomington Session for NSSE “Veterans” Regional NSSE User’s Workshop.
A Closer Look at Selected High- Impact Practices George D. Kuh Humboldt State Arcata, CA May 18, 2011.
Dr. Bettina Shuford, Associate Vice Chancellor of Student Affairs Dr. Amy Gauthier, Senior Associate Director, Housing and Residential Education High Impact.
Lessons from the National Survey of Student Engagement Dan BureauMahauganee Shaw Indiana University Center for Postsecondary Research.
What Matters to Student Success: The Promise of High- Impact Practices George D. Kuh RIT Faculty Institute Rochester, NY May 26, 2010.
GGC and Student Engagement.  NSSE  Overall: 32%  First Year: 30%  Seniors: 33%  GGC  Overall: 28%  First Year: 26% (381)  Seniors: 38% (120)
Presentation to Student Affairs Directors November, 2010 Marcia Belcheir, Ph.D. Institutional Analysis, Assessment, & Reporting.
Global Awareness and Student Engagement Allison BrckaLorenz Jim Gieser Program presented at the 2011 ASHE Annual Conference in Charlotte, North Carolina.
Mind the Gap: Overview of FSSE and BCSSE Jillian Kinzie NSSE.
Benchmarking Effective Educational Practice Community Colleges of the State University of New York April, 2005.
National Survey of Student Engagement University of Minnesota, Morris NSSE 2004.
BENCHMARKING EFFECTIVE EDUCATIONAL PRACTICE IN COMMUNITY COLLEGES What We’re Learning. What Lies Ahead.
Derek Herrmann & Ryan Smith University Assessment Services.
Results of AUC’s NSSE Administration in 2011 Office of Institutional Research February 9, 2012.
Community College Survey of Student Engagement CCSSE 2014.
An Equal Opportunity University Third Annual Meeting of the Provost’s Committee on Undergraduate Student Success October 22, 2009.
Presentation of Results NSSE 2003 Florida Gulf Coast University Office of Planning and Institutional Performance.
Selected Results of NSSE 2003: University of Kentucky December 3, 2003.
CCSSE 2013 Findings for Cuesta College San Luis Obispo County Community College District.
 Assessing Student Engagement.  1. Amount of time/effort students put into their studies and other educationally purposeful activities  2. How institutional.
Note: CCSSE survey items included in benchmarks are listed at the end of this presentation 1. Active and Collaborative Learning Students learn more when.
2009 National Survey of Student Engagement (NSSE) Report Institutional Research & Information November 18, 2009.
National Survey of Student Engagement, 2008 Results for UBC-Vancouver.
Gallaudet Institutional Research Report: National Survey of Student Engagement Pat Hulsebosch: Executive Director – Office of Academic Quality Faculty.
APSU 2009 National Survey of Student Engagement Patricia Mulkeen Office of Institutional Research and Effectiveness.
2009 National Survey of Student Engagement (NSSE) Report Institutional Research & Information November 18, 2009.
An Overview.  Association of American Colleges and Universities (AAC&U)  Liberal Education and America’s Promise (LEAP)  aacu.org/leap.
Assessing SAGES with NSSE data Office of Institutional Research September 25 th, 2007.
ESU’s NSSE 2013 Overview Joann Stryker Office of Institutional Research and Assessment University Senate, March 2014.
National Survey of Student Engagement 2009 Missouri Valley College January 6, 2010.
CCSSE 2010: SVC Benchmark Data Note: Benchmark survey items are listed in the Appendix (slides 9-14)
BEAMS – Using NSSE Data: Understanding the Benchmark Reports.
NSSE 2005 CSUMB Report California State University at Monterey Bay Office of Institutional Effectiveness Office of Assessment and Research.
Looking Inside The “Oakland Experience” Another way to look at NSSE Data April 20, 2009.
Student Engagement as Policy Direction: Community College Survey of Student Engagement (CCSSE) Skagit Valley College Board of Trustees Policy GP-4 – Education.
Highlights of NSSE 2001: University of Kentucky December 10, 2001.
Student Engagement and Academic Performance: Identifying Effective Practices to Improve Student Success Shuqi Wu Leeward Community College Hawaii Strategy.
National Survey of Student Engagement (NSSE) Comparison on the survey results at UPRM with peers Office of Institutional Research and Planning University.
Jennifer Ballard George Kuh September 19, Overview  NSSE and the Concept of Student Engagement  Select Linfield results:  NSSE 2011  Brief explanation.
1 NSSE Results Fort Lewis College (2010) Richard A. Miller Exec. Dir – OIRPA.
GGC and Student Engagement.  NSSE  Overall: 27% (down 5%)  First Year: 25% (down 5%)  Seniors: 28% (down 5%)  GGC  Overall: 35% (up 7%)  First.
Why Are HIP Practices so Important to Students?... Where and how are we accomplishing these at CWU? HIGH IMPACT PRACTICES: Create an environment that helps.
The University of Texas-Pan American National Survey of Student Engagement 2005 Results & Recommendations Presented by: November, 2005 S. J. Sethi, Ph.D.
Office of Institutional Research and Effectiveness 1 The University of Texas-Pan American National Survey of Student Engagement 2003, 2004, 2005, 2006.
The University of Texas-Pan American Susan Griffith, Ph.D. Executive Director National Survey of Student Engagement 2003 Results & Recommendations Presented.
The University of Texas-Pan American National Survey of Student Engagement 2013 Presented by: November 2013 Office of Institutional Research & Effectiveness.
Fostering Student Learning & Success Bridging the Gap: Teaching Underprepared Students Jillian Kinzie IU Center for Postsecondary Research February 24,
Learning Communities at Ventura College. What are learning communities? Interdisciplinary learning Importance of sense of community for learning Student.
The University of Texas-Pan American National Survey of Student Engagement 2014 Presented by: October 2014 Office of Institutional Research & Effectiveness.
The University of Texas-Pan American
UTRGV 2016 National Survey of Student Engagement (NSSE)
Your Institutional Report Step by Step
High Impact Practices: HU-HIPs plan
Derek Herrmann & Ryan Smith University Assessment Services
UTRGV 2018 National Survey of Student Engagement (NSSE)
UTRGV 2017 National Survey of Student Engagement (NSSE)
GGC and Student Engagement
Faculty In-Service Week
2013 NSSE Results.
Presentation transcript:

10 Years of Student Engagement Results: Lessons Learned & High Impact Practices Jillian Kinzie Indiana University, Center for Postsecondary Research

The NSSE Project Assessment tool provides institutions with data about student engagement in educational practices that research correlates with student learning & success NSSE results are immediately actionable - institutions can use information to pinpoint strengths & identify areas for improvement Results useful for research and to guide educational practice

What we’ve learned from NSSE Student learning and personal development are enhanced when students engage in educationally purposeful activities. 2.The single best predictor of student satisfaction with college is the degree to which they perceive the college environment to be supportive of their academic and social needs.

What we’ve learned from NSSE Student engagement positively related to student grades and to persistence for all students. 4.At institutions where faculty members use effective educational practices more frequently in their classes, students are more engaged over all and gain more from college.

Findings about FSSE and student engagement 1.When faculty members emphasize certain educational practices, students engage in them to a greater extent than their peers elsewhere. 2.Good things go together.

Senior Students Participation in ‘High Impact Activities’ 0% 10% 20% 30% 40% 50% Somewhat ImportantImportantVery Important Average Importance Faculty Placed on the Experience Percentage of Seniors Who Did the Experience Culminating Senior Experience Research with a Faculty Member Study Abroad

Lessons about Effective Educational Practices 1.Engagement benefits all students – but, some students benefit more. 2.Deep approaches to learning are worth fostering. 3.Some educational activities – “High Impact Practices” - have greater impact on student learning than others.

Engagement is positively related to grades, retention for all students, but some students – those entering with low ACT scores and historically underrepresented students – appear to benefit more than others from the same educational programs or practices.

Effect of Engagement on GPA by ACT scores

From AAC&U: We “hope for students to engage intellectually and seriously with what is taught… [leading to] …the ability to defend positions…write well and think clearly… to develop rational and reflective minds, open to continuous learning…” (Greater Expectations pp. 8-9)From AAC&U: We “hope for students to engage intellectually and seriously with what is taught… [leading to] deep learning …the ability to defend positions…write well and think clearly… to develop rational and reflective minds, open to continuous learning…” (Greater Expectations pp. 8-9) Deep Approaches to Learning: The kind of learning we want for all students

NSSE Deep Approaches to Learning Scales Deep approaches to learning Higher order thinking (item 2b,c,d,e) Integrated learning (items 1d,e,i,p,t) Reflective learning (items 6d,e,f) Educationally substantive information, interesting to faculty Perform well in analyses

 Integrating ideas or information from various sources  Included diverse perspectives in class discussions/writing  Put together ideas from different courses  Discussed ideas with faculty members outside of class  Discussed ideas with others outside of class  Analyzing the basic elements of an idea, experience, or theory NSSE Deep/Integrative Learning  Synthesizing & organizing ideas, info., or experiences  Making judgments about the value of information  Applying theories to practical problems or in new situations  Examined the strengths and weaknesses of your own views  Tried to better understand someone else's views  Learned something that changed how you understand an issue

Findings about NSSE Deep Approaches to Learning & Student Outcomes Increased participation in deep approaches is associated with elevated levels of engagement in other areas, including enriching educational experiences, time spent preparing for class etc. Strong relationship between deep approaches and self-reported gains in intellectual and social development

High-Impact Practices Educational experiences that make a significant difference to student persistence, learning outcomes, and student success. 1.Pedagogical practices for all classrooms 2.Structural features

High Impact Pedagogical Practices Asked questions in class or contributed to class discussions Made a class presentation Prepared two or more drafts of a paper or assignment Worked with other students on projects during class Worked with classmates outside of class on assignments Tutored or taught other students (paid or voluntary) Participated in a community-based project as part of course Talked about career plans with a faculty member or advisor Discussed ideas from readings/classes with faculty outside class Received prompt feedback on your academic performance Worked harder than you thought Worked with faculty on activities outside coursework (committees, student life, etc.) Discussed ideas from readings/classes with others Had serious conversations with students of a different race or ethnicity and those who differ from you - religious beliefs, political opinions, or personal values

High Impact Activities  First-Year Seminars and Experiences  First-Year Seminars and Experiences  Common Intellectual Experiences  Learning Communities  Writing-Intensive Courses  Collaborative Assignments and Projects  Undergraduate Research  Diversity/Global Learning  Service Learning, Community-Based Learning  Internships  Capstone Courses/Projects

Highlights: High-Impact Practices in the First Year Learning communities. Most positive structures include: integrated assignments, activities, or discussion groups; peer mentors; required out-of- class activities. First Year Seminar. Research about what works from The National Resource Center for The First-Year Experience and Students in Transition Service learning. Most beneficial when connected to course; particularly within learning community; most powerful as community-based research.

High Impact Activities  How many of these activities exist for your students?  How widespread are these activities?  Which practices would be particularly beneficial to your students?

Are these magical practices?? High-Impact Activities Increase Odds Students Will: Invest time and effort Interact with faculty and peers about substantive matters Experience diversity Get more frequent feedback Reflect & integrate learning Reflect & integrate learning Discover relevance of learning through real-world applications

Do All Students Experience High-Impact Practices? Nope. High Impact Practices Reach A Fraction of Students Participation Levels in NSSE cohort: First Year Students: Learning Communities 17% Service Learning 36% Seniors: Research With Faculty 19% Internship 53% Study Abroad 19% (9% FG) First-generation (FG), racial-ethnic, major differences

Reactions, Discussion, Questions?? 1.Is your institution focused on these matters? 2.What other effective educational practices are emphasized at your institution?

Findings from NSSE and AAC&U: Some Educational Activities are Unusually Effective Growing evidence that “high-impact practices” provide substantial educational benefits to students

High Impact Activities  First-Year Seminars and Experiences  First-Year Seminars and Experiences  Common Intellectual Experiences  Learning Communities  Writing-Intensive Courses  Collaborative Assignments and Projects  “Science as Science Is Done”; Undergraduate Research  Diversity/Global Learning  Service Learning, Community-Based Learning  Internships  Capstone Courses and Projects

Learning More about High Impact Activities Activities collected by NSSE include participation in: Learning Communities Service Learning Research with a Faculty Member Study Abroad Culminating Senior Experience

NSSE Annual Report 2007 High Impact Practice results Download: (“Reports & Services”)

 Deep learning: Attend to underlying meaning of information as well as content; Integrate and synthesize ideas, information; Discern patterns in evidence or phenomena; Apply knowledge in different situations; View issues from multiple perspectives  Educational Gains:  General Education – Writing; speaking clearly; gen ed; critical thinking  Practical Competence – Working with others, solving real problems, work related knowledge  Personal/Social Development – understanding self; contributing to community; Outcomes Associated with High Impact Practices

First-Year Students Learning Communities Service Learning Study Abroad Senior Capstone Deep Learning General Education ++ + Personal/Social Development Practical Competence ++ +p.10; +++ p.30 Effects of Participating in High Impact Practices on Deep/Integrative Learning and Gains Seniors

High Impact Activities All associated with desirable learning and personal development outcomes. Some features have more impact. Not all students take part.

Learning Communities Formal program where groups of students (FY) take two or more classes together NSSE explored different program features of LC’s … LC programs that integrate material across courses are associated with higher student engagement and learning

Learning Community Program Characteristics Integrative course or discussion group Related to academic major Required out-of-class activities Courses closed to LC students Assignments integrate material Undergraduate peer advisors Majority of courses in LC Residential

Learning Community (LC) Characteristics and Gains  Students who frequently integrate material from LC classes benefitted more in terms of gains, deep approaches to learning, and an enriched social life.  Required out-of-class activities were related to gains in self-understanding, deep learning, and an enriched social life.  An undergraduate peer advisor is associated with reports of more supportive campus environment and an enriched social life.  Living-learning communities linked to the quality of social life, but not other outcomes.

Service Learning Community-based project as part of a regular course More likely to be present at smaller and private institutions Positively associated with deep learning and personal development

Service Learning Education & Business students do more service than others… Faculty Survey of Student Engagement (FSSE) results show 55% faculty teaching FY think “community service” is “important” but, less than 25% do “service-learning” in their FY courses. High ACT more likely to do service Males: “don’t plan to do service.” Being in a LC most important predictor for FY students’ propensity to volunteer

First-Year Learning Communities Research w/ Faculty Study Abroad Senior Capstone Deep Learning General Education ++ + Personal/Social Development ++ Practical Competence ++ + p.10; +++ p.30 Effects of Participating in High Impact Practices on Deep/Integrative Learning and Gains Seniors

High-Impact Practices: Research with a Faculty Member Outside of course or program requirements More likely at Bac A&S colleges and in the sciences; Less likely in business Majority utilized existing info (libraries, WWW), and almost half worked in laboratory and fieldwork settings. Reviewing literature and interpreting findings most closely related to deep learning. Data collection had the weakest relationship.

First-Year Students Learning Communities Service Learning Study Abroad Senior Capstone Deep Learning General Education ++ + Personal/Social Development Practical Competence ++ +p.10; +++ p.30 Effects of Participating in High Impact Practices on Deep/Integrative Learning and Gains Seniors

Study Abroad Students who studied overseas engaged more frequently in educationally purposeful activities afterwards and reported gaining more from college. Students who lived with host nationals – in home stays or in dorms – benefited more in terms of integrative and reflective learning, and personal and social gains. The length of time spent overseas did not make a difference in the frequency with which students used deep learning approaches after returning or their self- reported gains.

Study Abroad: Implication for Practice Amount of time abroad not as important as whether student has such an experience. Value in increasing short-term cross-cultural or “study away”, “May term” opportunities for students who cannot be away from their home institution for extended period of time

Culminating Senior Activities Capstone course, senior project/thesis, comp exam, etc. Field placements have impact on greatest number of gains, Also beneficial: –Projects that required the greatest investment of time, –Working in groups, –Meeting often with supervising faculty member, and –Receiving clear expectations for the activity.

What is it about these high-impact activities that appear to be so effective with students? Practices Increase Odds That Students Will: Invest time and effort Interact with faculty and peers about substantive matters Experience diversity Get more frequent feedback Discover relevance of their learning through real-world applications

What to do?? Make it possible for every student to participate in at least two high impact activities  One in First Year FY seminars FY seminars Learning communities Learning communities Service learning Service learning  One Later in Major Study abroad Study abroad Student-faculty research Student-faculty research Field placement or internship Field placement or internship Capstone project Capstone project

Assessment questions about high-impact practices 1.How often are students experiencing high-impact practices? 2.Do all students have an equal likelihood of participating? To what extent do underrepresented students participate? 3.Are these practices done well?

Participation in High-Impact Educational Experiences

NSSE and Institutional Comparisons of Undergraduate Quality 1.NSSE offers comparative information (select peers, Carnegie types, NSSE cohort) to inform discourse on quality in undergraduate education 2.Institutions use comparative information for benchmarking, demonstrating effectiveness etc. 3.HOWEVER, from a teaching and learning perspective, we need to move beyond institution-level means to consider engagement among all students -- Who are the least engaged, and what can we do?

Variation With-in Quality is not uniform within institutions. The lion’s share of the variation is among students, within institutions

Lesson: Look at student variation within your institution. How do experiences differ by major, student subgroups, who are our least engaged students? Student engagement varies more within than between institutions.

What does it mean to look at variation within? –Examine variation in student experience by major, by groups of related majors, or demographic or enrollment subgroups –Or, examine: who are the least engaged students (for ex: the bottom quarter of the distribution within an institution), and what can be done to improve their experience so as to narrow the gap between an institution’s least and most engaged students? Another implication: even high-performing institutions have work to do to improve the experience of all students. Two case studies based on real data from two NSSE 2008 institutions illustrated in NSSE AR –1. Examine Supportive Environment for 3 student groups: Honors, Educational Opportunity Program (EOP) and, “All Other Students.” –2. Examine Enriching Experiences by discipline/major Variation With-in

Promise of Student Engagement “If faculty and administrators use principles of effective practice to arrange the curriculum & other aspects of the college experience, students would… write more papers, read more books, meet with faculty and peers, and use information technology appropriately, all of which would result in greater gains in such areas as critical thinking, problem solving, effective communication, and responsible citizenship.” Kuh, Kinzie, Schuh, Whitt & Associates, Student Success in College, 2005

Institutional Conditions for Student Success For institutional programs, practices to be effective they must… –Involve a significant proportion of students –Be of high quality, employ best practices, meet needs of your students & attend to campus culture –Be knit into students experience – be unavoidable –Be assessed, monitored, reviewed, improved

“We don’t want students to go through school, but for school to go through them.” “We don’t want students to go through school, but for school to go through them.” Faculty member, Fayetteville State University Final thought on Student Success….

A Challenge in Higher Education Today “Helping our extraordinarily diverse students reap the full benefits – economic, civic and personal – of their studies in college” -- Carol Geary Schneider, President AAC&U

Meanwhile, in China… students are inhaling oxygen Chinese high school students study while inhaling pressurized oxygen in the hope of improving their mental abilities ahead of the national college entrance exam

Deep Approaches to Learning Attend to the underlying meaning of information as well as content Integrate and synthesize different ideas, sources of information Discern patterns in evidence or phenomena Apply knowledge in different situations View issues from multiple perspectives Increase in learning-centered activities that foster deeper levels of understanding and application for global work and citizenship See: John Tagg (2005) The Learning Paradigm College