Student Engagement Data in the UK: Policy and Practice

Slides:



Advertisements
Similar presentations
Enhancing Student Engagement – what are we talking about? Graham Gibbs Research Centre for Student Engaged Educational Development.
Advertisements

2003 Community College Survey of Student Engagement (CCSSE) SVC Office of Institutional Research Dr. Maureen Pettitt, Director Leslie Croot, M.S., Analyst.
Gallaudet University Results on National Survey of Student Engagement Office of Institutional Research August, 2007.
Mind the Gap: Overview of FSSE and BCSSE Jillian Kinzie NSSE.
Achievement of Educational Outcomes: Seniors’ Self- evaluations from 2004 & 2007 National Surveys of Student Engagement (NSSE) Cathy Sanders Director of.
BENCHMARKING EFFECTIVE EDUCATIONAL PRACTICE IN COMMUNITY COLLEGES What We’re Learning. What Lies Ahead.
Assessment of Student Learning Faculty In-service June 5, 2006.
Derek Herrmann & Ryan Smith University Assessment Services.
Community College Survey of Student Engagement CCSSE 2014.
Perspectives of student engagement Learning and Teaching Conference Faculty of Science and Engineering 30th March 2015 Mark Langan (School of Science.
Individual versus representational: Community, engagement and belonging Student Unions and the Changing Nature of Student Leadership in the UK SRHE 2 June.
Mountain View College Spring 2008 CCSSE Results Community College Survey of Student Engagement 2008 Findings.
 Assessing Student Engagement.  1. Amount of time/effort students put into their studies and other educationally purposeful activities  2. How institutional.
2009 National Survey of Student Engagement (NSSE) Report Institutional Research & Information November 18, 2009.
Before & After: What Undergraduates and Alumni Say About Their College Experience and Outcomes Angie L. Miller, NSSE & SNAAP Research Analyst Amber D.
National Survey of Student Engagement, 2008 Results for UBC-Vancouver.
Gallaudet Institutional Research Report: National Survey of Student Engagement Pat Hulsebosch: Executive Director – Office of Academic Quality Faculty.
2009 National Survey of Student Engagement (NSSE) Report Institutional Research & Information November 18, 2009.
ESU’s NSSE 2013 Overview Joann Stryker Office of Institutional Research and Assessment University Senate, March 2014.
The Academy Experience: A Plan for Integrated Education.
Introductions O A warm welcome to all Comenius partners from the British team: O Andy Marshall.
NSSE 2005 CSUMB Report California State University at Monterey Bay Office of Institutional Effectiveness Office of Assessment and Research.
The “I” in Integrated Social Sciences: Innovative, Interdisciplinary, Integrative Welcome to ISS, the University of Washington’s newest online degree completion.
Looking Inside The “Oakland Experience” Another way to look at NSSE Data April 20, 2009.
Student Engagement as Policy Direction: Community College Survey of Student Engagement (CCSSE) Skagit Valley College Board of Trustees Policy GP-4 – Education.
Student Engagement and Academic Performance: Identifying Effective Practices to Improve Student Success Shuqi Wu Leeward Community College Hawaii Strategy.
HEInnovate A self-assessment tool for higher education institutions (HEIs) wishing to explore their entrepreneurial and innovative potential.
NSSE 2013 Results Report to Faculty Senate February 19, 2014.
A survey of Student Engagement SARAH GRETTON DEREK RAINE CENTRE FOR INTERDISCIPLINARY SCIENCE UNIVERSITY OF LEICESTER 1. Background – AUSSE, HEA 2. Our.
Dr. Leslie David Burns, Associate Professor Department of Curriculum and Instruction UK College of Education
The University of Texas-Pan American National Survey of Student Engagement 2005 Results & Recommendations Presented by: November, 2005 S. J. Sethi, Ph.D.
The University of Texas-Pan American Susan Griffith, Ph.D. Executive Director National Survey of Student Engagement 2003 Results & Recommendations Presented.
Defining 21st Century Skills: A Frameworks for Norfolk Public Schools NORFOLK BOARD OF EDUCATION Fall 2009.
Learning Communities at Ventura College. What are learning communities? Interdisciplinary learning Importance of sense of community for learning Student.
Policy Futures: Measuring Students’ Learning Gain and Engagement Deans of Arts, Social Science and Humanities Dr Camille B. Kandiko King’s.
Academic Support: the student perspective Kate Little Senior Project Officer National Union of Students.
Working with students as partners on the Personal Skills Award Ellen Shobrook, Project Development Officer.
Learning Gain in Active Citizenship Funded by the Higher Education Academy (HEA) Dr. Mary Deane, Senior Lecturer in Education Oxford Brookes University.
Quality Enhancement Report Learning Initiative
HEInnovate A self-assessment tool for higher education institutions (HEIs) wishing to explore their entrepreneurial and innovative potential.
Dr Alex Buckley 16 February 2017, University of Stirling
The University of Texas-Pan American
Learning Without Borders: From Programs to Curricula
Student Surveys - Best Practice
Kate Cossa, Matthew Drilling, Abby Hahn, Katy Leichsenring
NSSE Data Conversations
Irish Survey of Student Engagement (ISSE) Results 2016
Jackson College CCSSE & CCFSSE Findings Community College Survey of Student Engagement Community College Faculty Survey of Student Engagement Administered:
A nationwide US student survey
NSSE Results for Faculty
UTRGV 2016 National Survey of Student Engagement (NSSE)
The UKPSF and the HEA Fellowship scheme
What’s Your Evidence? Using Data to Support Student Success
Director, Institutional Research
Derek Herrmann & Ryan Smith University Assessment Services
Preparing for Higher Education Review (HER)
21st Century Learning Environments Phase 1 Professional Development
How well are we fostering ‘Global Graduate’ skills
Dr Camille B. Kandiko Howson Academic Head of Student Engagement
UTRGV 2018 National Survey of Student Engagement (NSSE)
Common Core State Standards Initiative
Dr Camille B. Kandiko Howson Academic Head of Student Engagement
Parent-Teacher Partnerships for Student Success
The Heart of Student Success
UTRGV 2017 National Survey of Student Engagement (NSSE)
Using Learning Gain Data as Evidence for Enhancement
Faculty In-Service Week
Title V Initiatives to Promote Student Success: Capstone Seminar and Student Research With Faculty May 31, 2016.
Common Core State Standards Initiative
2013 NSSE Results.
Presentation transcript:

Student Engagement Data in the UK: Policy and Practice Dr Alex Buckley University of Strathclyde

Plan for talk What is student engagement? Development of the UK Engagement Survey How is UKES data used? Engagement and learning gain

What is student engagement? “The term [‘student engagement’] covers two domains relating to: improving the motivation of students to engage in learning and to learn independently the participation of students in quality enhancement and quality assurance processes, resulting in the improvement of their educational experience” (QAA 2012) “This Chapter is related to the participation of students in quality enhancement and quality assurance processes”

What is student engagement? Student engagement in US, Canada, Australasia, is about… “the time and energy students devote to…activities that matter to learning and student success.” (McCormick et al 2013) National Survey of Student Engagement (NSSE) themes: Academic challenge Learning with peers Experiences with faculty Campus environment

Development of the UK Engagement Survey Run by HEA Voluntary participation, free to HEA subscribing institutions Results are confidential to institutions Administered online Around 50 questions Two question types: activity frequency and course emphasis

Development of the UK Engagement Survey Compulsory questions Critical thinking Collaborative learning Staff-student interaction Reflective and integrative learning Course challenge Optional questions Engagement with research Staff-student partnerships Skills development Time spent on activities www.heacademy.ac.uk/download/ukes-2016-questionnaire

Development of the UK Engagement Survey Participating institutions Student responses 2013 9 8,500 2014 32 25,500 2015 24 24,500 2016 31 ???

How is UKES data used? 10 case studies from 2013: Canterbury Christ Church University Oxford Brookes University University of Bath Cardiff Metropolitan University University of Oxford King’s College London University of Warwick Kingston University York St John University Manchester Metropolitan University https://www.heacademy.ac.uk/sites/default/files/resources/engagement_for_enhancement_case_studies.pdf

How is UKES data used? Challenges: Institutional investment Tension over responsibility Actionable data Response rates, benchmarking

How is UKES data used? Challenges: Institutional investment “It is far easier to sign up for a survey offered by an outside entity…than to orchestrate a series of complex conversations with different groups on campus about what the findings from these data mean and what actions might follow.” (Blaich and Wise 2011) Challenges: Institutional investment Tension over responsibility Actionable data Response rates, benchmarking

How is UKES data used? Challenges: Institutional investment Tension over responsibility Actionable data Response rates, benchmarking “College is basically a voluntary activity… This is why the quality of effort, which one might also think of as quality of initiative, is so important at the college level… [C]ollege can’t give you an education; but if you go to college, and fully use the facilities and opportunities it provides, you can get an education” (Pace 1982)

How is UKES data used? Challenges: Institutional investment Tension over responsibility Actionable data Response rates, benchmarking “The focus on behaviour is both concrete and actionable: when results fall short of what is desired, the behavioural measures suggest avenues of intervention.” (McCormick et al 2013)

Engagement data and learning gain “There is a rapidly growing evidence base in the US about the impact on educational gains of changes in evidence-based educational processes… There is no such evidence base in the UK.” (Gibbs 2010)

Engagement data and learning gain Examples of staff good practice Provide timely feedback Check to see if students learned the material before moving on to new material Develop organized classes and presentations Provide clear explanations of course goals and requirements Ensure that students work hard to prepare for their classes and are required to read and write a substantial amount of material Challenge students to analyze and synthesize information and make judgments about ideas, experiences, and theories Ask students to integrate ideas and information from different sources and to include diverse perspectives in their work Ask students to examine the strengths and weakness of their ideas and to understand someone else’s view by imagining how an issue looks from his or her perspective (Blaich and Wise 2011)

Engagement data and learning gain How much has your overall student experience contributed to your knowledge, skills and personal development in the following areas? Writing clearly and effectively Speaking clearly and effectively Thinking critically and analytically Analysing numerical and statistical information Acquiring employability skills (eg skills to help you get a job such as CV writing or career planning) Becoming an independent learner Being innovative and creative Working effectively with others Developing or clarifying personal values or ethics Understanding people of other backgrounds (economic, racial/ethnic, political, religious, nationality, etc.) Exploring complex real-world problems Being an informed and active citizen

Engagement data and learning gain How much has your overall student experience contributed to your knowledge, skills and personal development in the following areas?

Engagement data and learning gain Core skills scale: Writing clearly and effectively Speaking clearly and effectively Thinking critically and analytically Analysing numerical and statistical information Acquiring employability skills (eg skills to help you get a job such as CV writing or career planning) Becoming an independent learner Soft skills scale Being innovative and creative Working effectively with others Developing or clarifying personal values or ethics Understanding people of other backgrounds (economic, racial/ethnic, political, religious, nationality, etc.) Exploring complex real-world problems Being an informed and active citizen

Engagement data and learning gain Biological sciences 2200, engineering and technology 1000, business and admin 1800, creative arts 1400

Engagement data and learning gain

References Blaich, C. and Wise, K. (2011). “From gathering to using assessment results: Lessons from the Wabash National Study”. National Institute for Learning Outcomes Assessment Occasional Paper 8 Gibbs, G. (2010) Dimensions of Quality. York, Higher Education Academy. McCormick, A., Kinzie, J. and Gonyea, R. (2013) “Student engagement: Bridging research and practice to improve the quality of undergraduate education” in M.B. Paulsen (ed.), Higher Education: Handbook of Theory and Research, 28. (Dordrecht, The Netherlands, Springer) Pace, R. (1982) Achievement and the quality of student effort (Department of Education, Washington DC) QAA. (2012). UK Quality Code for Higher Education, Chapter B5: Student engagement. Gloucester, Quality Assurance Agency.