USING GRADUATE ATTRIBUTES TO DESIGN 21ST CENTURY UNIVERSITY CURRICULA Hong Kong Institute of Education 9 February 2010 A/Prof Simon Barrie Institute for Teaching and Learning 1

Graduate attributes Graduate attributes are an orientating statement of education outcomes used to inform curriculum design and engagement with teaching and learning experiences at a university (Barrie 2009). They are descriptions of the core abilities and values a university community agrees all its graduates should develop as a result of successfully completing their university studies (adapted from Bowden et al 2000). What do we notice about his definition: Learning is more than storing the accumulating the content that has sometimes defined discipline curricula in the past. A guiding framework for designing and engaging with learning experiences rather than a tightly prescribed set of definitive outcomes that need to be promulgated in university marketing or audits. A shared understanding of these attributes in relation to all graduates - shared understandings have to be negotiated not simply decreed. 2

However…. Meaningful curriculum renewal has proved elusive and in Australia there remains a 'national gap' between the rhetoric of generic attributes and the reality of the student learning experience. 3

Last time I was here we discussed three reasons Why…….. As outcomes they are more complex than they seem 2. Universities’ activity systems aren’t supportive 3. Learners have been left behind This time I want to discuss…… How we might do this differently

1. Setting the right direction Ensure the university community understands the complexity and makes a relevant commitment Foundation: Generic skills – ‘off-the shelf’, non-specialised skills for university learning and work Translation: Explicit ways of doing and thinking, using and applying discipline knowledge… they are the discipline Enabling: Implicit dispositions attitudes & values, they grow from, but transcend the discipline Implicit dispositions attitudes & values, they grow from, but transcend the discipline Explicit ways of doing and thinking, using and applying discipline knowledge… they are the discipline Generic skills – ‘off-the shelf’, non-specialised foundation skills for university learning and work We need to think about GA as integrated – though heterogeneous outcomes

What do you want for your graduates? Write one attribute for each level One Enabling outcome: One Translation outcome: One Foundation skill (input): Implicit dispositions attitudes & values, they grow from, but transcend the discipline Explicit ways of doing and thinking, using and applying discipline knowledge… they are the discipline Generic skills – ‘off-the shelf’, non-specialised foundation skills for university learning and work We need to think about GA as integrated – though heterogeneous outcomes

Why keep these levels of outcome distinct in your mind and in your policy? One sort of GA is an input not an output and if we look for ‘value-add’ from university in that group, both staff and students will be disappointed. Some sorts of GA can be explicitly taught and assessed at university but one type probably can’t. One type of GA is different in every discipline – the others might be more generic – but that still doesn’t meant they are the same. One sort you develop with stand alone skills courses taught by skills experts and there is no real change to the rest of the curriculum Implicit dispositions attitudes & values, they grow from, but transcend the discipline Explicit ways of doing and thinking, using and applying discipline knowledge… they are the discipline Generic skills – ‘off-the shelf’, non-specialised foundation skills for university learning and work We need to think about GA as integrated – though heterogeneous outcomes

Some other reasons….. One sort would be developed if all university teachers adopted ‘good teaching practices’ in their courses Some types are not very appealing to some in the academic community Some types are very appealing to bureaucrats and administrators – and some scare them Implicit dispositions attitudes & values, they grow from, but transcend the discipline Explicit ways of doing and thinking, using and applying discipline knowledge… they are the discipline Generic skills – ‘off-the shelf’, non-specialised foundation skills for university learning and work We need to think about GA as integrated – though heterogeneous outcomes

What commitment is required to achieve useful outcomes? They are not a shopping list to be ticked off and they are not somebody else’s responsibility, it is a team effort. Foundation generic skills: Ensure coverage and recognise limits Translation graduate attributes: we may need to change the way we think about teaching the discipline. Enabling graduate attributes: we need to find ways to better engage students in the broader integrative learning experiences of university – and we may need to provide better integrative learning experiences

2. Moving from commitment to action All three are required: Foundation skills, Translation attributes, Enabling Attributes. How can we act on these commitments in relation to each type of graduate attribute.

Foundation Skills: Effective coverage, efficient learning recognise limits What do we agree all first year students need to know in order to learn effectively at university ……that they don’t get taught at school? How might we do this? How can we ensure students learn this efficiently? Skills modules taught by experts, self-study modules, embedded FY assignments, work with 2# schools? Limits? Not enough on its own – inputs to GA not outputs - connect to subsequent learning and GA development Global Citizens is a common graduate outcome – one claimed by Sydney Uni. HKPU and many other HK institutions What does this mean in relation to the notion that such outcomes might be multilayered? Implicit dispositions attitudes & values, they grow (slowly) from, but transcend the discipline

Translation graduate attributes: We may need to change the way we think about teaching the discipline. A lot is in place Move from content-based to outcomes-based curriculum ‘Discipline’ is not defined by content alone but content + (disciplinary)graduate attribute Content in action Professional accreditation does this Global Citizens is a common graduate outcome – one claimed by Sydney Uni. HKPU and many other HK institutions What does this mean in relation to the notion that such outcomes might be multilayered? Implicit dispositions attitudes & values, they grow (slowly) from, but transcend the discipline

Translation graduate attributes: teaching the discipline continued…… Different outcomes suggest different teaching, learning & assessment processes Active learning & active teaching Inquiry-learning, undergraduate research, work-integrated learning, case based learning, writing intensive courses, collaborative assignments etc. Different teaching and learning means different (aligned) assessment Global Citizens is a common graduate outcome – one claimed by Sydney Uni. HKPU and many other HK institutions What does this mean in relation to the notion that such outcomes might be multilayered? Implicit dispositions attitudes & values, they grow (slowly) from, but transcend the discipline

Enabling graduate attributes: Better integrative learning experiences and better student engagement Integrative learning – “Fostering students' abilities to intentionally integrate learning - over time, across courses, and between academic, personal, and community life” (Huber & Hutchings) The term Integrative Learning was coined by Jerry Perez de Tagle and "... comes in many varieties: connecting skills and knowledge from multiple sources and experiences; applying skills and practices in various settings; utilizing diverse and even contradictory points of view; and, understanding issues and positions contextually." "...making connections within a major, between fields, between curriculum, cocurriculum, or between academic knowledge and practice." Fostering students' abilities to integrate learning--over time, across courses, and between academic, personal, and community life--is one of the most important goals and challenges of higher education. The undergraduate experience is often a fragmented landscape of general education, concentration, electives, co-curricular activities, and for many students "the real world" beyond campus. An emphasis on integrative learning can help undergraduates find ways to put the pieces together and develop habits of mind that will prepare them to make informed judgments in the conduct of personal, professional, and civic life.

Enabling graduate attributes: integrative learning continued…… Integrative learning experiences (adapted from Kuh) First-Year Seminars Study Groups Common Intellectual Experiences Learning Communities Research Experiencing Diversity Service & Community-Based Learning Internships Capstone Courses and Projects +Discipline learning that is like this The term Integrative Learning was coined by Jerry Perez de Tagle and "... comes in many varieties: connecting skills and knowledge from multiple sources and experiences; applying skills and practices in various settings; utilizing diverse and even contradictory points of view; and, understanding issues and positions contextually." "...making connections within a major, between fields, between curriculum, cocurriculum, or between academic knowledge and practice." Fostering students' abilities to integrate learning--over time, across courses, and between academic, personal, and community life--is one of the most important goals and challenges of higher education. The undergraduate experience is often a fragmented landscape of general education, concentration, electives, co-curricular activities, and for many students "the real world" beyond campus. An emphasis on integrative learning can help undergraduates find ways to put the pieces together and develop habits of mind that will prepare them to make informed judgments in the conduct of personal, professional, and civic life.

Enabling graduate attributes: integrative learning continued…… Engaging students in integrative learning Make time & space Value and recognise engagement Encourage rewarding require assess give credit integrate participate The undergraduate experience is often a fragmented landscape of general education, concentration, electives, co-curricular activities, and for many students "the real world" beyond campus. An emphasis on integrative learning can help undergraduates find ways to put the pieces together and develop habits of mind that will prepare them to make informed judgments in the conduct of personal, professional, and civic life. Encourage – talk about this with students rewarding - make it enjoyable, interesting for them require – make it part of the course requirements Assess – mark their learning/ participation give credit – acknowledge their learning Integrate – connect back to this from our discipline teaching participate – join in ourselves – this is the most powerful.

Enabling graduate attributes: integrative learning continued…… Assessing integrative student learning We don’t have to assess everything We don’t always have to be the assessors Portfolios Self assessment Subsequent application embedded in discipline assessment or capstone assessment Assess in the next subjects assignment by including a criteria – extent response demonstrates an appreciation of cross disciplinary perspectives / sustainability / life long learning / ethics etc. i.e teach in one place and assess in another.

Putting it all together: Tertiary Integrated Graduate Attributes (TIGA Putting it all together: Tertiary Integrated Graduate Attributes (TIGA?) curriculum

4: How do we engage the university community Collective and collaborative task initially - not an individual one Group is the broader university community not just the ‘GA’ converts

Collaborative group task…… How do we encourage students to work in groups? What makes for effective student group work? How do we manage student group work?

University staff working together (!) Allow sufficient time Coordination and leadership Acknowledge different roles and contributions Effective internal team processes Effective internal communication Accountability for outputs Reward for effective processes

Encouraging staff engagement Lessons from students (Encourage, rewarding, require, assess, give credit, integrate, participate) Make time and make it manageable Make it intellectually rewarding and fun (intrinsic) Build on what is done and reward productive engagement (extrinsic) Participate – lead by example Reward and champion leaders & teams Extrinsic – Promotion criteria Intrinsic – Satisfying and pleasurable Adequately supported – formal and informal learning – especially informal.

Recognise engagement – Evaluation Teacher measures Course (discipline and integrative) audits of developments, teaching and assessment activities Mapping is of limited benefit for engagement on its own Audit could become inquiry What is done with the data after matters most Evidence of effective curriculum development for GA as a KPI? (teacher measures cross tab with student outcome measures) Evidence of effective curriculum devt for GA as a KPI (time spent on curriculum development cross tab with quality of student learning outcomes and process data Teacher measures Reward and champion leaders & teams Extrinsic – Promotion Intrinsic – Satisfying and pleasurable Adequately supported – formal and informal learning – especially informal.

Recognise engagement – Evaluation Indirect measures of outcomes - surveys and audits Average # times per semester academics meet with students outside class Frequency and quality of intellectual engagement with staff outside of class # and % of students reporting helpful teacher feedback on GA development # and % of students reporting participation in (integrative learning experiences) # and % of courses emphasizing multicultural learning experiences # and % of students involved in faculty research # and % of degrees requiring practicum, internship, service Frequency and quality of intellectual engagement with other students not studying your course Self ratings on development of GA Did the course / teaching / assessment help you develop these GA? Employer/Graduate/Peer perception surveys Indirect measures process and outcomes: Surveys & audits Average # times per semester academics meet with students outside class Frequency and Quality of intellectual engagement with staff outside of class # and % of students reporting helpful teacher feedback on GA development per week # and % of students reporting participation in study groups (integrative learning experinces) per semester # and % of courses emphasizing multicultural learning experiences # and % of students involved in faculty research # and % of degrees requiring practicum, internship, service Frequency and Quality of intellectual engagement with other students not studying your course Self ratings on development of GA Did the course help you develop these GA? Did the teaching help you develop these GA Did the Assessment allow you to demo learning Direct measures of student learning Assignments exams projects NOT standardised generic skills tests – Why not? Teacher measures Evidence of effective curriculum devt for GA as a KPI (time spent on curriculum development cross tab with quality of student learning outcomes and process data Reward and champion leaders & teams Extrinsic – Promotion Intrinsic – Satisfying and pleasurable Adequately supported – formal and informal learning – especially informal.

Recognise engagement – Evaluation Direct measures of student outcomes - assessments and audits Course (discipline and integrative capstone) assignments, exams, projects Perhaps not standardised generic skills tests – Why not? Un-intended (unwanted and not insignificant) consequences…. Direct measures of student learning Test the wrong things The value-add may not be much to do with university Ceiling effect Teacher measures Evidence of effective curriculum devt for GA as a KPI (time spent on curriculum development cross tab with quality of student learning outcomes and process data Reward and champion leaders & teams Extrinsic – Promotion Intrinsic – Satisfying and pleasurable Adequately supported – formal and informal learning – especially informal.

Graduate Attributes led curriculum development OBE policy and curriculum design should start with the recognition that these graduate outcomes are multilayered. Multilayered outcomes require a multilayered curricula. (TIGA) The broader university community needs to choose to be meaningfully engaged. 31

Simon.Barrie@sydney.edu.au http://www.itl.usyd.edu.au Thank you!

What does this variation look like? Global Citizens Implicit disposition/stance: Graduates will aspire to contribute to society in a full and meaningful way through their roles as members of local, national and global communities they will respect multiple perspectives and recongise the potential limitations of their own world view Explicit disciplinary way of doing/thinking: Apply ecologically responsible engineering techniques to promote sustainability Foundation skill – Will be aware of cross cultural communication strategies Global Citizens is a common graduate outcome – one claimed by Sydney Uni. HKPU and many other HK institutions What does this mean in relation to the notion that such outcomes might be multilayered? Implicit dispositions attitudes & values, they grow (slowly) from, but transcend the discipline

A Hong Kong example to reflect on To enable students to develop their capabilities in: Pursuit of academic / professional excellence, critical intellectual enquiry and life-long learning Tackling novel situations and ill-defined problems Critical self-reflection, greater understanding of others, and upholding personal and professional ethics Intercultural understanding and global citizenship   Communication and collaboration  Leadership and advocacy for the improvement of the human condition  Different universities statements typically are a combination of two – sometimes three different types of outcomes.....

In some more detail… Aim 4: Intercultural understanding and global citizenship   Heighten awareness of own culture and other cultures Develop cultural sensitivity and interpersonal skills for engagement with people of diverse cultures Perform social responsibilities as a member of the global community Aim 6: Leadership and advocacy for the improvement of the human condition  Play a leading role in improving the well-being of fellow citizens and humankind Uphold the core values of a democratic society: human rights, justice, equality and freedom of speech Participate actively in promoting the local and global social, economic and environmental sustainability Can you see different levels of outcomes emerging here?

And one more….. Have up-to-date and in-depth knowledge of an academic specialty, as well as a broad range of general knowledge; Have bilingual communicative competence in English and Chinese (including Putonghua); Be able to think logically, critically and creatively; Have the necessary numerical skills to function effectively in work and everyday life; Be an independent and self-directed learner, motivated by an inquiring spirit; Be well-developed as a ‘whole person’ – intellectually, morally, spiritually, culturally, socially and physically; Be a responsible citizen with an international outlook, and willing to serve and lead. Can you see different levels of outcomes amongst those in this list?

Scholarship: An attitude or stance towards knowledge Graduates of the University will have a scholarly attitude to knowledge and understanding. As Scholars, the University’s graduates will be leaders in the production, application and communication of new knowledge and understanding through inquiry, critique and synthesis. A disposition The University of Sydney policy specifies two levels of graduate attributes. There are three overarching graduate attributes – Scholarship, Lifelong Learning, and Global Citizenship – which reflect the research intensive nature of the University, its scholarly values in relation to research-led teaching, and the place of its graduates in a global society. These attributes are developed through students’ participation as active members of the university community, through extra curricular activities as well as their formal studies.

Research and Inquiry: Graduates of the University will be able to create new knowledge & understanding through the process of research & inquiry be able to identify, define and analyse problems and identify or create processes to solve them be able to exercise critical judgement and critical thinking in creating new understanding be creative and imaginative thinkers have an informed respect for the principles, methods, standards, values and boundaries of their discipline and the capacity to question these be able to critically evaluate existing understandings and recognise the limitations of their own knowledge A cluster of attributes These overarching attributes are built on our graduates’ development of the next level of graduate attributes. The development of these attributes is explicitly focussed on in teaching and assessment in students’ formal courses of study at the University. This second level of attributes is described as five clusters of more specific attributes; 1. Research & inquiry, 2. Communication, 3. Information Literacy, 4. Ethical social & professional understandings, and 5. Personal & intellectual autonomy.

Research and Inquiry at the Conservatorium of Music: be able to identify, define and analyse problems in written work, composition, teaching and performance and identify or create processes to solve them be able to exercise critical judgement and critical thinking in creating new understandings in relation to music analysis, music composition, music education, music history, music technology, and music performance be creative, imaginative and independent thinkers in their musical endeavours have an informed respect for the principles, standards, values and boundaries of current music knowledge, pedagogy and performance practice. be able to question critically and to evaluate current music knowledge and compositional, pedagogical and performance practices, acknowledging global and historical diversity and recognising the limitations of their own knowledge The details of these attributes are interpreted and contextualised differently in different disciplinary domains. The individual faculty statements of graduate attributes are available here. These were ratified by faculties after consultation with staff, students, alumni, government groups, employers, accrediting bodies and professional associations. The development of the University’s graduate attributes is in turn supported by the development of generic foundation skills and abilities.

Sydney Model of Graduate Attributes SO we articulate two tiers of outcomes... And we require two very different development strategies which need to align with these. – Constructive alignment

And one final local example… Can you see similarities to the Sydney clusters of personal attributes? Can you also see some outcomes – or elements of outcomes that look more like dispositional stances than others?

Varied development strategies Multilayered teaching & learning strategies Foundation skills - co curriculum (multi)Discipline learning - curriculum A learning community - extra curriculum Why is this an issue?........ Constructive alignment works at the level of institutional strategy too....... Its not surprising that different sorts of outcomes are best developed by different sorts of learning experiences – think of the principles of constructive alignment – and the research bears this out. This is how we are thinking about it at Sydney

What might that look like at a Hong Kong University? Curriculum Renewal: PolyU elements General University requirements, bridging courses Strong professional curriculum, multidisciplinary studies, student centred pedagogies Electives, freshman seminar, extra(co)-curricula activities……and what else? Curriculum Challenges: Align and integrate elements as a holistic curriculum ….Charting a learning pathway….creating a university community As part of the 4 year curriculum models at most HK universities there is a general education component There is a recognition that the teaching and learning experiences within discipline course need to shift to become aligned with the statements of Graduate Outcomes There is a recognition that the ‘between curriculum experiences are important.... But is there true engagement by students in the academic and intellectual community of the university?

Meaningful engagement by staff in curriculum renewal How might we engage the university community in thinking and talking about these complex outcomes and complex development processes…. in a more complex way. Why is meaningful engagement in curriculum renewal so hard to achieve?

A way of thinking about generic attributes curriculum renewal in (institutional) context Conceptualisation Stakeholders Implementation Curriculum Assessment Staff Development Quality Assurance Student Centred http://www.itl.usyd.edu.au/projects/nationalgap/introduction.htm

Curriculum Curriculum structure & organisation can be limiting Rather than a linear sequence of isolated content blocks need a whole degree approach – the Hong Kong 4 year structure delivers this 1. ‘Curriculum’ as the lived experience of students learning across/around the whole degree 1. Include new ‘elements’ (co/extra curriculum) PD theme, skills courses, WIL, internships, Freshman seminars) 2. Change and diversify the existing learning experiences (inquiry learning, CBL, GA focused teaching and assessment)

Change and diversify the existing learning experiences High impact educational practices (Kuh, 2008) First-Year Seminars and Experiences Common Intellectual Experiences Learning Communities Writing-Intensive Courses Collaborative Assignments and Projects Undergraduate Research Experiencing Diversity/Global Learning Service Learning, Community-Based Learning Internships Capstone Courses and Projects

Defining curriculum qualities With your neighbor…..what are 3 things that might characterise a student’s learning experience at university if we wanted to foster the development of generic attributes like: global outlook, professional competence, leadership … or Defining the qualities of your students learning experiences

A Sydney example….. To foster the generic attribute of scholarship …… the Sydney curriculum (student learning experience) should be characterized by active, inquiry based learning – learning in a research like way With your neighbor…..what are 3 things that might characterise a student’s learning experience at university if we wanted to foster the development of generic attributes like: global outlook, professional competence, leadership Please be ready to share some of your ideas with the group in 5 minutes……. s

What are the defining features of some local university curricula? Broad based curriculum Strong fundamentals in professional education Multidisciplinary Flexible admissions Flexible curriculum design Articulation with NSS curriculum Freshman Year experience Integrated learning Enhanced communication skills Active learning Global learning experience Work Integrated Education Capstone Experience OBE As one example you might think about how HKPU has articulated this. If people are interested in exploring how those features might be enacted in teaching and of course in assessment, the two workshops will be an opportunity for that

What are the defining features of some local university curricula? The following distinctive features will characterise the new curriculum: (inter)disciplinary inquiry multidisciplinary collaboration poly-contextual inquiry diverse learning experiences multiple forms of learning and assessment engagement with local and global communities development of civic and moral values. Another institution – notice that some of these include outcomes rather than process..... These statements are the other face of statements of outcomes ....... they are statements of the experiences that should shape the curriculum

Engaging staff A curriculum model is not enough when… Quality Assurance does not support or inform engaged curriculum enhancement Staff development does not support or encourage staff to engage intellectually in curriculum renewal Other stakeholders are marginalised Implementation is not planned, resourced and stratified (complex outcomes multi-layered strategy) Underlying conceptualisations remain unaddressed in policy or practice Note is a whole system that needs to be aligned with GA curriculum renewal

Quality Assurance Quality Assurance strategies which do not support engaged curriculum enhancement include: QA measures are teacher focused Curriculum mapping is used on its own Rewards are based on indicators that are unrelated to intellectual engagement in curriculum renewal Measures privilege a focus on only some GA Challenge: Evidence of actual student learning is often missing (assessment) Lets look at one of these...... QA QA includes the way we measure GA curricula – and how those measures are used for rewards and to plan improvements. QA measures are teacher focused Curriculum mapping is used on its own Rewards are based on indicators that are unrelated to intellectual engagement in curriculum renewal Measures privilege a focus on only some GA

A local insight on QA – evidence of student learning……. The range of learning activities that comprise the student experience: students’ learning does not take place only through their academic program. In the areas of personal development, citizenship, cross-cultural sensitivity and so on, campus life and the co-curriculum are significant contributors to students’ development. The range of sites where learning occurs: while students’ departments are the obvious location for an effort to evaluated overall achievement of “graduateness”, Schools, other departments, the Language Center, the Library, SAO, residential halls, and others all contribute to activities relevant to the achievement of desired outcomes. The range of the potential sources of evidence for the achievement of outcomes, including: assessments embedded in courses; sample data of students’ achievement of generic outcomes in standardized tests; and students’ self-report of the achievement of outcomes through questionnaires, focus groups. (HKUST) Trudy Banta’s talk will explore this issue in more depth and the workshop on Assessment of Graduate Attributes will be another chance to explore some of these ideas......

Achieving student engagement for graduate attributes Involve students as partners in the conversations about the learning potential of university early on. Provide engaging teaching learning and assessment experiences that make these conversations real and help students come to understand what university learning can be. Encourage students to create learning opportunities for themselves What we found from the research with students.