Workshop 2: Assessment Jules Cassidy Dr Julie Baldry Currens

Aims and Learning Outcomes for this session Aims of this session To demonstrate the importance of learning outcomes in the planning of learning activities Learning Outcomes of this session At the end of the workshop you will be able to: 1.Define the term learning outcome and the difference between this and other terms e.g. learning objective 2.Discuss the factors which are salient in the construction of learning outcomes. 3.Critique learning outcomes from a programme of study with which you are familiar. 4.Identify a range of assessment tasks relevant to a set of learning outcomes.

Aims/Goals & Learning Outcomes Academics often find it easier to identify their aims when planning a programme or module or learning activity, than the Learning Outcomes. WHY might this be?

Definition – Learning Outcomes Learning outcomes: ‘statements of what a learner is expected to know, understand and/or be able to do at the end of a period of learning.’ (Bologna Working Group 2005: 37)

Learning Outcomes..or Learning Objectives? LOs are now used where previously we had Aims and Learning Objectives. Learning Objectives are now thought to be too teacher centred and passive – focusing on us & what we do during the learning activity, and the content we present to learners in lectures, seminars etc. Learning Outcomes, in contrast, are student centred with their focus on what it is that students can do, following a learning experience.

6 Learning Outcomes Help students to understand what they can be expected to know and be able to do at the end of the course Provide a clear framework against which to measure students’ success and the effectiveness of the learning strategies adopted

Learning Outcomes LOs are fundamental to good curriculum and learning activity design. LOs usually begin with a statement like: ‘At the end of this module/lecture/seminar students will be able to: LOs are usually expressed using active verbs.

Learning Outcomes Assessment - designed to test LOs Learning Activities - designed to match LOs

Constructive Alignment ‘Constructive Alignment (Biggs, 1999) is one of the most influential ideas in higher education. It is the underpinning concept behind the current requirements for programme specification, declarations of Intended Learning Outcomes (ILOs) and assessment criteria, and the use of criterion based assessment.’ (Houghton 2004)

Constructive Alignment ‘There are two parts to constructive alignment: Students construct meaning from what they do to learn. The teacher aligns the planned learning activities with the learning outcomes. The basic premise of the whole system is that the curriculum is designed so that the learning activities and assessment tasks are aligned with the learning outcomes that are intended in the course. This means that the system is consistent. (Houghton 2004)

How to construct LOs (HEA) Learning outcomes should: be written in the future tense identify important learning requirements be achievable and assessable use clear language easily understandable to students (Overton 2005)

How to construct LOs (HEA) ‘Learning outcomes should not use terms such as ‘understand’ or ‘appreciate’ as it is not immediately obvious to a student what they have to do in order to demonstrate that they ‘understand’ or ‘appreciate’ something. Tutors should think about how they ask their students to demonstrate their understanding. They may ask students, during an examination, to describe a process, to discuss a concept, to evaluate some data or to derive an equation. These are the tasks that the student actually does in order to demonstrate understanding, so these terms can be used to express the leaning outcomes.’ (Overton 2005)

How to construct LOs (HEA) ‘ There are no rules on how many outcomes are appropriate per lecture course or credit point and any attempt to standardise would be completely artificial. Some modules may have many outcomes that are fairly easily achieved and assessed. Other, perhaps higher level, modules may have fewer, more complex outcomes which are more demanding to acquire and demonstrate.’ (Overton 2005)

Activity 1 – small groups Review the LOs on the module specification How would you rate the LOs? What would you change / improve? Why?

Assessment “ Assessment defines what the students regard as important, how they spend their time and how they come to see themselves as students and then as graduates… if you want to change student’s learning then change the method of assessment ” Brown and Pendlebury, 1997

if we get it right, but unthinkable if we get it wrong.” Race, Brown & Smith (2005) p.xi.... The results of our assessment influence our students for the rest of their lives and careers – fine if we get it right, but unthinkable if we get it wrong.” Race, Brown & Smith (2005) p.xi “ Nothing that we do to, or for, our students is more important than our assessment of their work and the feedback we give them on it... fine if we get it right, but unthinkable if we get it wrong.” Race, Brown & Smith 2005 p.xi “ Students can escape bad teaching; they can't escape bad assessment ” Boud 1995

Summative assessment Used to indicate the extent of a learner's success in meeting the assessment criteria [and LOs] Used to gauge the intended learning outcomes of a module or programme To award a mark or grade (QAA, 2006)

Activity 2 – small groups How many summative assessment types can you name in 30 seconds?

SUMMATIVE Exams: Unseen / Seen Long /short answers MCQ Open-book Practical exams OSCE Presentations Demonstration Viva voce Coursework: Portfolios Essays Annotated bibliographies; Journal article + abstract Poster Design a ‘xxxx’ e.g.: Assessment Compendium

Heppel, 2008

Activity 3 – individuals How well does the summative assessment task match the LOs on the module specification? Activity 4 – in pairs What would be an alternative assessment task that more effectively test the LOs? Why is the new task better?

Formative assessment Activity 5 How many different methods of offering formative feedback can you identify?

Eg’s of FA Statement banks Feedback sheets Self assessment against model answers Marking previous /parts of assessments using criteria Peer discussion/ review / assessment Peer +/or Computer aided Key issues listed on VLE Q+A in- session Quizes + Test Q’s at home Short MCQs Simulations + Practice tasks Summarise what is known so far 1-2 mins summary of key points Prepare bullet point answer to mock Q Students prepare/present info on material not covered in class

Formative assessment Activity 6 Using the new summative assessment task, identify 2 formative tasks that would help promote learning and prepare for summative assessment.

Bibliography Biggs, J. (1999) Teaching for Quality Learning at University, Buckingham: OUP. Bloom’s Taxonomy, Louisiana State University [online] Available from: [12 February 2010] Bologna Working Group (2005) A Framework for Qualifications of the European Higher Education Area, Copenhagen: Ministry of Science, Technology & Education [online] Available from: bergen2005.no/Docs/00-Main_doc/050218_QF_EHEA.pdf [10 February 2010]. bergen2005.no/Docs/00-Main_doc/050218_QF_EHEA.pdf Boud, D. (1995) Enhancing learning through self assessment London: Kogan PageComeaux, J. (2005)

Bibliography Comeaux, J. (2005) Bloom’s Taxonomy, Louisiana State University [online] Available from: [12 February 2010] Houghton, W. (2004) Engineering Subject Centre Guide: Learning and Teaching Theory for Engineering Academics. Loughborough: HEA Engineering Subject Centre [online] Available from: [13 February 2010] [13 Overton, T. (2005) Writing Learning Outcomes, Higher Education Academy [online] Available from: 091_writing_learning_outcomes_mar_2005.pdf [11 February 2010] 091_writing_learning_outcomes_mar_2005.pdf

Bibliography QAA. (2001) The framework for higher education qualifications in England, Wales and Northern Ireland, QAA [online] Available from: #annex1 [15 February 2101] #annex1 QAA. (2006) Code of Practice for the assurance of academic quality and standards in higher education; Section 6: Assessment of students QAA [online] Available from: 6/default.asp [2 June 2011] 6/default.asp [2 Race, P., Brown, S. & Smith, B. (2005) (2nd ed) 500 tips on assessment London: Routledge Falmer Race, P. (2009) Assessment Compendium [online] Available from: October 2010]

Thank you – any questions / comments ?