1. PRO-EAST Workshop1 Achievement of Learning Outcomes: Assessment Methods and Procedures Ian Freeston Engineering Council UK IET Academic Accreditation Committee

2. PRO-EAST Workshop2 Summary What are Learning Outcomes? Procedures for evaluating. Methods of assessing.

3. PRO-EAST Workshop3 Purpose of Accreditation To maintain quality of engineering education To evaluate programmes against agreed standards Assess evidence and apply judgement Professional approach; fair and rigorous Threshold standard

4. PRO-EAST Workshop4 Learning Outcomes Statements of what achieved in programme Three sources of evidence of achievement Content of the programme Level of attainment Teaching and learning environment

5. PRO-EAST Workshop5 Procedures Self-assessment report to Agency Agency arranges visit of panel of assessors Report of assessors Decision by Agency

6. PRO-EAST Workshop6 Self-Assessment Report Explains how Learning Outcomes are achieved. Based on guidance from Agency to clarify the information required. Can refer to other publications Panel uses to identify key issues to be investigated during visit

7. PRO-EAST Workshop7 Visit Panel sets the agenda and timetable Make sure that University is informed of agenda and timetable Ensure that Panel obtains all information required Feedback at end of visit (?)

8. PRO-EAST Workshop8 Report Report summarises evidence from Self Assessment Report and Visit Purpose is to enable Agency to make a decision. University sees draft to correct errors of fact (including recommendations (?)) University required to produce Action Plan (?) Report with recommendations and Action Plan to Agency for decision

9. PRO-EAST Workshop9 Decisions Rules for Decision Making Committee (membership, voting, declaration of interests) Rules for deciding length of accreditation period Formal communication of decision to University

10. PRO-EAST Workshop10 Methods How do we decide if Learning Outcomes are achieved? Not an exact science; requires judgement of evidence by experts. Three sources of evidence: programme content, level (standard), learning environment. ‘Show me’ not ‘Tell me’.

11. PRO-EAST Workshop11 Content of Programme Does the programme contain the topics you think should be included? Evidence should be documented and referenced in the Self Assessment report Confirmation of evidence in examination papers, examination scripts, student reports, etc

12. PRO-EAST Workshop12 Level The most difficult judgement to make in accreditation. EUR-ACE: ‘a critical awareness of the forefront of their branch’, based on Dublin Descriptors. The members of panel have to make this judgement, based on an equivalent statement.

13. PRO-EAST Workshop13 Learning Environment Are there adequate resources supporting the programme? Evidence of resources from: Number and qualifications of teaching and support staff Library, laboratory and computing facilities Feedback from students University internal QA reports (if any)

14. PRO-EAST Workshop14 Combining Judgements How do we combine evidence to make overall judgement? Agreed list of items that need to be evaluated. Assess each Satisfactory or Not Satisfactory. Can compensation be applied to Not Satisfactory items? Agreed rules for overall decision based on evaluation of individual items

15. PRO-EAST Workshop15 Conclusions Assessing Learning Outcomes requires professional judgement Agreed rules should be used to guide judgements. Agreed rules for Agency Committee. Procedures and methods should be published. Is accreditation important?