1. Seventh Quality in Higher Education Seminar Transforming Quality 30–31 October 2002 Melbourne

2. Transforming quality Deliberate ambiguity: can quality transform or do we need to transform quality?

3. Themes Is quality in higher education about transforming students? How might (external) quality monitoring be transformed to help improve the quality of the student experience and of the learning? What has been the transformative impact of external quality monitoring?

4. Theme 1 Is quality in higher education about transforming students?

5. Quality learning What constitutes a high quality learning process and outcomes? To what extent is there a need to reconceptualise how higher education engages with the key issues of —access —employability —funding?

6. standards monitoring assessment audit accreditation Object improvement accountability Rationale External evaluation Approach learner output medium of delivery provider Focus qualification learning experience curriculum design, admin governanace & regulation control compliance national regional national regional international

7. standards monitoring assessment audit accreditation Object improvement accountability Rationale External evaluation Approach learner output medium of delivery provider Focus qualification learning experience curriculum design, admin governanace & regulation control compliance national regional national regional international

8. Interlinked elements funding access employability learning quality

9. Interlinked elements funding access employability learning quality value for money fitness for purpose excellence transformation

10. Interlinked elements funding access employability learning quality value for money fitness for purpose excellence transformation employers institutions students academic staff

11. Theme 2 How might (external) quality monitoring be transformed to help improve the quality of the student experience and of the learning?

12. improvement audit accrediting, assessing and checking Object improvement accountability and conformance Rationale External evaluation Approach learner provider and what is provided provider and what is provided Focus learning experience static elements: regulation, curriculum, outputs static elements: regulation, curriculum, outputs

13. improvement audit accrediting, assessing and checking Object improvement accountability and conformance Rationale External evaluation Approach learner provider and what is provided provider and what is provided Focus learning experience static elements: regulation, curriculum, outputs static elements: regulation, curriculum, outputs

14. improvement audit accrediting, assessing and checking Object improvement accountability and conformance Rationale External evaluation Approach learner provider and what is provided provider and what is provided Focus learning experience static elements: regulation, curriculum, outputs static elements: regulation, curriculum, outputs

15. improvement audit Object improvement Rationale External evaluation Approach learner Focus learning experience transformation of the learner

16. Transformation Transformation is a process of transmutation of one form into another. In the educational realm this involves the development of domain expertise AND the development of attributes that enable the development of new understanding.

17. Transformation Transformation in higher education is about producing people who can lead, who can produce new knowledge, who can see new problems and imagine new ways of approaching old problems. Higher education has a role to prepare people to go beyond the present and to be able to respond to a future which cannot now be imagined. HE has to transform to do this.

18. Transformative learning A continuous process of assimilation, reflection, synthesis and critique. Questioning absolutes, preconceptions and taken-for granteds —others and ones own. Deconstructing knowledge and building alternative understandings.

19. Transformative learning Transformative learning Rote Engaging/ Questioning Reconceptualising Accepting Understanding

20. Critical transformative learners have domain expertise; are independent learners; attempt to develop alternative understandings.

21. Knowledge of structure, principles and procedures in a domain Expertise within a domain Metacognitive Ability to use new data to re-shape old concepts and form new ones: accommodation of discordant data not just assimilation of non-discordant data Skilled (transferable)

22. Commitment to continued learning, especially through reflection, construction and deconstruction Independent learner Develop own learning agenda Continuous refinement of own values and self-reflection

23. Develop alternative understandings Recognition that frames of reference empower and limit Draw upon a variety of explanatory and interpretive frameworks Development of critical, dialectical thinking Go beyond the preconceptions or taken-for-granteds of frameworks

24. Transformative learning Enhancing students’ abilities and knowledge Empowering students to be active learners

25. Enhancing learners Enhancing students as transformative learners means: providing students with access to a body of knowledge; enabling students to develop a range of intellectual and other attributes through which they can engage and develop knowledge.

26. self skills risk taking flexibility and adaptability ability to find things out willingness to continue learning intellect Attributes knowledge analysis, synthesis, critique communication team working interpersonal skills

27. Empowering learners Empowering students as transformative learners means: treating students as intellectual performers rather than as passive recipients of teaching; encouraging critical engagement with a body of knowledge.

28. Quality monitoring? To what extent can external quality processes assure transformative learning. Approaches to date are not strong on learning at all —tend to conservatism.

29. Quality monitoring? External processes are not the primary mechanism by which transformative quality improvement in higher education is assured. Day-to-day quality assurance is through internal academic processes. External processes should articulate with, and augment, internal procedures.

30. Theme 3 What has been the transformative impact of external quality monitoring?

31. Impact What impact has EQM had and on what? Does it go beyond the level of rhetoric? Does it lead to short-term response or does it lead to permanent cultural changes? If so, does this permeate all levels of the institution or is it a management preoccupation?

32. External quality monitoring leads to bureaucratisation and inflexibility is amateurish, burdensome and inefficient is concerned with accountability not improvement leads to ‘game playing’ and ‘performance’ short-term response not cultural changes has no real impact on student learning

33. Bureaucracy Any form of EQM would involve some level of ‘bureaucracy’. Key issue is not the existence of a bureaucracy or of bureaucratic processes but the nature of the bureaucracy and its processes. Bureaucracy must meets needs of external and internal stakeholders, not be self-perpetuating.

34. Quality bureaucracies Three main roles: ensure integrity of HE act as a catalyst for improvement act as a conduit for useful information

35. Amateurism Dominant approach —self- assessment, peer review, statistical data — not necessarily seen as the best approach. Burdensome. Most benefit to the peer assessors not the assessed.

36. Efficiency Doubts about the efficiency of most EQM. Cost (of agency and and to the institution) outweighs the value gained. Periodic ‘events’ do not help inform change management. EQM inhibits innovation through its conservative or rigid evaluation criteria.

37. Improvement Temporary impact. EQM must interact with internal quality systems — often not the case. Changes in culture —slow —commitment. Event or continuous process: performance and game playing.

38. Performance & game playing Engagement mediated by the perceived, short-term affect. ‘Game playing’ and compliance. ‘Performance’ to ensure maximum return. Obscures the reality. No surprise: ‘natural’ outcome of accountability-oriented processes. Game playing taking up resources for very little real return.

39. Self-assessment Main value of EQM is the internal self-reflection. But ‘two sets of books’. Fear of revealing weaknesses.

40. Longevity of process Improvement potential decreases as process becomes more elaborate and routine? Emphasis shifts to procedural elements rather than innovative process. Need for constant reflection on and change in EQM, more trust and collaboration. Periodic change in purposes and in the agencies themselves.

41. Longevity Without periodic change, there is the danger of ending up with a British-style, QAA-type, system: a rolling ‘juggernaut’, that is not sure what it is looking for, but which ensures compliance and minimizes innovation and risk-taking. British institutions continue to comply, even if the return on the investment is derisory, because of the fear of loss of income. “ ”

42. Impact on learning Extreme sceptical that EQM had any impact on programme quality or student learning. No evidence of clear impact on learning —available research suggests that other factors outweigh the impact of EQM. Structure and organisation of EQM is not compatible with empowering staff and students to enhance the learning situation.

43. Impact on learning? I still haven’t seen a study that directly links external evaluation to improved student learning. (NOR) ‘ ’

44. Impact on learning? We still know almost nothing about the outcome of this concern for quality in terms of improvements in student learning. (SWE) ‘ ’

45. Impact on learning? I can detect no improvement in the learning situation of students — perhaps, in fact, even the opposite. Because we spend so much time trying to lay ‘ paper trails ’ for audit, and trying to ensure good RAE ratings, time to devote to students (certainly for informal interaction with them) is at a premium. (UK) ‘ ’

46. A Quality Manifesto “ Academics and students of the world unite and reclaim the quality agenda….. ”

47. Thank you