1. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy1 Self-Assessment Report & On-Campus Evaluation How to plan & how to run Professor Sergey Gerasimov Siberian Transport University, Russia Accreditation Board Member, RAEE

2. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy2 Outline 1. Self-Assessment Report 2. On-Campus Evaluation

3. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy3 Self-Assessment Report CRITERIA AND PROCEDURE FOR ACCREDITING PROGRAMMES IN ENGINEERING AND TECHNOLOGY bachelor masterdiplomaspecialist These criteria correspond with the Bologna follow-up activities and distinguish between programmes of the First and Second Cycles. The term "Cycle" is used to describe a study programme leading to an academic degree. In Russia the first cycle refers to bachelor programmes, while the second cycle encompasses both master and diploma specialist programmes.

4. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy4 Self-Assessment Report CRITERION 1. PROGRAMME OBJECTIVES CRITERION 2. PROGRAMME CONTENT CRITERION 3. STUDENTS AND STUDY PROCESS CRITERION 4. FACULTY CRITERION 5. PROFESSIONAL QUALIFICATIONS CRITERION 6. FACILITIES CRITERION 7. INFORMATION INFRASTRUCTURES CRITERION 8. FINANCE AND MANAGEMENT CRITERION 9. GRADUATES Common criteria

5. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy5 Self-Assessment Report Criterion 1. Programme objectives 1.1Each engineering programme must have: 1.1.1 clearly stated and documented objectives that are in full correspondence with the State Educational Standard, the institution mission and the needs of the programme constituencies; 1.1.2. a system for achievement of programme objectives and their improvement. 1.2Programme objectives must be published and available for all the constituencies as well as shared by each faculty member participating in programme delivery.

6. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy6 Criterion 1. Programme objectives. FC EEE. i) A solid mathematical and scientific background necessary to comprehend the fundamentals of engineering and to successfully obtain graduate degrees in engineering as well as in other professions. ii) A strong foundation in engineering areas relevant to current industry needs to allow them to compete for quality jobs. iii) An ability to apply design processes discipline, which will allow them to provide resourceful and innovative engineering solutions. iv) An ability to communicate effectively and to act with social, ethical and professional responsibility in their encounter with those inside and outside the engineering profession. v) An ability to use computers as a tool for analysis, design, simulation and control. vi) Strong laboratory skills that will allow them to design and conduct experiments with systems and instruments of various complexity. vii) An understanding of a need for lifelong learning and critical thinking required for entrepreneurship, competitiveness, leadership and adaptation to new challenges. viii) An understanding of social, business, industrial and human aspects as a complement to their engineering background.

7. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy7 Criterion 1. Programme objectives. SC EEE. i). Creatively use their background in basic sciences and mathematics in solving engineering problems. ii). Use their expertise in certain areas of electrical engineering in solving engineering problems. iii). Innovatively apply design process to complex engineering problems. iv). Communicate effectively and to act with social and professional responsibility in their encounter with those inside and outside the engineering profession in an international level. v). Innovatively use computers as a tool for simulation, analysis, design, computing and control. vi). Design and carry out experiments with systems and instruments of various complexities and analyse their findings. vii). Creative, critical and model-based thinking and problem solving. viii). Ability to do research on important scientific and technical problems. ix). Ability to disseminate knowledge and publish research findings. x). Ability to function effectively in multidisciplinary research and development teams.

8. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy8 Criterion 1. Objectives vs. Curriculum. FC EEE. Program Educational ObjectiveCourses and/or Evaluation Processes team work EEE 299, …., 474; EEE 491, 492; GE 401-402; IEEE Student Activities; Robotics Club basic sciences and mathematics MATH, 101, … 250; PHYS 101, 102; Math/Science/Basic Eng. Elective Sequence electrical engineering areas All EEE Courses apply design processes to engineering problems EEE 102, 211, 212, 313, 314, 342, 352; EEE 299, 399; EEE 411,424, 428, 443, 451, 452, 474; EEE 491, 492; communication skills ENG 101, 102; RUSSIAN 101, 102; EEE 299, 399, EEE 491, 492; GE 401-402 act with social, ethical and professional responsibility GE 301, 304, 401-402; EEE 299, 399; Disciplinary Rules; Attitude of Faculty Members computer skills CS 111, 112; All 3rd, 4th year EEE courses; MATH Courses laboratory skills All 4 credit-hour EEE courses Lifelong learning and critical thinking HUM 111, 112; GE 304; EEE 211,299, 399; Attitude of Faculty Members social, business, industrial and human aspects GE 301, 304, GE 401-402; EEE 491, 492; Humanities and Social Sciences Electives

9. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy9 Self-Assessment Report Criterion 2. Programme content 2.1. The programme must meet requirements of the State Educational Standard of the Russian Federation. 2.2. The programme must have clearly stated and documented learning outcomes that correspond with the programme objectives.

10. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy10 Criterion 2. Programme outcomes. FC EEE. a). an ability to apply knowledge of mathematics, science and engineering b). an ability to design and conduct experiments, as well as analyze and interpret data c). an ability to design a system, component, or process to meet desired ends d). an ability to function on multi-disciplinary teams e). an ability to identify, formulate and solve engineering problems f). an understanding of professional and ethical responsibility g). an ability to communicate effectively h). the broad education necessary to understand the impact of engineering solutions in a global and societal context i). a recognition of the need for and an ability to engage in life-long learning j). a knowledge of contemporary issues k). an ability to use the techniques, skills and modern engineering tools necessary for engineering practice

11. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy11 Criterion 2. Programme outcomes. SC EEE. a). an in-depth knowledge and understanding of the principles and recent trends of some branches of electrical and electronics engineering; b). an innovative ability to formulate and solve incompletely defined engineering problems in their area of expertise; c). an ability to apply design processes creatively to problems even having interdisciplinary features; d). an ability to identify, locate, obtain and evaluate required data in their investigations by way of designing and conducting observations, modelling, simulation, or experiments; e). a knowledge of the ethical, environmental and commercial constraints on engineering practice together with an understanding of applicable methods and techniques in interdisciplinary and complex engineering problems; f). function and communicate effectively as leader of a team that may be composed of different disciplines and demonstrate awareness of project management and business as well as the impact of engineering solutions in a societal and environmental context.

12. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy12 Correspondence between EUR-ACE & Program Outcomes PROGRAM EUR-ACE abcdefghijk 1. Knowledge and Understanding  2. Engineering Analysis  3. Engineering Design  4. Investigations  5. Engineering Practice  6. Transferable Skills.  FC EEE

13. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy13 Program Objectives vs. Outcomes FC EEE Program Objectives iiiiiiivvviviiviii Program Outcomes aa,ecf,gka,bh,ij SC EEE Program Objectives iiiiiiivvviviiviiiixx Program Outcomes aace,fdda,b,ca-ee, fc,e,f

14. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy14 Curriculum Characteristics vs. Program Outcomes. FC EEE. 0: None L: Low M: Medium H: High EEE Courses abcdefgh i jk EEE 101MMM0LMMLMLM EEE 102HHH0H0LLMLH EEE 202HMM0H0LLMLH EEE 211HHMLHHMHHMH EEE 212HHHLH0MLMLH EEE 299MMHHHHHHHHH EEE 313HHHMH0M0LMM EEE 314MHHLM0LMMMH ------------ EEE 424HHMMH00LLHM EEE 428HHM0L0000LL EEE 429HLMHH0L0MMM

15. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy15 Intended Learning Outcomes; Teaching and Learning Strategies and Methods; Assessment Strategies and Methods A. Knowledge and Understanding (FC MEng) Learning Outcomes: A1 An advanced knowledge of a broad range of modelling methodologies… A2 Knowledge of fundamental design issues relevant to mechanical … A3, A4, A5, A6, A7… Teaching Strategy/Methods The main mechanism for imparting the above knowledge and understanding in A1-A6 is lectures, combined with tutorials, examples classes, activities and coursework. Design labs and CAD sessions are used for A2, whilst computer labs form part of the teaching methods for some of the numerically orientated option modules (A4)…. Learning Strategy/Methods Students are required to support and reinforce lecture based knowledge transfer through private study, making use of recommended texts and web-based material. Tutorials allow lecture material to be discussed and supplemented… Assessment Strategy/Methods Formative assessment of student progress on taught modules is affected through the use tutorial exercises and coursework in the form of written answers to set exercises and/or case-study reports…

16. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy16 On-Campus Evaluation. How to plan & how to run «The place and time cannot be changed»

17. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy17 1.To assess in qualitative and quantitative terms those factors that can not be documented in a written questionnaire; 2.To scrutinize documentation presented by the University for accreditation; 3.To provide the University with the assessment of its strong points and shortcomings. On-Campus Evaluation. Objectives of the examination team

18. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy18 Regional Branches of RAEE

19. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy19 17.00-19.00Private Meeting of Panel and Academic Staff 19.00-20.00Dinner at University Hotel Day 0

20. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy20 8.30-9.30 Breakfast 10.00-10.30 Meeting with the administration of the University and the persons responsible for accreditation arrangements 10.30-11.00 Overview Presentation by Faculty of Engineering 11.00-13.30 Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work) 13.30-15.00Lunch 15.00-16.30Tour of University and related facilities (Library) 16.30-18.30 Tour of University and related facilities (Laboratories and Departments of Mathematics and Natural Sciences) 18.30-19.00Dinner at Hotel 19.00-20.00Private meeting of Panel at Hotel Day 1

21. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy21 8.00-9.00 Breakfast 9.00-10.30 Achievement of Programme Outcomes for Engineering Programme (Discussion between Panel and Academic Staff to cover all aspects of the programme) 10.30-13.30 Tour of University and related facilities (Departments of Engineering) 13.30-15.00Lunch 15.00-16.00Meeting/discussion with students on the programme 16.00-17.00Meeting/discussion with graduates from the programme 17.00-18.00 Meeting/discussion with employers from programme being reviewed 18.00-19.00Dinner at Hotel 19.00-20.00Private meeting of Panel at Hotel Day 2

22. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy22 8.00-9.00 Breakfast 9.00-12.00Visit on the base enterprise 12.00-13.30 Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work) 13.30-14.30Lunch 14.30-15.30 Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work). Private meeting of Panel to agree findings on Engineering Programme 15.30-16.30 Panel explains finding for the programme with Academic Staff 16.30-17.30Conclusion of visit 18.00-19.00Dinner Day 3

23. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy23 8.00-9.00 Breakfast Departure Day 4

24. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy24 Accommodation at hotel Day 0

25. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy25 Private Meeting of Panel and Academic Staff 17.00-19.00 Day 0

26. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy26 Dinner 19.00-20.00 Day 0

27. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy27 10.00-10.30 Day 1 Meeting with the administration of the University and the persons responsible for accreditation arrangements

28. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy28 Overview Presentation by Faculty of Engineering 10.30-11.00 Day 1

29. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy29 Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work) 11.00-13.30 Day 1

30. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy30 15.00-16.30 Day 1 Tour of University and related facilities (Library)

31. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy31 16.30-18.30 Day 1 Tour of University and related facilities (Laboratories and Departments of Mathematics and Natural Sciences)

32. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy32 19.00-20.00 Day 1 Private meeting of Panel at Hotel

33. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy33 9.00-10.30 Day 2 Achievement of Programme Outcomes for Engineering Programme (Discussion between Panel and Academic Staff to cover all aspects of the programme)

34. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy34 10.30-13.30 Day 2 Tour of University and related facilities (Departments of Engineering)

35. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy35 15.00-16.00 Day 2 Meeting/discussion with students on the programme

36. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy36 16.00-17.00 Day 2 Meeting/discussion with graduates from the programme (~ 10 graduates)

37. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy37 17.00-18.00 Day 2 Meeting/discussion with employers (~ 7) from programme being reviewed

38. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy38 19.00-20.00 Day 2 Private meeting of Panel at Hotel

39. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy39 9.00-12.00 Day 3 Visit on the base enterprise

40. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy40 12.00-13.30 13.30-14.30 – обед 14.30-15.30 Day 3 Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work). Private meeting of Panel to agree findings on Engineering Programme

41. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy41 Panel explains finding for the programme with Academic Staff 15.30-16.30 Conclusion of visit 16.30-17.30 Day 3

42. PRO-EAST Workshop, May 9-11, 2007, Rome, Italy42 Questions and answers