Integrating MOOCs in University Curriculum: HSE University Experience Evgeniya Kulik, PhD, Director of eLearning Office at HSE University Ksenia Kidimova, PhD, Deputy Director of eLearning Office at HSE Higher School of Economics , Moscow, 2017 www.hse.ru

National Research University Higher School of Economics Founded in 1992 > 31 000 Students 4 Campuses: Moscow, St.Petersburg, Nizhniy Novgorod, Perm 10 Academic Departments (MegaSchools) 80 MOOCs 1 million enrollments on HSE online courses on Coursera 300 000 students on National Platform of Open Education TOP-10 on Coursera by number of courses

HSE University on Coursera and Open Education Platform Coursera since 2014 OpenEducation since 2015 53 courses (19 in Eng) 1 000 000 enrollments 195 countries 3 (+2new) specializations 30% first learned about HSE 27 courses 300 000 enrollments 18 countries 30% HEI lectures 6 HSE courses in TOP-10 we develop: Management solutions Organizational and economic models Learning analytics

Why? How? Sharing Experience

Focus on Online Education HSE University is developing online projects to ensure: Variability and the highest quality of teaching HSE’s social responsibility as a center of high quality education Uniform standards of teaching in 4 HSE campuses Promotion among the global academic community

High quality Variability Why? Improving the quality of educational programs and reducing the cost of their implementation High quality Variability Reasonable expenses Identifying the best possible organizational and economic formats for incorporating online courses into a standard academic curriculum and adding them to HSE’s internal bylaws Academic Council of each educational program is responsible for all aspects of its quality

The Goals of Integrating MOOCs into HSE Curriculum improve the quality of our educational programs by including online-courses achieve specific tasks with limited resources 1) Non-HSE MOOCs (unique content): a course, non-core for HSE, by a leading university specialized course in English a niche course delivered by a renowned professor 2) HSE MOOCs: variability and better quality of education on campus optimization of logistics, topical issue for universities with a disperse campus optimal use of resources

How We Integrate MOOCs into Curricula? Request of a student Regulations on academic mobility of students is the basis for credit transfer: The Student's Application Certificate on successful completion of the course Decision of the academic administration "White list“ Since 2016/17 online courses have become a mandatory element for all educational programs (decision of HSE Academic Council) MOOCs lists are prepared and opened to access by the academic supervisor the course certificate is guaranteed to be credited / the course is integrated in blended format (with offline exam, seminars etc.) Mechanisms of including MOOCs:

total number of MOOCs in curricula 350+ MOOCs are included into the educational plans of 11 000 HSE students in 2016/17 different MOOCs included in HSE students’ individual curricula 57 of 70 HSE online courses included in HSE students’ curricula total number of students total number of MOOCs in curricula 207 Educational Programs

350+ MOOCs are included into the educational plans of 11 000 HSE students in 2016/17 different MOOCs included in HSE students’ individual curricula 57 of 80 HSE online courses included in HSE students’ curricula We analyse: Types of courses offered using MOOCs Whether the strategy of schools in the selection of the MOOC type is related to the field of study 3) Students’ difficulties and satisfaction rate

How HSE University Integrates MOOCs: Internal Data Monitoring surveys organized by HSE Center for Internal Monitoring Series of in-depth interviews with staff and students (Academic Supervisors, Program Coordinators and Curricula Managers, Deans and Vice-deans, Students, Student council) Strategic session with Academic Supervisors, aimed at: analyzing the intermediate results, discussing bottlenecks finding optimal solutions and recommendations

What Types of Courses Are Offered to Students in the Format of MOOC Flexible approach Maximize the educational experience of students > 60% of educational programs expanded the list of existing elective courses Enhance professional diversity Adaptive Elective Compulsory

Field of Study vs. MOOC Type Some general patterns: Humanities are more likely to integrate MOOCs in blended format, which allows a traditional offline exam Computer science programs used MOOCs to go deeper in some specific topics or tools, online programming assessments were fairly reliable verifying students' knowledge and skills Programs taught in English, as well as programs in the field of international relations, international business and a some others, logically focused their attention on the choice of English-language courses

eSTARS.hse.ru/en/ The Main Challenges for Successful Use of MOOCs No set criteria for assessing the quality of MOOCs on University level A unified University system for selecting MOOCs and assessing the quality of external MOOCs selected for integration in university curriculum Reliability of exams and other assessments on MOOCs platforms Psychometrics and proctoring eSTARS.hse.ru/en/

Thank you for your attention! Your questions are mostly welcomed Cooperating and sharing experience kkidimova@hse.ru and ekulik@hse.ru