Erasmus+ Sarantuya Tumurtogoo Orkhon Gantogtokh 16-17/Oct/2018 Assuring quality of learning and teaching in Cycle 3 (doctoral) programmes Erasmus+ Sarantuya Tumurtogoo Orkhon Gantogtokh 16-17/Oct/2018

CHALLENGES AROUND TEACHING AND LEARNING Curriculum development Research integrity Research environment Access and admission Partnerships

CURRICULUM DEVELOPMENT Development of doctoral programs curriculum is weak and content of courses are duplicated with masters courses. Foreign language proficiency of candidates need to be improved. Internal quality assurance of doctoral programs is not well developed.

HOW ARE THESE ADDRESSED IN NATIONAL GUIDELINE? Doctoral program will have at least 60 credit hours, consisting of the following courses and research works: 10 credit hours of research methodology course. 20 credit hours of professional course. Of which, up to 6 credit hours can be collected from local and foreign professional departments, team of professors, universities, and scientific institution. Research and theoretical seminar by the thesis supervisor will be up to 6 credit hours.

HOW ARE THESE ADDRESSED IN NATIONAL GUIDELINE? Research and theoretical seminar by the thesis supervisor will be up to 6 credit hours. Doctoral dissertation will have 24 credit hours. The university will collaborate effectively with the government, non-governmental organizations, academic institutions, professional associations, and employers in implementing the program to improve efficacy for the society. The program must be comparable with internationally recognized programs from reputable universities.

HOW IS IT ADDRESSED IN NATIONAL GUIDELINE? After studying 20 credit hours, foreign language examination will be taken. Foreign language examination and level of knowledge requirement should be included in the university program policy The credit hours collected foreign language courses is not considered a part of the main credit hours of the program.

HOW ARE THESE ADDRESSED IN NATIONAL RESEARCH-BASED PROGRAM? 3.4.6. To improve the internal quality assurance in order to improve the quality of postgraduate teaching and provide support to postgraduate programs to be accredited internationally and nationally.

HOW ARE THESE ADDRESSED IN EQA? Criterion 1. DOCTORAL PROGRAMME OBJECTIVES, CONTENT AND DELIVERY The doctoral programme objectives are aligned with the institutional research policy and objectives, taking into account stakeholder expectations. 1.1 Programme objectives The programme has defined objectives in the form of intended learning outcomes covering knowledge, skills and competencies to be acquired by students by the end of the studies. The objectives reflect the national and institutional research policy and objectives, mission, expectations of the relevant subject community and stakeholders. 1.2 Pertinence of doctoral studies for societal needs Priority areas of national and regional development needs and/or contextual challenges are reflected in research strategies of graduate programs. To address the contextual challenges, doctoral schools support interdisciplinary programs and research opportunities. 1.3 Programme content The curricular contents allow scientific scope and students to achieve the intended learning outcomes of research degree. The curriculum does have a logical sequence, avoids overlaps and contains a balance between theory and practice in line with the programme objectives. Where appropriate, the curriculum contains elective elements for students

HOW IS IT ADDRESSED IN EQA? 1.5 Employability skills Doctoral programmes include appropriate professional career development opportunities such as embedding employability skills in courses and including relevant practicum in the work places. Doctorate ensures professional associations’ involvement in the development of doctoral program. 1.6 Doctoral student workload Workload for teaching contact hours, independent research projects, and thesis writing is balanced, preventing from overload or shortcomings. 1.7 Documentation of curriculum development Doctoral program documentation is developed by meeting the common requirements of doctoral programs set by the Ministry, and other special requirements set by professional associations of a particular field. Documentation of a doctoral program clearly states the procedures of plan, implementation and quality assurance of research projects completed during the program. 1.8 Teaching and learning methodology The instructional methodology is student centered, aligned with the programme objectives and supports students’ achievement of the intended learning outcomes.

HOW IS IT ADDRESSED IN EQA? Criterion 7. QUALITY ASSURANCE The doctoral programme is subject to regular internal and external quality assurance mechanisms directed at continuous development with the involvement of stakeholders. 7.1 Internal quality assurance policy The programme and its components (including teaching material and facilities) as well as the quality of the involved staff members are regularly evaluated. The programme demonstrates that evaluation results are used for continuous improvements. All relevant stakeholders are involved in evaluation mechanisms. 7.2 Quality assurance indicators to support employability Doctoral schools monitor their research degree provision against internal and external indicators and utilizing effective instruments to monitor and improve their doctoral graduates’ employability. 7.3 Appeals procedure Doctoral schools establish formal procedures for dealing with complaints and appeals that are fairly and consistently applied.

Plagiarism is a pressing issue. 2. RESEARCH INTEGRITY Plagiarism is a pressing issue. Evaluation of research quality and impact is not much developed. No Research Ethics Committee function Research ethics policy is not well applied at university level.

HOW IS IT ADDRESSED IN NATIONAL GUIDELINE, ORDER NUMBER 370 ? Ethics committee is established under the postgraduate affairs Research ethics contract is made between the school and doctorate candidate To avoid research and experimental designs that may adversely affect national security, health and the environment, human development, humanitarian, democratic and civil society, and to ensure universal biosafety standards Scientific data, calculations, analysis, rationale and evaluations should be based on evidences

HOW IS IT ADDRESSED IN NATIONAL GUIDELINE? The findings of the research should be proven based on evidences and to demonstrate academic ethics, reference of the sources used in the research should be made. All sources referenced should be consistent with the doctoral dissertations Plagiarism shall not exceed acceptable level, unless the thesis/dissertation will be returned. If the action is repeated, reactive actions will be taken up to removal from university. Subcommittee on academic ethics under the University Academic Council will produce a conclusion that the research paper is in compliance with academic ethical standards and is plagiarism-free. The level of acceptable plagiarism will be included in the University Program Policy.

HOW IS IT ADDRESSED IN NATIONAL RESEARCH-BASED PROGRAM? 3.1.5. Create a mechanism to ensure the implementation of research ethical policy and other general rules of conduct by enhancing protection of intellectual property rights and using a software (turn tin) to check plagiarism. 3.4.5 To improve ethics and attitude of supervisors in postgraduate studies and build their capacity.

HOW ARE THESE ADDRESSED THROUGH EQA? 1.4 Research integrity Curricular content enables students to aqcuire research skills, research originality and integrity, required presentation of work and about best academic practice. 2.3 Research responsibility Students undertaking doctoral programmes are informed with clearly defined responsibilities and entitlements in contractual terms. 3.3 Assessment of originality Criteria of the originality of research work is clearly defined to enable doctoral students to prevent from risks of any research ethical misconducts. 6.2 Regulations for doctoral programme Higher education institutions have regulations for doctoral degrees. Research integrity policy, procedures and consequence of misconduct are clear and readily available to doctoral students and staff, including examiners. 7.3 Appeals procedure Doctoral schools establish formal procedures for dealing with complaints and appeals that are fairly and consistently applied.

3. CHALLENGES OF LEARNING ENVIRONMENT Database of national citation is not well developed. The number of internationally and nationally recognized journals is limited. Learning environment, resources and joint lab are inadequate.

HOW IS IT ADDRESSED IN NATIONAL RESEARCH-BASED PROGRAM? 3.1.4. Establish a "Scientific Reference Database" (SCI) where doctoral dissertation, master's thesis, academic journal articles and other research works are hosted. 3.1.6. Support the publication of internationally-accredited, peer-reviewed scientific journals that can be jointly produced by university, educational associations and other relevant institutions 3.5.4.Improve laboratory usage and support the establishment of open laboratories;

HOW IS IT ADDRESSED IN NATIONAL RESEARCH-BASED PROGRAM? 3.5.5.Establish, maintain and accredit a national network of inter-disciplinary and open laboratories 3.5.6.Develop an online database of laboratories The committee has the following right: 3.1. To approve the list of international and local journals in which the academic article of the candidates of the relevant field shall be published (Doctoral dissertation committee policy and rules)

HOW ARE THESE ADDRESSED THROUGH EQA? 6.4 Research environment Higher education institutions ensure to provide doctoral students with a learning environment that provides support for doing and learning about research. Laboratories and their equipment and library resources are suited to the subject area of the programme. Students have access to facilities and software necessary for the achievement of the intended learning outcomes, also during self-study periods.

4. CHALLENGES OF ACCESS AND ADMISSION The duration of full time and part time studies is not specified. Most doctoral candidates study part-time while working, which affects the quality of doctoral studies. Limited number of doctoral scholarships. Admission criteria is not strong. Development of Graduate school is not well established.

HOW IS IT ADDRESSED IN NATIONAL GUIDELINE? The duration of doctoral studies is 3-6 years for full time and 6-8 years for part-time Government decree number 46 on ‘Student Development Loan’ has just been approved in 2018. The doctoral-education schools must have a separate management unit responsible for the program. The head of this unit (director or principal) must have at least 3 years’ experience in management or teaching, and a doctoral degree.

HOW IS IT ADDRESSED IN NATIONAL RESEARCH-BASED PROGRAM? 3.3.2. Develop and implement competitive grants for “Research University”, “Research team”, “Student researcher” 3.4.3. To support student exchange programs, and joint research and teaching projects in postgraduate academic programs

HOW IS IT ADDRESSED IN EQA? 2.1 Admission policy Admission policy and criteria enable students to achieve the intended learning outcomes. They are fairly and consistently applied. 2.2 Selection of doctoral students Only qualified and prepared applicants are admitted to doctoral programmes. Selection team from a doctoral school who are trained for selection and admission of doctoral students make independent admission decisions which have been made in accordance with its admissions policy. 6.1 Structure to support doctoral studies Higher education institution has a structure and organization to effectively implement the doctoral programmes, aligned with the programme objectives and institutioanal research strategies and supports students’ achievement of the intended learning outcomes and research activities.

5. CHALLENGES OF PARTNERSHIP The number of visiting professors and adjunct professors is limited. Partnership with academy and enterprises are not very strong. Student and faculty mobility are not supported adequately. The number of joint doctoral programs with international institutions is limited.

HOW IS IT ADDRESSED IN NATIONAL GUIDELINE? In the case of joint and inter-sectoral programs by universities /internal, foreign/, mutual recognition of credit hours is governed by a formal contractual agreement in consistence with requirements by the accreditation body of the relevant program Formal consent must be taken from the State Central Administrative Authority of Educational Affairs, when implementing a joint doctoral program with a foreign university The program must be comparable with internationally recognized programs from reputable universities The university will collaborate effectively with the government, non-governmental organizations, academic institutions, professional associations, and employers in implementing the program.

HOW IS IT ADDRESSED IN NATIONAL GUIDELINE? 3.4.1. To improve the condition to support mobility of researchers between domestic universities through increasing the number of adjunct professors and visiting professors in international universities 3.4.2. To support international and national prominent professors who work in highly developed countries to work as visiting professors in Mongolia and implement joint research projects 3.5.3.Support universities to implement joint research projects, innovational program and projects with international scientific centers and associations

HOW IS IT ADDRESSED IN NATIONAL RESEARCH-BASED PROGRAM? 3.4.1. To improve the condition to support mobility of researchers between domestic universities through increasing the number of adjunct professors and visiting professors in international universities 3.4.2. To support international and national prominent professors who work in highly developed countries to work as visiting professors in Mongolia and implement joint research projects 3.4.3. To support student exchange programs, and joint research and teaching projects in postgraduate academic programs

HOW ARE THESE ADDRESSED THROUGH EQA SYSTEM? 2.5 Research partnerships The doctoral programs have established links and partnerships with national and international higher education institutions, internal or external research departments and research institutions and industries to establish joint doctoral programs, joint research projects and industry partnerships.

HOW ARE THESE ADDRESSED THROUGH EQA SYSTEM? 3.2 Doctoral student progress and recognition of achievements Credit transfer system to enable recognition of learning outcomes acquired in different institutions is in place. Relevant regulation and procedure to support mobility of doctoral students, allowing them to do a certain number of courses offered by external institutions, if they wish. 4.4 Mobility of teaching staff Doctorate supports mobility of teaching staff, inviting highly competent visiting and/or adjuct professors from national and international organizations and research institutes. Providing teaching staff a professional development opportunities through working as visiting professors or researchers in different institutions through joint agreements.

HOW ARE THESE ADDRESSED THROUGH EQA SYSTEM? 1.5 Pertinence of doctoral studies for society Priority areas of national and regional development needs and/or contextual challenges are reflected in research strategies of graduate programs. To address the contextual challenges, doctoral schools support interdisciplinary programs and research opportunities. 6.6 Research partnership Entrepreneurship opportunities are provided through business incubator centers within universities for doctoral communities , where applicable.

IMPROVEMENT OF LEGAL FRAMEWORK OF THE CYCLE 3 PROGRAMME IN MONGOLIA Government decree number 46 on ‘Loan for Student Development’ Building up Research based university in Mongolia, approved by the Government decree number 282, Sept 2018. approved in 2018. It is a non-interest loan to support doctoral students who have over 3.2 GPA in their studies. According to the National Statistical data, there are 1164 doctoral students who are eligible to get such loan. This loan will be effective in October 2018 and application process has already started.

Objectives: Objective 1: To establish the requirements and criteria for research-based university and the mechanism to evaluate research findings; Objective 2: To enhance the management, organization and operational system of universities so as to meet good governance requirements and international standards; Objective 3: To create diversified funding mechanism that ensures multiple sources and wide coverage, and implement a competitive grant program to promote quality research; Objective 4: To develop postgraduate teaching and research through concentrating a pool of competent researchers in priority fields of science, technology and innovation development. Objective 5: To promote research collaboration and partnership among university, government, private sector and industry, and create an innovation ecosystem.