Development of educational assessment in Ukraine Liashenko O. I., doctor of educational science, professor, chief scientific secretary of Academy of Educational Sciences of Ukraine International symposium-2007 “Improvement and supporting of educational assessment practice: Ukrainian and European experience”

2 From the history of the issue  s – study of knowledge, ability and skill level in different subjects among secondary school students  – state certification of school-leavers using test items  – establishment of independent assessment of professional competence for health sector (Testing Board at Ministry of Public Health of Ukraine)  – “Independent Testing” project of “Renaissance” foundation (4 universities)  – project of Ministry of Education and Science, Academy of Pedagogical Sciences and Renaissance foundation “Centre of testing technologies”  UNDP Project “Equal access to quality education”  International TRAST project “True Assessment”  – pilot independent external assessment of academic achievements of secondary school graduates

3 Study of knowledge, ability and skill level of students  All general subjects are included  Non-test format – written papers  Level-based methods of task development – 3-4 levels  Sample – students from each grade, 7-10 domains of each subject  Non-standardized criteria of result assessment and processing  Interpretation of derived data – in a journal or bulletin of Ministry of Education before August teacher meetings

4 State certification of school-leavers ( )  Two stages – school-leaver certification and university entrance selection (results are added up)  Uniform tasks for everyone (a booklet in each subject) for three levels  Non-standardized result processing by teachers of respective schools  Mass falsification, because teachers perceived this certification form as a check of their skillfulness  No result interpretation

5 Projects “Independent Testing” and “Centre of testing technologies”  The project was initiated by four universities (Kyiv, Lviv, Kharkiv universities, Kyiv Mohyla Academy)  Combination of international experience (expert involvement) and native experience (experience of Kyiv Mohyla Academy, Lviv National University)  Development of standardized testing technology  Pilot independent assessment of academic achievement in three subjects (Ukrainian, mathematics, history)  Establishment of regional centres network  Organization and realization of monitoring studies ordered by the World Bank

6 Elements of educational quality assessment in Ukraine  Independent external assessment of academic achievements of secondary school-leavers  Participation in international inspections of education quality (TIMSS, PISA, CIVIC etc)  Collection, analysis and popularization of information about socio-economic and educational factors that define the state of functioning of education system at all levels  Preparation of analytical materials about education quality in Ukraine at different educational levels and in different subject fields

7 Monitoring of education quality (inspection levels)  at a local level - analysis of activity of an educational institution, prediction of psycho-educational results of activities of educational institutions and municipal system of education on the whole  at a regional level - analysis of the state of functioning of the regional education system  at a national level - analysis of the state of functioning of the national educational system, prediction of its development prospects with the purpose to develop public policy in education  at an international level - determination of functioning level of educational system in the context of international standards, comparative analysis with other countries

8 Functions of external assessment of school-leavers’ achievements  Combination of two functions – certification (state certification) and selection (selection of university entrants)  Independent assessment of students’ knowledge and skill level in different subjects  Unbiased (objective) student treatment during their assessment  Standardization of academic achievement assessment by modern methods  Monitoring of education quality at a level of educational institutions (rating of secondary schools)  Corruption control during admission to higher educational institutions

9 Development of independent external assessment 2006  Number of students –  Subjects – Ukrainian, maths, history  Regional centres – 4  Share of general number of students– 10% 2007  Number of students –  Subjects – Ukrainian, maths, history; on pilot base – physics, chemistry, biology  Regional centres – 9  Share of general number of students – 26% (Kyiv – 94,2%; Kharkiv – 81,8%)

10 Monitoring studies in Ukraine  spontaneous initiative studies of different aspects of education in the regions;  quality monitoring of primary and maths-and-science education by order of the World Bank (using TIMSS method )  monitoring of academic achievements in mathematics of the 4 th grade students  monitoring research of maths-and-science education of the 4 th and 8 th grade students as provided by program TIMSS-2007  2010 – expected participation in PISA inspection