Training and Evaluation Tool Milan Jovic Dusan Jevtic Dr Dragan Jankovic Public Reporting on Project Results TEMPUS project

Outlines : Introduction Introduction About existing solutions About existing solutions TET package TET package Conclusion Conclusion Public Reporting on Project Results TEMPUS project

Introduction This is the century when school system can not be imagine to work without computer assistance. Software developed for learning in classrooms or from home are present in large percent of schools in every country. This kind of software is almost always developed for some of next purposes : This is the century when school system can not be imagine to work without computer assistance. Software developed for learning in classrooms or from home are present in large percent of schools in every country. This kind of software is almost always developed for some of next purposes : Distance learning Distance learning Question generators Question generators Test generators Test generators Students testing Students testing Away laboratories Away laboratories Public Reporting on Project Results TEMPUS project

Large analysis number of existing packages shows that following set of functionalities should be implemented in every serious application dedicated to evaluation or training : Large analysis number of existing packages shows that following set of functionalities should be implemented in every serious application dedicated to evaluation or training : Possibility to make fast tests easy Possibility to make fast tests easy Large number of different formats for the same test Large number of different formats for the same test Fast creating different set of tests for each student Fast creating different set of tests for each student Creating set of tests with switched question places (in every test every question is different numbered) Creating set of tests with switched question places (in every test every question is different numbered) Unlimited number of tests Unlimited number of tests Unlimited number of questions per test Unlimited number of questions per test Possibility to transform created test for any other device Possibility to transform created test for any other device Possibility to already created test for some device can easily transform for any other Possibility to already created test for some device can easily transform for any other Every student should have his/her own account Every student should have his/her own account Public Reporting on Project Results TEMPUS project

Notice start time, for every test and each student, when he/she began solving some test and also end time. Notice start time, for every test and each student, when he/she began solving some test and also end time. Templates for adding tests in database from file Templates for adding tests in database from file Possibility for hand marking correct and wrong answers Possibility for hand marking correct and wrong answers In period of learning, possibility to give, as much as possible, good answers and explanations for each question. In period of learning, possibility to give, as much as possible, good answers and explanations for each question. Possibility to put in the group any set of questions, so test should consist whole set or none of them. Possibility to put in the group any set of questions, so test should consist whole set or none of them. Possibility to set time that some student has to solve the test. Possibility to set time that some student has to solve the test. Software should automatic do all necessary statistics after every given answer. Software should automatic do all necessary statistics after every given answer. Possibility to create reports with statistics that we want Possibility to create reports with statistics that we want Possibility to make new test from the set of exist tests. Possibility to make new test from the set of exist tests. Possibility to attach multi-media files (sounds, pictures, movies) to any question Possibility to attach multi-media files (sounds, pictures, movies) to any question Public Reporting on Project Results TEMPUS project

Possibility to review the answers of some student after some period and to compare them with the key for same set of questions. Possibility to review the answers of some student after some period and to compare them with the key for same set of questions. To embed filters in purpose of exporting any document to MS-Word, for example, or some other. To embed filters in purpose of exporting any document to MS-Word, for example, or some other. To embed FTP protocol for distance database change To embed FTP protocol for distance database change Different level of access for every type of users Different level of access for every type of users Word processing with options for font and color change, for example (with Find dialog, Replace dialog, etc.) Word processing with options for font and color change, for example (with Find dialog, Replace dialog, etc.) Possibility to add references to any question in faze of creating Possibility to add references to any question in faze of creating Check the validation of test, meaning that data in test is inserted correctly. Check the validation of test, meaning that data in test is inserted correctly. Possibility to disable some questions to be inserted in test Possibility to disable some questions to be inserted in test Computer should read questions on speakers. This option is very important in last few years. Computer should read questions on speakers. This option is very important in last few years. Public Reporting on Project Results TEMPUS project

About TET package This package is developed in program language Delphi as Kylix application. Database server that we used is MySQL. This package is developed in program language Delphi as Kylix application. Database server that we used is MySQL. TET package consists of three separated parts TET package consists of three separated parts Administrating part Administrating part Question and test generator Question and test generator Tester Tester Common for all known packages is separated part for administration Common for all known packages is separated part for administration Public Reporting on Project Results TEMPUS project

Question generator (with this generator we can make questions and create groups of questions where every question belongs to some of them) Question generator (with this generator we can make questions and create groups of questions where every question belongs to some of them) Test generator (dedicated to make tests using questions from existing groups. We can choose one or more groups, and take one or more questions from everyone of them.) Test generator (dedicated to make tests using questions from existing groups. We can choose one or more groups, and take one or more questions from everyone of them.) Tester (with this tool we can test every student - solving some of already prepared tests) Tester (with this tool we can test every student - solving some of already prepared tests) Public Reporting on Project Results TEMPUS project

TET package features : Flexible interface Flexible interface Dynamic forms and components Dynamic forms and components Simple upgrade of database Simple upgrade of database Application portability on Linux operating system Application portability on Linux operating system Easy work with application. Easy work with application. Public Reporting on Project Results TEMPUS project

Types of question in question generator Yes/No questions Yes/No questions Questions with more Questions with more given possible answers given possible answers Connect familiar words Connect familiar words Put pictures on right places Put pictures on right places Fill blanks in sentences Fill blanks in sentences Public Reporting on Project Results TEMPUS project

Types of question in question generator Yes/No questions Yes/No questions Questions with more Questions with more given possible answers given possible answers Connect familiar words Connect familiar words Put pictures on right places Put pictures on right places Fill blanks in the sentences Fill blanks in the sentences Public Reporting on Project Results TEMPUS project

Types of question in question generator Yes/No questions Yes/No questions Questions with more Questions with more given possible answers given possible answers Connect familiar words Connect familiar words Put pictures on right places Put pictures on right places Fill blanks in sentences Fill blanks in sentences Public Reporting on Project Results TEMPUS project

Types of question in question generator Yes/No questions Yes/No questions Questions with more Questions with more given possible answers given possible answers Connect familiar words Connect familiar words Put pictures on right places Put pictures on right places Fill blanks in sentences Fill blanks in sentences Public Reporting on Project Results TEMPUS project

Types of question in question generator Yes/No questions Yes/No questions Questions with more Questions with more given possible answers given possible answers Connect familiar words Connect familiar words Put pictures on Put pictures on right places right places Fill blanks in sentences Fill blanks in sentences Public Reporting on Project Results TEMPUS project

Types of question in question generator Yes/No questions Yes/No questions Questions with more Questions with more given possible answers given possible answers Connect familiar words Connect familiar words Put pictures on right places Put pictures on right places Fill blanks in Fill blanks in sentences sentences Public Reporting on Project Results TEMPUS project

Test generator features : There are two different ways of test making that we can apply in this package : There are two different ways of test making that we can apply in this package : We can personally decide witch questions will be on the test, picking one by one We can personally decide witch questions will be on the test, picking one by one As it’s said that every question has to belong to some of existing groups (areas), we can just pick the groups and, separated for each of them, choose percent of questions those we want on the test from each group of questions As it’s said that every question has to belong to some of existing groups (areas), we can just pick the groups and, separated for each of them, choose percent of questions those we want on the test from each group of questions Public Reporting on Project Results TEMPUS project

Public Reporting on Project Results TEMPUS project

Tester Test selection Test selection Notice date and time for every test that student worked on Notice date and time for every test that student worked on Notice number of points won on each test Notice number of points won on each test Testing – all question are on the same form (imitation of paper work) Testing – all question are on the same form (imitation of paper work) Errors and points review for each test Errors and points review for each test Public Reporting on Project Results TEMPUS project

Conclusion Until now, developed parts of package are almost ready to be used and tested on our faculty. For the beginning, it will be tested with programming exam, techniques and methods of programming, etc. Until now, developed parts of package are almost ready to be used and tested on our faculty. For the beginning, it will be tested with programming exam, techniques and methods of programming, etc. We are planning to spread this package to some kind of tool for making questions and tests where we will not be limited by five different types of question. There should be a board with all necessary elements next it and we should just put elements on the board, set their properties and connect them, making a question on that way. Public Reporting on Project Results TEMPUS project

Thank you ! Contact s : Milan Jovic – Milan Jovic – Dusan Jevtic – Dusan Jevtic – Dr Dragan Jankovic – Dr Dragan Jankovic – Public Reporting on Project Results TEMPUS project