1. DAAD Project “Joint Course on Software Engineering” Humboldt University Berlin, University of Novi Sad, University of Plovdiv, University of Skopje, University of Belgrade, University of Niš, University of Kragujevac Version: June 12, 2006 Seminar and Project in eLearning Zoran Budimac, Zoran Putnik

2. 2 DAAD project „Joint Course on Software Engineering“ © Introduction  In a summer semester of a school-year 2005/06, an “Elective seminar – eLearning” was held for the second time.  Last year, when the course was held for the first time, we had 7 students enrolled. Some of their achievements (Živana Komlenov, Filip Prentović) You were able to see last year, during the workshop in Baile Herculane.  This year (because we were good?) we had 25 students enrolled.

3. 3 DAAD project „Joint Course on Software Engineering“ © Introduction  eLearning seminar is, naturally, supported through eLearning software system Moodle.  As You can all check, a home page for this and other courses held at DMI is: perun.im.ns.ac.yu/courses

4. 4 DAAD project „Joint Course on Software Engineering“ © Web support:  Being one of the regular courses, “eLearning” course is listed with other “Regular courses”, and all of the enrolled students can access it using this web-page and their enrollment key.  Enrollment key is a security measure existing as a part of Moodle software system.  We chose to use it for all of our courses: learning resources are protected this way, and so are data about students

5. 5 DAAD project „Joint Course on Software Engineering“ © Web support:  Compared to our other courses, web support for this one contains relatively small number of resources.  Web-page contains only 4 resources (in Serbian):  Introductory lecture about eLearning,  Introduction to Moodle system,  Quality criteria for eLessons, and  An example of eLesson

6. 6 DAAD project „Joint Course on Software Engineering“ © Web support:  Resources are PDF files, created from presentations given at classes.  Resource used for creation of this criteria was – among others – a presentation given by Joachim Sam last year in Baile Herculane on this subject.

7. 7 DAAD project „Joint Course on Software Engineering“ © Last year:  We approached this course differently this year than we did the last year: Last year, students were expected to read the original lecture (PPT presentation), and transfer it to Moodle. Yet, Moodle was mostly used as a page-turner! (Plus – students were requested to answer the question after each page – just as a proof that (s)he read it! Some of those solutions were presented at Baile Herculane, and received suggestions and criticisms. This year, students were obliged to transfer topics into e-Lessons and use Moodle in a more creative manner.

8. 8 DAAD project „Joint Course on Software Engineering“ © This year:  We approached this course differently this year than we did the last year: Students were asked to identify Learning objects and create Graphical representation of their relationship Wherever possible, we requested different paths between LO’s Choice of a learning path should be implicit, i.e. based on her answers (to a posed question) Scheme should resemble – as much as possible – known algorithmic patterns: cycles, (multiple) choices, input/outputs … No more than 2 paragraphs without picture/ paging rather than scrolling …

9. 9 DAAD project „Joint Course on Software Engineering“ © Web support:  As mentioned, one of the resources was an example of eLesson.  This eLesson was mostly created by Živana Komlenov, and will be (or was) explained in more details during this workshop.  It represents a Topic 23 “Software Metrics” of JCSE, transferred into an eLesson.

10. 10 DAAD project „Joint Course on Software Engineering“ © Implementation:  Reason for small number of resources is a fact that most of the classes – after a few introductory lessons – are performed interactively.  Students are given their assignments, and they have approximately 2 months to create an electronic lesson.  They are also given a Moodle system (including all of the necessary additions) to be able to do their assignments at home.  So – after some work at home, they usually come to DMI, restore their lesson, and ask for help, opinions, or decisions …

11. 11 DAAD project „Joint Course on Software Engineering“ © Implementation:  After “agreeing” on the contents and appearance of eLesson, students usually go home for a second iteration.  A week or two later, they are back with improved eLesson and more questions and discussions to fight.  …  Anyway – after several iterations, we have a finished eLesson, they have their mark.  … 10 (excellent) usually.  We simply “torture” them until their eLesson is not good enough for 10. They don’t complain too much.

12. 12 DAAD project „Joint Course on Software Engineering“ © Course schedule:  For the assignments, additional category of “Courses” inside Moodle is defined – category “eLearning 2006”  At the beginning, it contains empty courses, named after students who enrolled to the seminar.  Later – as they finish their eLesson, it changes name to something more meaningful.

13. 13 DAAD project „Joint Course on Software Engineering“ © Course schedule:  Since this elective seminar is available for students of both 3 rd and 4 th year, we decided to give them different assignments: 3 rd year students had to create eLesson for a selected part of a course “Operating systems” 4 th year students had to create eLesson for a selected part of a course “Software Engineering” The idea behind this is: After they create parts of a course, we will combine these eLessons, and create complete eCourses.

14. 14 DAAD project „Joint Course on Software Engineering“ © Course schedule  For the 3 rd year students, we had no problems – there was plenty of students, so we managed to cover the whole course, some topics even twice!  Topics included for example: Introduction Synchronization Classic problems of operating systems Communication of heavy processes Dispatcher Memory management Virtual memory File system Reliability – optimization algorithms Deadlock Security and protection

15. 15 DAAD project „Joint Course on Software Engineering“ © Course schedule  For the 4 th year students, we had several problems: there was not enough students, some students were allowed to create their lessons before we decided to ask for e-Lessons – their lessons are static! some students took their topic, started their work, and then drop out from the course, some students took their topics, but haven’t finished it yet – they finished with “attendance” part of studying, we expect them anytime now.  So, topics that are worth mentioning from SE course are: Object-oriented analysis – still not finished Object-oriented design – still not finished State-oriented view – finished and useful Scenario-based view – finished and useful Functional view – finished and useful Structured analysis – finished and useful Cost estimation (old version) – finished and very useful

16. 16 DAAD project „Joint Course on Software Engineering“ © Example of graphical representation of LO’s and their relationships:  As a part of the seminar paper that is an accompaniment of an eLesson, we insisted on scheme representing their lesson.  Here is an example of such a scheme.  The author of this scheme and an eLesson that goes with it, is 3 rd grade student, Radana Bratić. OSNOVNI POJMOVI, KONCEPTI OS-a. Sadržaj Jezgro OS-a ? Prekidi. UvodPolingPrekidi ? Komandni interpreter Sistemski pozivi ? Fajl sistem Procesi Stanja Konkurentno programiranje ? Korišćenje memorijePodela procesa na teške i lake ? ? Podela OS-a u odnosu na procese ? Odnos procesa Operacije sa procesima Process Control Block ? Prelasci između različitih stanjaSuspendovani procesi ? ?žžžž*

17. 17 DAAD project „Joint Course on Software Engineering“ © Example of another eLesson:  Naturally, we do expect have problems with this, we are aware that there will be a lot of work until all of the eCourse parts are equalized and perfected, but we have a start!  Of course, in the future, some parts of courses can be re- worked, either by students, or by lecturers.  Let us take a look at one of eLessons created by a 3 rd year student (Jaroslava Valah).  Note: All eLessons are in Serbian, for obvious reasons.

18. 18 DAAD project „Joint Course on Software Engineering“ © Example of eLesson:  Miss Valah had to create an eLesson for a course “Operating systems”. Her part was “Swamping of processes”.  All of the students were required to produce the same three parts of eLesson:  Lecture itself, with all of the needed explanations  Quiz that will be used for knowledge testing  Glossary of new and important terms.

19. 19 DAAD project „Joint Course on Software Engineering“ © Example of eLesson:  As can be noticed, student followed the suggested criteria: not too much text, each page fitting a screen, some graphics, …

20. 20 DAAD project „Joint Course on Software Engineering“ © Example of eLesson:  One of the more important suggestions/demands was to include questions into their eLessons.  Questions are relatively simple, strongly connected to a given material.  Given answer determines a flow of eLesson. Incorrect answer takes student back to a previously explained material.

21. 21 DAAD project „Joint Course on Software Engineering“ © Example of eLesson:  At the end of an eLesson – there is a more complex quiz.  Here we can see only the first 4 questions.  Students were required to create a question data-base of about 25-30 questions.  Moodle system is then employed to randomly chose 10 questions for a quiz.

22. 22 DAAD project „Joint Course on Software Engineering“ © Example of eLesson:  As a help for a more successful knowledge acquiring, there is also a glossary of new and unknown terms.  Again, here we can see only the first 4 terms.  Students were required to create a glossary of as much (meaningful) terms as possible.  That demand usually resulted in about 10 terms.

23. 23 DAAD project „Joint Course on Software Engineering“ © Project  Considering that we are using Moodle system for a web-support at the DMI, we decided to apply for some funding!  WUS-Austria was offering a support for eLearning projects.  Since we decided to use it anyway – we just collected necessary administrative material and sent it to WUS-Austria.

24. 24 DAAD project „Joint Course on Software Engineering“ © Project  Our Moodle web-site – in its part dedicated to regular courses – supports courses “Software engineering” and “Operating systems”  Naturally, professors and assistants involved in those two courses were candidates for a project: Budimac, Ivanović, Putnik, Komlenov, and Pribela.  Professor Bothe was also interested in a project, and send us a “letter of support” from Humboldt University.

25. 25 DAAD project „Joint Course on Software Engineering“ © Project objectives  To create course supporting and e-learning system for at least two undergraduate and one graduate course in the field of informatics. The system will be web-based and accessible through Internet.  The system would consists of: repository of teaching materials, quizzes and testing facilities, live chats between students and teachers, specialized forums for students to exchange ideas, additional sources of information and ways to solve assignments, statistics on earned points and progress reports for teachers and students, e-lessons (specialized electronic lessons for independent study and checking the progress), facilities to submit solutions to assignments with prevention of cheating, automatic checks of certain aspects of solutions to assignments (when solutions are computer programs).

26. 26 DAAD project „Joint Course on Software Engineering“ © Project objectives  The objectives will be fulfilled using one of the existing course- supporting and e-learning platforms and extending it with specialized services needed.  The system would be illustrated and used on: The undergraduate and graduate courses of software engineering compatible with several other courses in the region and with the similar course at the Humboldt University in Berlin. Thus the systems will be used in international environment to exchange ideas and knowledge, esp. via live chats and student forums The undergraduate course in Operating Systems, where prevention from cheating and automatic checks will be used.  The collected experience, principles and rules will be published in a form of two documents: how to use the system (manual for students) and how to create lessons using the system (manual for teachers).

27. 27 DAAD project „Joint Course on Software Engineering“ © Back to the course  As usual, we gave students a questionnaire to find out about their satisfaction with the course. It contained three types of questions: “quantitative” – attendance and number of hours needed to master the material, and “qualitative” – quality of lectures + exercises  Attendance was very high: out of 14 students – 13 said that they missed only one lecture, and less than 3 exercises. all of them said that they used consultations and advices a lot additional work: on the average, they said that 2.93 hrs per week is needed, and that they spend 2.86 hrs, Yet: two of them said “it’s 7 (5) hrs needed, I spent 4 (3)” other two are on the totally other end: “it’s 3 (2) hrs needed, yet I spent 6 (4)”

28. 28 DAAD project „Joint Course on Software Engineering“ © Lecture organization  On a scale from 1 – 5, we received a few excellent marks: organization of lectures good4.83 continual assessment motivating4.82 lectures and exercises coordinated4.46  … few slightly lower: type and difficulty of tasks motivating4.15 quantity of lectures appropriate4.21  … and the worst mark of the whole questionnaire: course resources appropriate 3.85  The similar thing happened with SE and SPM courses – it seems that our students would prefer to have textbooks!  Finally, our overall marks were excellent: course useful4.57 overall quality good4.57

29. 29 DAAD project „Joint Course on Software Engineering“ © Lecturer vs. Exerciser  “Personal” marksLecturerExerciser preparation of lectures 4.77 4.71 explanation style 4.38 4.86 “What have You learned through lectures and exercises 4.00 willing to answer questions 4.69 4.86 difficulty of assignments 4.93  On a scale 1 – too slow through 5 – too fast: Speed was a bit too high 4.08 4.36  Finally, students were overall satisfied with their Lecturer 4.54 but much more with their practitioner 4.86

30. 30 DAAD project „Joint Course on Software Engineering“ © General comment  With or without the questionnaire, there are some things that we might conclude as a certainty: learning just by using slides is not welcomed by students additional texts do help, but are not enough students who attended lectures and exercises regularly, and were also given a chance for additional consultations, were a bit more satisfied, yet … they definitely want a textbook, if possible an exercise book.

31. 31 DAAD project „Joint Course on Software Engineering“ © Are we happy with our seminar?  Yes, we are, and for several reasons: we have a repository that holds all the material needed for successful learning, self-testing, and statistics we have a regular live chat between students and professor, offering help when needed forums are used to clear all misunderstandings, obscurities, or problems. Students help each other, but also professor, assistants, and distinguished guests (Kay Schützler, Martin Douguamis …) participated. eLessons are created in such a way that solitary work is enabled, provoked, and approved cheating is greatly minimized – firstly because of a software solution, secondly because of fear

32. 32 DAAD project „Joint Course on Software Engineering“ © Are we happy with our seminar?  What else is there to be done? our manuals for students and teachers are almost done, they will ease the work “live chats” are not used as much as they can be: technical difficulties for students, uncommon method of professor/student cooperation … transformation of the courses from “material repository” into “eLessons” will improve this seminar significantly. involvement of other “guest experts” from around the globe (for example, from inside this room?!?) in forums would promote the seminar, courses covered with it, and our project.