1. Utility of Learning Management Systems for Institutes of higher Education Dr. Gerrit Tamm Holger Ziekow Institute of Information Management, University St.Gallen Institute of Information Systems, Humboldt University Berlin

2. Utility of Learning Management Systems for Institutes of higher Education 2 Motivation Need for improvements in education Need for managed distribution of information LMS are seen as a chance for institutes of higher education Need for a generic, holistic approach for the evaluation of LMS

3. Utility of Learning Management Systems for Institutes of higher Education 3 Structure Conceptual framework o Definitions o The Analysis of Processes Evaluation o Strategy o Lecturers Perspective o Students Perspective o Practical Test Conclusion

4. Utility of Learning Management Systems for Institutes of higher Education 4 Definition of LMS “A Learning Management System is software that automates the administration of training events. All Learning Management Systems manage the log-in of registers users, course catalogs, record data from learners, and provide reports to management. There used to be a distinction between Learning Management Systems and more powerful Integrated Learning Management Systems. That distinction has now disappeared. The term Learning Management System is now used to describe a wide range of applications that track student training and may or may not include functions such as: authoring, classroom management, competency management, knowledge management, certification or compliance training, personalization, mentoring,chat, discussion boards.” “A Learning Management System is software that automates the administration of training events. All Learning Management Systems manage the log-in of registers users, course catalogs, record data from learners, and provide reports to management. There used to be a distinction between Learning Management Systems and more powerful Integrated Learning Management Systems. That distinction has now disappeared. The term Learning Management System is now used to describe a wide range of applications that track student training and may or may not include functions such as: authoring, classroom management, competency management, knowledge management, certification or compliance training, personalization, mentoring, chat, discussion boards.”

5. Utility of Learning Management Systems for Institutes of higher Education 5 Central administration Curricular activities Central administration Curricular activities Academic programs Administration of studies Gathering of information Gathering of information The Analysis of processes Primary Activities Secondary Activities Archiving Preparation of information Preparation of information Distribution of information Distribution of information Evaluation

6. Utility of Learning Management Systems for Institutes of higher Education 6 Strategy of the Evaluation Practical Tests Analysis of Processes Value Chain Empirical Studies Evaluation Conclusions

7. Utility of Learning Management Systems for Institutes of higher Education 7 Empirical Studies Questionnaire addressing Lecturers o General conditions for the introduction of LMS o Investigation of psychological aspects and peculiarity of processes Questionnaire addressing Students o Students need for LMS o Most desired functions

8. Utility of Learning Management Systems for Institutes of higher Education 8 Empirical Study addressing Lecturers All professors and scientific assistants of the Humboldt-University of Berlin addressed About 1800 persons were contacted 208 lecturers responded, covering 11,5%

9. Utility of Learning Management Systems for Institutes of higher Education 9 Current peculiarity of processes Lecturers frequent use seldom use

10. Utility of Learning Management Systems for Institutes of higher Education 10 Current peculiarity of processes Lecturers frequent use seldom use

11. Utility of Learning Management Systems for Institutes of higher Education 11 Current peculiarity of processes Lecturers frequent use seldom use

12. Utility of Learning Management Systems for Institutes of higher Education 12 Current peculiarity of processes Lecturers frequent use seldom use

13. Utility of Learning Management Systems for Institutes of higher Education 13 Current peculiarity of processes Use of modern technology polarizes the lecturers The frequency of use is higher for simple functions Many lecturers are already using modern technology in a number of processes

14. Utility of Learning Management Systems for Institutes of higher Education 14 100 Lecturers Usage of Google frequent use seldom use 45 Lecturers Usage of information portals frequent use seldom use 30 Lecturers Digital slides in lectures 100 % 0 % 25 Lecturers Submission of homework per e-mail frequent use seldom use

15. Utility of Learning Management Systems for Institutes of higher Education 15 Psychological Aspects General attitude towards LMS Expectations Fears and prejudices

16. Utility of Learning Management Systems for Institutes of higher Education 16 40 Lecturers I will use LMS frequently agreementdisagreement 50 Lecturers LMS is a good thing university should put an effort on agreementdisagreement 40 Lecturers I will have no time to use an LMS agreementdisagreement 50 Lecturers LMS will ease administration agreementdisagreement

17. Utility of Learning Management Systems for Institutes of higher Education 17 Psychological Aspects General positive attitude towards LMS Concerns regarding usability Concerns regarding time

18. Utility of Learning Management Systems for Institutes of higher Education 18 Empirical Study addressing Students Most desired functions were investigated More than 70 students answered the questionnaire Setting Results Most desired functions preparation tests available online detailed information about courses grades of the exams online books and articles in hyperlinked version online corrected solution of the exam Focus on simple functionality Overall high demand for internet based support

19. Utility of Learning Management Systems for Institutes of higher Education 19 Practical Test Seven institutes of the HU participated in the test Five Systems where available for the testers Blackboard Oracle iLearning WebCT imc CLIX Campus Sumatra System 3 Systems where provided as ASP-solutions

20. Utility of Learning Management Systems for Institutes of higher Education 20 Practical Test Four of seven institutes had to stop testing early getting familiar with the system took too much time lecturers where unable to integrate the system in the lessons The other institutes complained about serious problems usage appeared to be complicated getting familiar with the system was very time consuming none of the testers recommended the used system

21. Utility of Learning Management Systems for Institutes of higher Education 21 Conclusions General conditions for LMS are good Just providing an LMS is insufficient Functions do not easily match with universities processes Three aspects appeared to be most critical Occupation of Time Usability Integration in lectures (using LMS for desired functions)

22. Utility of Learning Management Systems for Institutes of higher Education 22 Conclusions LMS is not just a matter of software Holistic information management is needed Successful introduction needs support Training Road shows for information Support while introduction (matching with processes) Support for usage-problems Technical service LMS are a chance for central institutions

23. Utility of Learning Management Systems for Institutes of higher Education 23 Thank you for your attention Dr. Gerrit Tamm Institute of Information Management University St.Gallen CH-9000 St.Gallen, Switzerland E-mail: gerrit.tamm@unisg.ch Holger Ziekow Institute of Information Systems Humboldt-University of Berlin 10178 Berlin, Germany E-mail: ziekow@wiwi.hu-berlin.de