Exploring edX log traces Guanliang Chen, Dan Davis, Claudia Hauff, Geert-Jan Houben Web Information Systems EEMCS, TU Delft.

Slides:

Advertisements

Similar presentations

PROBLEM-BASED LEARNING & CAPACITY BUILDING

Advertisements

Agent-Based Architecture for Intelligence and Collaboration in Virtual Learning Environments Punyanuch Borwarnginn 5 August 2013.

Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.

© Cranfield University 2008 Karen Boehnke Peesker and Javier Marcos-Cuevas Cranfield School of Management GSSI 2014 Conference Exploring Leadership Styles.

P291: Flipped Teaching in Organic Chemistry Layne A. Morsch, PhD University of Illinois Springfield 2014 Biennial Conference on Chemical Education Grand.

Genre Shift: Instructor Presence and its Impact on Student Satisfaction in Online Learning.

Engaged learning in MOOCS Julie Wintrup With research team: Kelly Wakefield, Debra Morris, Hugh Davis Funded by HEA.

Conclusion Our prediction model did a good job at predict 8 th grade math proficiency. It can be used to estimate 10 th grade score fairly well, too. But.

Investigating Relationships among Elements of Interaction, Presence, and Student Learning in a Graduate Online Course Lydia Kyei-Blankson, Department of.

Retina: Helping Students and Instructors Based on Observed Programming Activities Chris Murphy, Gail Kaiser, Kristin Loveland, Sahar Hasan Columbia University.

OnlineInset.net Ltd is a non-profit training company limited by guarantee that develops training courses to teach people who support children.

WELCOME Thank you for joining our webinar. We will begin at 1pm Eastern. Please call into the audio portion of our presentation: Dial If you.

Needs Analysis of the Meetup Function Design for Massive Open Online Course Learners in Taiwan Wei-Ting Lin, Chao-Hsiu Chen, & Wei-I Lee.

Nov 9th 2006 Determinants of Engagement in an Online Community of Inquiry Jim Waters College of Information Science and Technology Drexel University Philadelphia.

Concepts related to the quality of learning at university (from Entwistle et al., 2002).

WEB USAGE AND LEARNING STYLES IN AN ACADEMIC COURSE Moshe Leiba Rafi Nachmias Knowledge Technology Lab Science and Technology Education Center School of.

Introduction to WRESTT (WISTPC 2014:2) July 18th, FIU Main Campus A Cyber Enabled Learning Environment of Software Testing Education Supported by.

Question 1 Why did a majority of students perceive the innovative web-enhanced Japanese language courses favorably and participate in additional online.

An Empirical Study of Visual Security Cues to Prevent the SSLstripping Attack Dongwan Shin and Rodrigo Lopes In Proc. 27 th Annual Computer Security Applications.

Using A Digital Campus to Support Electronic Learning In Lebanon Presenters: Shumin Chuang Professor: Ming-Puu Chen 2008/6/26 王堯興王堯興 Schaik, P., Barker,

Gaming the System in the CALL Classroom Peter Gobel Kyoto Sangyo University

Games are Up for DVFS Yan Gu Samarjit Chakraborty Wei Tsang Ooi Department of Computer Science National University of Singapore.

Preparing and Delivering a Memorable Presentation The Canadian Institute Presentation.

Using a cognition-motivation-control view to assess the adoption intention for Web-based learning Presenter: Che-Yu Lin Advisor: Ming-Puu Chen Date: 09/30/2009.

Money Matters Financial literacy for youth By Andrea Kulkarni.

Towards Collaborative Scale. 20 million minds foundation.

Professor Jeff Haywood, Vice Principal Digital Education University of Edinburgh, UK 1 Learning.

Review Presentation Wafaa Alsaggaf S May

Massive Open Online Course

MOOCs: learners, directions & disruption Professor Jeff Haywood, Vice Principal Digital Education University of Edinburgh, UK

1 Human-Computer Interaction Usability Evaluation: 2 Expert and Empirical Methods.

Show me the data! Actionable insight from open courses.

ABSTRACT In this study, structural equation modeling is applied to examine the determinants of students’ satisfaction and their perceived learning outcomes.

Professional Development How to improve teaching skills.

Developing a Metric for Evaluating Discussion Boards Dr. Robin Kay University of Ontario Institute of Technology 2 November 2004.

Evaluation and Assessment of Instructional Design Module #4 Designing Effective Instructional Design Research Tools Part 2: Data-Collection Techniques.

The relationship between student characteristics, including learning styles, and their perceptions and satisfaction in web-based courses in higher education.

Innovation in Learning Analytics and Learning Scenarios in Clinical Psychiatry WEDNESDAY APRIL │ K1.28 Carolyn Hodgman Leading Education Initiatives,

Associate Professor Cathy Gunn The University of Auckland, NZ Learning analytics down under.

Introduction Moodle is a course management system, designed to help teachers create online courses and manage virtual interactions with their students.

Creating your course on MOODLE Learning Management System.

Recommending Self-Regulated Learning Strategies Doesn’t Improve Performance in a Massive Open Online Courses René F. Kizilcec, Mar Pérez-Sanagustín, Jorge.

Advanced Science and Technology Letters Vol.47 (Education 2014), pp Comparison of Pedagogical Effectiveness.

Use of ICT in Education for Online and Blended Learning IIT Bombay May 2016 AICTE approved Faculty Development Program.

Clickprints on the Web: Are there Signatures in Web Browsing Data?

ELEVATE YOUR TEACHING PRESENCE

Christina Petersen, PhD Center for Educational Innovation

FLIPPED CLASSROOM ACTIVITY CONSTRUCTOR – USING EXISTING CONTENT

OUT-OF-CLASS ACTIVITY CONSTRUCTOR FOR FLIPPED CLASSROOM

How do students perceive interactivity in online video

FLIPPED CLASSROOM Lesson Design-1 Array representation in main memory

FLIPPED CLASSROOM ACTIVITY CONSTRUCTOR – USING EXISTING CONTENT

FLIPPED CLASSROOM ACTIVITY CONSTRUCTOR

OUT-OF-CLASS ACTIVITY CONSTRUCTOR FOR FLIPPED CLASSROOM

Use of ICT in Education for Online and Blended Learning

Use of ICT in Education for Online and Blended Learning

FLIPPED CLASSROOM ACTIVITY -1:4 Demultiplexer

Use of ICT in Education for Online and Blended Learning

Improving MOOCs.

Meina Zhu, Curtis J. Bonk, and Annisa Sari

FLIPPED CLASSROOM ACTIVITY CONSTRUCTOR – USING EXISTING CONTENT

Transformations.

FLIPPED CLASSROOM ACTIVITY CONSTRUCTOR

OUT-OF-CLASS ACTIVITY CONSTRUCTOR FOR FLIPPED CLASSROOM

Using Conference and WeChat for Online Courses

Use of ICT in Education for Online and Blended Learning

FLIPPED CLASSROOM ACTIVITY CONSTRUCTOR – USING EXISTING CONTENT

Explaining Student Behaviour at Scale

How do students perceive interactivity in online video

On-the-spot student performance analysis through visualization

Presentation transcript:

Exploring edX log traces Guanliang Chen, Dan Davis, Claudia Hauff, Geert-Jan Houben Web Information Systems EEMCS, TU Delft

Outline 1.Transforming logs into queryable data 1.Current data-driven research lines 1.Concrete examples

edX events Watch video Answer questions Collaborate in forum discussion Filling out survey Profile information

Log trace example {"username": "hayword", "event_type": "play_video", "ip": " ", "agent": "Mozilla", "host": "courses.edx.org", "session": "4b6eed109122babdcd5d2d73b2ff7f93", "event": "{"id":"i4x-DelftX-FP101x-video-5386b7ed6da24715bb4cc2ae75df74b8", "currentTime": ,"code":"uA4J7DQ95cE"}", "event_source": "browser", "context": {"user_id": , "org_id": "DelftX", "course_id": "DelftX/FP101x/3T2014"}, "time": " T19:31: :00"} From raw logs to a data model user_id course_idDelftX/FP101x/3T2014 video_idi4x-DelftX ….

From raw logs to a data model ❏ MOOCdb Data Model developed by MIT ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

MOOCdb ❏ MOOCdb Data Model ❏ Observation Mode ❏ Submission Mode ❏ Collaboration Mode ❏ Survey Mode ❏ User Mode

research lines

Example I ❏ Guo P J, Kim J, Rubin R. How video production affects student engagement: An empirical study of mooc videos [C] // Proceedings of the first ACM conference on scale conference. ACM, 2014: ❏ Major findings ❏ Shorter videos are more engaging. ❏ Informal talking-head videos are more engaging. ❏ Instructors’ speaking rate affects engagement. ❏...

Example I ❏ Students’ engagement ❏ Time spent in watching videos ❏ # questions attempted to solve ❏ Video types ❏ Length of the video ❏ Styles of the video ❏ Instructor’s speaking rate ❏... ❏ A mix approach ❏ Quantitative analysis: correlation analysis & significance analysis ❏ Qualitative analysis: interview

❏ Li N, Kidzinski L, Jermann P, et al. How Do In-video Interactions Reflect Perceived Video Difficulty? [C] // Proceedings of the European MOOCs Stakeholders Summit PAU Education, 2015 (EPFL-CONF ): ❏ Major findings ❏ Higher pause frequency and duration reflect higher difficulty level. ❏ Less frequent or large amount of replay indicates higher difficulty level. ❏... Example II

❏ Perceived difficulty level of video ❏ Survey ❏ In-video interaction ❏ The frequency and duration of pause ❏ The frequency and duration of replay ❏ The frequency of speed up & down ❏... ❏ Approach ❏ Regression based method ❏ Significance analysis Example II

❏ Northcutt C G, Ho A D, Chuang I L. Detecting and Preventing" Multiple-Account" Cheating in Massive Open Online Courses [J]. arXiv preprint arXiv: , ❏ Major finding ❏ Multiple-Account cheating behaviour accounts for 1.3% of certificates in 69 MOOCs. Example III

❏ Data being used ❏ Question submission ❏ Time information ❏ IP address ❏ A mixed approach ❏ Bayesian filter ❏ Manually-developed filters Example III

Take-home messages ❏ The edX log traces can be translated into queryable data by adopting the MOOCdb data model developed by MIT. ❏ Most of the existing data-driven research in MOOC are about learners.

The end Thank you! Web Information Systems