Evaluating the Effectiveness of Feedback in SQL-Tutor Antonija Mitrovic, Brent Martin Intelligent Computer Tutoring Group Computer Science Department University.

Slides:

Advertisements

Similar presentations

Web Passive Voice Tutor: an Intelligent Computer Assisted Language Learning System over the WWW Maria Virvou & Victoria Tsiriga Department of Informatics,

Advertisements

A quasi-experimental comparison of assessment feedback mechanisms Sven Venema School of Information and Communication Technology.

The HELM Project: Helping Engineers Learn Mathematics

An Individualized Web-Based Algebra Tutor D.Sklavakis & I. Refanidis 1 An Individualized Web-Based Algebra Tutor Based on Dynamic Deep Model Tracing Dimitrios.

Presenters: Goce Armenski Institute of Informatics, Faculty of Science and Mathematics, St. Cyril and Methodius University, Skopje, MACEDONIA

GIS Career Awareness Learning Modules Development, Use, and Assessment April 16, 2007, San Diego San Diego State University National Visiting Committee.

Lecture 1: IntroductionIntro to IT COSC1078 Introduction to Information Technology Lecture 2 Overview James Harland

CS CS 5150 Software Engineering Lecture 12 Usability 2.

Toward the extraction of production rules for solving logic proofs Tiffany Barnes, John Stamper Computer Science.

Adaptive Hypermedia 2ID20

Lecture 1: IntroductionIntro to IT COSC1078 Introduction to Information Technology Lecture 1 Introduction James Harland

Engineering thesis (title) Networking solutions (subtitle) Name of student TI10S (Name of course, supervisor, etc.)

Pear Software e-SATA (The Electronic Spreadsheet Automated Teaching Assistant) Requirements Specification.

Developing Web-based GIS CAREER awareness modules for high school students Paper Session : Developing Resources Ming-Hsiang (Ming) Tsou, Ph.D. Associate.

Emergence of the internet. Basics of internetworking UC Santa Cruz CMPS 10 – Introduction to Computer Science

Challenge the future Delft University of Technology Interactive Environments Minor Introduction.

Intelligent Tutors for All: the Constraint-based Approach Tanja Mitrovic Intelligent Computer Tutoring Group University of Canterbury.

ETH Initiative – Project FoodCASE Research on Data Quality of Scientific Database Systems by Example of Food Composition Databases Karl Presser.

Katherine Don, Michael Dewsnip, Chi-Yu Huang Workshop on the Greenstone Digital Library Software Open source system.

Source: Erica MelisLeActiveMath Language-enhanced, user-adaptive, interactive eLearning for Mathematics Erica Melis Competence Center for Technology-Enhanced.

Determining the Significance of Item Order In Randomized Problem Sets Zachary A. Pardos, Neil T. Heffernan Worcester Polytechnic Institute Department of.

1 Cecil Training Cecil 1- An Overview. 2 Seminar Objectives What is Cecil? A Brief History of Cecil Utilization of Cecil within UoA Functions Available.

Interfacing the LEGO RCX to the outside world John M. Larkin Whitworth College Spokane, WA.

Developing a Framework for Problem Solving Computer Coaches Presenter: Evan Frodermann University of Minnesota – Twin Cities Collaborators: Qing (Xu) Ryan,

Learning SQL with a Computerized Tutor (Centered on SQL-Tutor) Antonija Mitrovic (University of Canterbury) Presented by Danielle H. Lee.

CSE 436 Software Engineering Workshop Course Overview Christopher Gill CSE 436 January 2007 Department of Computer Science and Engineering.

Developing.NET Web Service- based Architectures with Aspect-Oriented Component Engineering Santokh Singh 1, Professor John Grundy 1,2 and Professor John.

Review of Activities of Working Group for Database Systems Prof. Dr Slobodanka Đorđević-Kajan.

ERGM 1413 Programming and Playing with Intelligent Robots Prof. K.H. Wong Robot building v4.7b1.

CAPIT: An Intelligent Tutoring System for Capitalisation and Punctuation ICTG Group Department of Computer Science University of Canterbury.

New Advanced Higher Subject Implementation Events Computing Science Advanced Higher Course Assessment.

KJC001 (sp2015.ppt – May 12, 2015) – Industry senior project presentation Industry-based Senior Project in the Department of Computer Science and Engineering.

Course Assessment SL External Assessment (Exam): 70% Paper 1 (Sections 1-4): 45% Paper 2 (Options paper): 25% Internal Assessment (Projects): 30% Solution:

Peer review systems, e.g. SWoRD [1], need intelligence for detecting and responding to problems with students’ reviewing performance E.g. problem localization.

 hd.jpg hd.jpg Information Retrieval and Interaction.

Lecture 1: IntroductionIntro to IT COSC1078 Introduction to Information Technology Lecture 1 Introduction James Harland

Tutoring & Help System CSE-435 Nicolas Frantzen CSE-435 Nicolas Frantzen.

What’s Right with Undergraduate Statistics? Exciting Course Options.

15 August, 2005IEEE IRI Web Based Expert System for Class Schedule Planning using JESS Ken Ho Hewlett Packard Company Meiliu Lu Department of Computer.

SOFTWARE ENGINEERING MCS-2 LECTURE # 4. PROTOTYPING PROCESS MODEL  A prototype is an early sample, model or release of a product built to test a concept.

Chemistry Fundamentals Overview. What is Chemistry anyway?  Chemistry is really the study of everything and everyone.  It is an important subject to.

Reactive learning Objects for Distributed e-Learning environments Patrick Duval, Agathe Merceron, Michel Scholl Computer Science Department Engineering.

Project Demonstration Template Computer Science University of Birmingham.

University of Macau Faculty of Science and Technology Computer and Information Science SFTW 241 Programming Languages Architecture 1 Group B5.

Figure 1. Animal science (food animals), equine science and total* departmental majors since the establishment of the equine major in *does not include.

The Solutions Team Members: Joe Greubel Pooja Modi Prahlad Venkatesh.

SFTW241 Programming Languages Architecture 2002~2003 Semester II Duration: 2003/2/11~ 2003/4/11 University of Macau Faculty of Science and Technology Computer.

A simulated student-player in support of the authoring process in a knowledge-based authoring tool for educational games Maria Virvou, Konstantinos Manos.

SharePoint Saturday SharePoint 2010 BI Insights Saturday, 16 th October, 2010 MIC - Kuwait.

Engineering Design Process: Overview Created by The North Carolina School of Science and Math.The North Carolina School of Science and Math Copyright 2012.

Retrieve the names of all senior students majoring in 'COSC' (computer science). SELECT Name FROM STUDENT WHERE Major='COSC'

Evaluation of Speak Project 2b Due: March 20 th, in class.

Dept. Computer Science, Korea Univ. Intelligent Information System Lab. 1 In-Jeong Chung Intelligent Information System lab. Department.

Quick Survey Results UCT Department of Computer Science Computer Science 1015F Hussein Suleman March 2009.

Accelerated B.S./M.S An approved Accelerated BS/MS program allows an undergraduate student to take up to 6 graduate level credits as an undergraduate.

Automated feedback in statistics education

COM Masters of Science in Medical Science Master’s Examination*

Presenter: Guan-Yu Chen

Chemistry Fundamentals

CS 351d Human-computer interaction Lecture 01 Introduction

Human computer interaction-com 402

CSE 431 Computer Architecture Fall Lecture 15: Midterm Exam Review

Project Title This is a sample slide layout

Midterm Evaluations Results from CELT

Lecture 01: Introduction

National University of Laos

CS 580 Human-computer interaction Lecture 01 Introduction

T. Trimpe Science Scramble Science Experiments T. Trimpe

Recapitulation of Lecture 13

COSC 3480 Projects & Homeworks Fall 2003

Presentation transcript:

Evaluating the Effectiveness of Feedback in SQL-Tutor Antonija Mitrovic, Brent Martin Intelligent Computer Tutoring Group Computer Science Department University of Canterbury Christchurch, New Zealand

Overview SQL-Tutor Feedback types Evaluation study Results

Architecture of the standalone version of SQL-Tutor

SQLT-Web: a Web-enabled SQL tutor Interface developed in CL HTTP-server Used in COSC courses since 1999 Open for outside users on March 29, 2000

Architecture of SQLT-Web

Feedback types Positive/negative Error flag Hint All errors Partial solution Complete solution

Hypothesis: Positive/negative and Error flag too general Low-level feedback contraproductive (partial and complete solution) Constraint-based feedback most effective (hint and all errors)

Evaluation study COSC313, May 1999 (Web) Single 2-hour session 6 lectures + 8 hours of labs 33 students

Three groups: Detailed (complete and partial solution) General (hint and all errors) Limited (pos/neg and error flag)

Results 1 GroupSolved (%)NoAttemptsTime/attempt Detailed s General s Limited s Difference in times is significant

Results 2 FeedbackConstSuccFailLearnCorr (%) Pos/neg %78.0 Error flag %81.8 Hint %74.4 All errors %80.0 Partial %91.6 Full sol %44.2

Initial learning rate All errors0.44 Error Flag0.40 Pos/Neg0.29 Hint 0.26 Partial0.15 Full solution0.13

Conclusions General feedback is most effective Detailed feedback is detrimental to learning Feedback level needs to be adapted