Intelligent Tutoring System based on Belief networks Maomi Ueno Nagaoka University of Technology.

Slides:

Advertisements

Similar presentations

The Matching Hypothesis Jeff Schank PSC 120. Mating Mating is an evolutionary imperative Much of life is structured around securing and maintaining long-term.

Advertisements

Trustworthy Service Selection and Composition CHUNG-WEI HANG MUNINDAR P. Singh A. Moini.

Design of Experiments Lecture I

Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.

An RG theory of cultural evolution Gábor Fáth Hungarian Academy of Sciences Budapest, Hungary in collaboration with Miklos Sarvary - INSEAD, Fontainebleau,

Modeling Student Knowledge Using Bayesian Networks to Predict Student Performance By Zach Pardos, Neil Heffernan, Brigham Anderson and Cristina Heffernan.

Judgment and Decision Making How Rational Are We?.

Effective Skill Assessment Using Expectation Maximization in a Multi Network Temporal Bayesian Network By Zach Pardos, Advisors: Neil Heffernan, Carolina.

CSE 471/598, CBS 598 Intelligent Agents TIP We’re intelligent agents, aren’t we? Fall 2004.

M.I. Jaime Alfonso Reyes ´Cortés.  The basic task for any probabilistic inference system is to compute the posterior probability distribution for a set.

Date:2011/06/08 吳昕澧 BOA: The Bayesian Optimization Algorithm.

Hidden Markov Model 11/28/07. Bayes Rule The posterior distribution Select k with the largest posterior distribution. Minimizes the average misclassification.

Regulatory Network (Part II) 11/05/07. Methods Linear –PCA (Raychaudhuri et al. 2000) –NIR (Gardner et al. 2003) Nonlinear –Bayesian network (Friedman.

Computer vision: models, learning and inference

More RL. MDPs defined A Markov decision process (MDP), M, is a model of a stochastic, dynamic, controllable, rewarding process given by: M = 〈 S, A,T,R.

1 Bayesian Networks Chapter ; 14.4 CS 63 Adapted from slides by Tim Finin and Marie desJardins. Some material borrowed from Lise Getoor.

A Study of Computational and Human Strategies in Revelation Games 1 Noam Peled, 2 Kobi Gal, 1 Sarit Kraus 1 Bar-Ilan university, Israel. 2 Ben-Gurion university,

Author: Fang Wei, Glenn Blank Department of Computer Science Lehigh University July 10, 2007 A Student Model for an Intelligent Tutoring System Helping.

1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.

Summary of the Bayes Net Formalism David Danks Institute for Human & Machine Cognition.

1 G Lect 1a Lecture 1a Perspectives on Statistics in Psychology Applications of statistical arguments Describing central tendency and variability.

Midterm Review Rao Vemuri 16 Oct Posing a Machine Learning Problem Experience Table – Each row is an instance – Each column is an attribute/feature.

Adaptive Importance Sampling for Estimation in Structured Domains L.E. Ortiz and L.P. Kaelbling.

Optimal predictions in everyday cognition Tom Griffiths Josh Tenenbaum Brown University MIT Predicting the future Optimality and Bayesian inference Results.

The Science of Prediction Location Intelligence Conference April 4, 2006 How Next Generation Traffic Services Will Impact Business Dr. Oliver Downs, Chief.

Theoretical and Experimental Probability Today you will learn to: calculate the theoretical and experimental probabilities of an event. M07.D-S.3.1.1:

Extracting Data from Distractors R. James Milgram.

Non-Informative Dirichlet Score for learning Bayesian networks Maomi Ueno and Masaki Uto University of Electro-Communications, Japan 1.Introduction: Learning.

CPS 270: Artificial Intelligence Machine learning Instructor: Vincent Conitzer.

Simulation is the process of studying the behavior of a real system by using a model that replicates the behavior of the system under different scenarios.

Fuzzy Reinforcement Learning Agents By Ritesh Kanetkar Systems and Industrial Engineering Lab Presentation May 23, 2003.

Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 12th Bayesian network and belief propagation in statistical inference Kazuyuki Tanaka.

1 Demand for Repeated Insurance Contracts with Unknown Loss Probability Emilio Venezian Venezian Associates Chwen-Chi Liu Feng Chia University Chu-Shiu.

A Passive Approach to Sensor Network Localization Rahul Biswas and Sebastian Thrun International Conference on Intelligent Robots and Systems 2004 Presented.

LAC group, 16/06/2011. So far...  Directed graphical models  Bayesian Networks Useful because both the structure and the parameters provide a natural.

METU Informatics Institute Min720 Pattern Classification with Bio-Medical Applications Lecture notes 9 Bayesian Belief Networks.

UAIG: Second Fall 2013 Meeting. Agenda  Introductory Icebreaker  How to get Involved with UAIG?  Discussion: Reinforcement Learning  Free Discussion.

Auto Diagnosing: An Intelligent Assessment System Based on Bayesian Networks IEEE 2007 Frontiers In Education Conference- Global Engineering : Knowledge.

Slides for “Data Mining” by I. H. Witten and E. Frank.

Introduction Many organizations use decision rules to alleviate incentive problems as opposed to incentive contracts The principal typically retains some.

Assessment embedded in step- based tutors (SBTs) CPI 494 Feb 12, 2009 Kurt VanLehn ASU.

Bayesian networks and their application in circuit reliability estimation Erin Taylor.

Dynamic Programming. A Simple Example Capital as a State Variable.

Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.

Learning and Acting with Bayes Nets Chapter 20.. Page 2 === A Network and a Training Data.

Spectrum Sensing In Cognitive Radio Networks

04/21/2005 CS673 1 Being Bayesian About Network Structure A Bayesian Approach to Structure Discovery in Bayesian Networks Nir Friedman and Daphne Koller.

Is Ignoring Public Information Best Policy? Reinforcement Learning In Information Cascade Toshiji Kawagoe Future University - Hakodate and Shinichi Sasaki.

1 Structure Learning (The Good), The Bad, The Ugly Inference Graphical Models – Carlos Guestrin Carnegie Mellon University October 13 th, 2008 Readings:

Search Control.. Planning is really really hard –Theoretically, practically But people seem ok at it What to do…. –Abstraction –Find “easy” classes of.

Perfect recall: Every decision node observes all earlier decision nodes and their parents (along a “temporal” order) Sum-max-sum rule (dynamical programming):

Extracting Data from Distractors R. James Milgram.

Linear Models & Clustering Presented by Kwak, Nam-ju 1.

Graduate School of Information Sciences, Tohoku University

Maximum Expected Utility

Machine Learning for dotNET Developer Bahrudin Hrnjica, MVP

Data Mining Lecture 11.

Model Averaging with Discrete Bayesian Network Classifiers

Using Bayesian Networks to Predict Test Scores

General Gibbs Distribution

Propagation Algorithm in Bayesian Networks

CASE − Cognitive Agents for Social Environments

Luger: Artificial Intelligence, 5th edition

The Behavior of Tutoring Systems

Class #16 – Tuesday, October 26

Graduate School of Information Sciences, Tohoku University

Graduate School of Information Sciences, Tohoku University

Graduate School of Information Sciences, Tohoku University

Chapter 14 February 26, 2004.

Making Simple Decisions

Presentation transcript:

Intelligent Tutoring System based on Belief networks Maomi Ueno Nagaoka University of Technology

Advantages of ITS in probabilistic approaches Mathematical analysis of the system behaviors. Mathematical approximation for convenient calculation

Decision making approaches to describe a teachers behavior Assumption A Teacher behaves to maximizes the following expected utility. Expected Utility = ΣUtility×Probability

Probability model to describe human behaviors Tversky A. and Kahneman,D. 3 Tversky A. and Kahneman,D. 4 Tversky A. and Kahneman,D. 83 Simon H.A. and etc. It is impossible to describe human behaviors by using Probabilistic approaches.

Rationality Human is Rational.(probabilistic approaches) vs. Human is not Rational.(has pointed out, and seems right.)

Purposes of this study What is the utility of a teachers behavior? This paper tries to describe a teachers behavior as a simple function.

Relational works Reye, J. (1986)A belief net backbone for student modeling, Proc of Intelligent Tutoring System, pp R. Charles Murray and Kurt VanLehn (2000) DD Tutor:A decision-Theoretic, Dynamic approach for Optimal Selection of Tutorial Actions, Proc of Intelligent Tutoring System, pp

Unique features of this paper A simple utility function: Changes of the predictive student model Teachers Prior knowledge An exact parameterization of Bayesian student modeling : Predictive distribution of Bayesian networks.

Student model Bayesian Belief networks

Prior distribution as a Prior Knowledge Dirichret distribution,which is a conjecture distribution of the Bayesian networks

Predictive distribution as a student model

Teachers actions Instruction corresponding to the js node. Ask a question corresponding to the js node.

Select the action to maximize utility function Expected Value of Instruction Information (EVII)

Stopping rule EVII < Probability propagation Given Instruction frame j P(x j ) p(x j =1 | x 1 =1, x 2 =1, x j-1 =1)=1 Given question frame j P(x j ) x j =1 :right answer 0:wrong answer

Examples Data: 248 Junior high school students test data

Prior parameter n 1 <n 0 P(root) = 0.0 When a teacher know that the student knowledge is poor

Strategy Bottom Up strategy (from the easy material to the difficult material) Instruction frames

Prior parameter n 1 >n 0 P(top)=1 When a teacher know that the student knowledge is excellent, Top down strategy The system presents the difficult question. If the student provides wrong answer, then the system presents more easy question and instruction.

Prior parameter n 1 =n 0 When a teacher have no knowledge about the student knowledge Flexible strategies

Strategy Diagnose the student knowledge states Then, the system instructs knowledge which student can not understand by using the bottom-up strategy.

Conclusions The prior knowledge for the student Prediction of students knowledge A simple utility function: How can the teacher change the students predicted knowledge states.

Future tasks We are developing large scale ITS based on this study. How can we evaluate the behaviors of the system? Good or bad?