Current State of Play Cognitive psychology / neuroscience: –Increasingly rigorous models of individual decision making –Virtual ignorance (and ignoring)

Slides:



Advertisements
Similar presentations
Hierarchical Reinforcement Learning Amir massoud Farahmand
Advertisements

Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Engineering Systems Analysis for Design Richard de Neufville © Massachusetts Institute of Technology Asphalt vs. Concrete Example Slide 1 of 18 Asphalt.
Questions?. Setting a reward function, with and without subgoals Difference between agent and environment AI for games, Roomba Markov Property – Broken.
COSC 878 Seminar on Large Scale Statistical Machine Learning 1.
1 Teck H. Ho April 8, 2004 Outline  In-Class Experiment and Motivation  Adaptive Experience-Weighted Attraction (EWA) Learning in Games: Camerer and.
M ☺ deling of User Behavior In Matching Task Based on Previous Reward History and Personal Risk Factor April 1, 2004 Helen Belogolova Amy Daitch.
R. S. Sutton and A. G. Barto: Reinforcement Learning: An Introduction 1 Chapter 2: Evaluative Feedback pEvaluating actions vs. instructing by giving correct.
Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007.
Soar-RL and Reinforcement Learning Introducing talks by Shiwali Mohan, Mitchell Keith Bloch & Nick Gorski.
XYZ 6/18/2015 MIT Brain and Cognitive Sciences Convergence Analysis of Reinforcement Learning Agents Srinivas Turaga th March, 2004.
1 Hybrid Agent-Based Modeling: Architectures,Analyses and Applications (Stage One) Li, Hailin.
Simulation Models as a Research Method Professor Alexander Settles.
Psychological Theories
Introduction to Multivariate Research & Factorial Designs
Reinforcement Learning (1)
The Discrete Emotions Theory Controversy in Psychology and Relevance to Consumer Behavior Louis Daily, Fiona Sussan, and Norris Krueger University of Phoenix.
Study Design and Efficiency Tom Jenkins Catherine Mulvenna.
Chapter 1 Introduction to Human Behavior. What is Behavior? What is meant by Human Behavior? Examples of human behavior and activities Factors affecting.
Institute for Theoretical Computer ScienceCGAIDE, Reading UK, 10 th November 2004 Reinforcement Learning of Strategies for Settlers of Catan Michael Pfeiffer.
Curious Characters in Multiuser Games: A Study in Motivated Reinforcement Learning for Creative Behavior Policies * Mary Lou Maher University of Sydney.
Strategy Implementation
STAR Typology (Not a Theory)
Second World Congress on Positive Psychology (July 23-26, 2011; Philadelphia, Pennsylvania, USA) Choice as self-orientation activity in real life situations.
What Is Perception, and Why Is It Important?
Lyle Ungar, University of Pennsylvania Learning and Memory Reinforcement Learning.
Machine Learning Chapter 13. Reinforcement Learning
Reinforcement Learning
Affective Computing: Agents With Emotion Victor C. Hung University of Central Florida – Orlando, FL EEL6938: Special Topics in Autonomous Agents March.
1 Dr. Itamar Arel College of Engineering Electrical Engineering & Computer Science Department The University of Tennessee Fall 2009 August 24, 2009 ECE-517:
The Seven Habits of Highly Effective Researchers Richard T. Watson The University of Georgia
Advanced Decision Architectures Collaborative Technology Alliance A Computational Model of Naturalistic Decision Making and the Science of Simulation Walter.
Drug Abuse & Addiction Objectives:
Reinforcement Learning for Spoken Dialogue Systems: Comparing Strengths & Weaknesses for Practical Deployment Tim Paek Microsoft Research Dialogue on Dialogues.
Learning Theory Reza Shadmehr & Jörn Diedrichsen Reinforcement Learning 1: Generalized policy iteration.
Methodological Problems in Cognitive Psychology David Danks Institute for Human & Machine Cognition January 10, 2003.
Scientific Process METHODS Question to Experimental Design to Data Analysis.
Design Principles for Creating Human-Shapable Agents W. Bradley Knox, Ian Fasel, and Peter Stone The University of Texas at Austin Department of Computer.
Reinforcement Learning Ata Kaban School of Computer Science University of Birmingham.
© J. Rudy, Organizational Behavior, FMCU, Fall 2007 Groups In Organization OBJECTIVES: A.GROUPS- DEFINITION AND ROLES -STAGES (EVOLUTION) - TYPES - NORMS.
Knowledge and Performance using Inter-Organizational Systems.
Cognitive Modeling / University of Groningen / / Artificial Intelligence |RENSSELAER| Cognitive Science CogWorks Laboratories › Christian P. Janssen ›
© D. Weld and D. Fox 1 Reinforcement Learning CSE 473.
Behavioral Intention Formation in Knowledge Sharing: Examining the Roles of Extrinsic Motivators, Social- Psychological Forces and Organizational Climate.
Class 2 Please read chapter 2 for Tuesday’s class (Response due by 3pm on Monday) How was Piazza? Any Questions?
Cognition © POSbase 2003Contributor Cognition denotes to acts or processes involved in the acquisition, transformation, retrieval, and use of knowledge.
Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.
Retraction: I’m actually 35 years old. Q-Learning.
Reinforcement Learning
WHS AP Psychology Unit 5: Learning (Behaviorism) Essential Task 5-5: Describe the essential characteristics of insight learning, latent learning, and observational.
Temporal Discounting of Various Gift Cards Kathryn R. Glodowski, Rochelle R. Smits, & Daniel D. Holt Psychology Department, University of Wisconsin-Eau.
RADHA-KRISHNA BALLA 19 FEBRUARY, 2009 UCT for Tactical Assault Battles in Real-Time Strategy Games.
Using MDP Characteristics to Guide Exploration in Reinforcement Learning Paper: Bohdana Ratich & Doina Precucp Presenter: Michael Simon Some pictures/formulas.
Abstract LSPI (Least-Squares Policy Iteration) works well in value function approximation Gaussian kernel is a popular choice as a basis function but can.
R. Brafman and M. Tennenholtz Presented by Daniel Rasmussen.
Neural correlates of risk sensitivity An fMRI study of instrumental choice behavior Yael Niv, Jeffrey A. Edlund, Peter Dayan, and John O’Doherty Cohen.
REINFORCEMENT LEARNING Unsupervised learning 1. 2 So far ….  Supervised machine learning: given a set of annotated istances and a set of categories,
Mechanisms of Simple Perceptual Decision Making Processes
Reinforcement Learning (1)
An Overview of Reinforcement Learning
Harm van Seijen Bram Bakker Leon Kester TNO / UvA UvA
Dr. Unnikrishnan P.C. Professor, EEE
Chapter 2: Evaluative Feedback
CS 188: Artificial Intelligence Spring 2006
What comes to mind when you think about Psychology?
Computational Aspects of Emotion in Adaptive Behavior
Chapter 2: Evaluative Feedback
World models and basis functions
Reinforcement Learning (2)
Presentation transcript:

Current State of Play Cognitive psychology / neuroscience: –Increasingly rigorous models of individual decision making –Virtual ignorance (and ignoring) of social factors Social psychology: –Rich phenomenology and qualitative analysis of social factors influencing individual and group decision making –Relative absence of formal models

Goals Construct simple decision making tasks, for which we have a well specified (formal) models, in which we can control and examine social factors that affect performance Understand the influence of social factors/interactions on individual and group performance in terms of formally rigorous models of decision making

A decision task A B

Simple reward structure % A Reward Reward A Reward B Average

More interesting structure (“Rising Optimum Task”) % A Reward Reward A Reward B Average

Advantages Existing formal model of decision process –Stochastic choice based on biased DDM –Biases accrue based on reinforcement (temporal differences) learning algorithm Useful for studying exploration vs. exploitation –Task parameters can be titrated so that most subjects find the local maximum but some (who explore) find global maximum Laboratory controlled environment for studying social factors –Parameterize so that most subjects find local maximum –Control flow of social information (e.g., choices made and/or rewards received by other players) and examine influences on group vs. individual behavior (comparison) –Amenable to formal modeling (e.g., counterfactual RL)