BehaviorNet An Action Selection Mechanism Aregahegn Negatu And Conscious Software Research Group.

Slides:



Advertisements
Similar presentations
Pat Langley School of Computing and Informatics Arizona State University Tempe, Arizona USA Modeling Social Cognition in a Unified Cognitive Architecture.
Advertisements

Information Processing Technology Office Learning Workshop April 12, 2004 Seedling Overview Learning Hierarchical Reactive Skills from Reasoning and Experience.
ARCHITECTURES FOR ARTIFICIAL INTELLIGENCE SYSTEMS
Exam 1 Review Purpose: Identify Themes Two major sections –Defining Social Psychology and Research Methods –Social Perception.
Architecture-dependent optimizations Functional units, delay slots and dependency analysis.
By Philippe Kruchten Rational Software
Data Structures: A Pseudocode Approach with C
CogSciSem Stan Franklin Deliberation and Voluntary Action Stan Franklin and the Conscious Software Research Group.
Banbury 5/15/01 Stan Franklin "Conscious" Software Agents” Can they be (or are they) Sentient? Stan Franklin and the “Conscious” Software Research Group.
Background to the IDA Model Stan Franklin and the ‘Conscious’ Software Research Group Machine Consciousness Workshop, Torino, Fall 2003.
© 2006 ITT Educational Services Inc. SE350 System Analysis for Software Engineers: Unit 9 Slide 1 Appendix 3 Object-Oriented Analysis and Design.
Rule Based Systems Michael J. Watts
CogSciSem Stan Franklin Working Memory Tasks Cognitive Science Seminar—Spring 2003 Stan Franklin.
Embedded System Lab Kim Jong Hwi Chonbuk National University Introduction to Intelligent Robots.
Object-Oriented Analysis and Design
Functioning Mind Stan Franklin A “Consciousness” Based Architecture for a Functioning Mind Stan Franklin and the Conscious Software Research Group Institute.
Artificial Intelligence Chapter 11: Planning
L4-1-S1 UML Overview © M.E. Fayad SJSU -- CmpE Software Architectures Dr. M.E. Fayad, Professor Computer Engineering Department, Room #283I.
A Summary of the Article “Intelligence Without Representation” by Rodney A. Brooks (1987) Presented by Dain Finn.
Modelling Hybrid Control Systems with Behaviour Networks Pierangelo Dell’Acqua Anna Lombardi Dept. of Science and Technology - ITN Linköping University,
Polyscheme John Laird February 21, Major Observations Polyscheme is a FRAMEWORK not an architecture – Explicitly does not commit to specific primitives.
Psychology of Music Learning Miksza Memory Processes.
Object-oriented Programming Concepts
Introduction to Affect and Cognition Copyright © 2005 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Chapter 3.
The Need of Unmanned Systems
Towards A Multi-Agent System for Network Decision Analysis Jan Dijkstra.
Chapter 4 Learning: Theories and Program Design
© 2006 Cisco Systems, Inc. All rights reserved. ICND v2.3—3-1 Determining IP Routes Introducing Link-State and Balanced Hybrid Routing.
What is Software Architecture?
Facilitate Flow in the Internet Shopping Yi (Maggie) Guo Arun Sen, Ph. D. April 5 th, 2003.
Distributed Constraint Optimization Michal Jakob Agent Technology Center, Dept. of Computer Science and Engineering, FEE, Czech Technical University A4M33MAS.
Dimensions of Human Behavior: Person and Environment
An Architecture for Empathic Agents. Abstract Architecture Planning + Coping Deliberated Actions Agent in the World Body Speech Facial expressions Effectors.
PSI Theory Basic Concepts. PSI concepts Motivation –Five basic needs drive behaviour –From basic needs, intentions are built Action Regulation –Intention.
IDA: A Cognitive Agent Architecture Lisa Soros. Outline Machine Consciousness Global Workspace Theory IDA: A Cognitive Agent Architecture.
CPSC 871 John D. McGregor Module 6 Session 3 System of Systems.
Patterns and Reuse. Patterns Reuse of Analysis and Design.
A Software Agent with a Self? Machine Consciousness: Complexity Aspects 29 Sept to 1st October '03, ISI, Torino, Italy Stan Franklin and the “Conscious”
Intelligent Agents RMIT Prof. Lin Padgham (leader) Ass. Prof. Michael Winikoff Ass. Prof James Harland Dr Lawrence Cavedon Dr Sebastian Sardina.
The LIDA model’s hypotheses on the cognitive cycle, high-level cognitive processes, and brain rhythms Who”s IDA Stan Franklin.
Example: object diagram for Scheduler, v What is wrong with this diagram? Seems like a lot of similarity between Task and UnplannedTask Can use.
Memory Hierarchy Adaptivity An Architectural Perspective Alex Veidenbaum AMRM Project sponsored by DARPA/ITO.
AI Lecture 17 Planning Noémie Elhadad (substituting for Prof. McKeown)
Distributed Models for Decision Support Jose Cuena & Sascha Ossowski Pesented by: Gal Moshitch & Rica Gonen.
Multiagent System Katia P. Sycara 일반대학원 GE 랩 성연식.
Fluid Concept Architectures An experimentation platform.
How conscious experience and working memory interact Bernard J. Baars and Stan Franklin Soft Computing Laboratory 김 희 택 TRENDS in Cognitive Sciences vol.
Operating Systems Unit 2: – Process Context switch Interrupt Interprocess communication – Thread Thread models Operating Systems.
IHP Im Technologiepark Frankfurt (Oder) Germany IHP Im Technologiepark Frankfurt (Oder) Germany ©
WP6 Emotion in Interaction Embodied Conversational Agents WP6 core task: describe an interactive ECA system with capabilities beyond those of present day.
Summary for final exam Agent System..
Dimensions of Human Behavior: Person and Environment Chapter 4 The Psychological Person: Cognition, Emotion, and Self.
Motivation, Ability, and Opportunity
Modelling and Solving Configuration Problems on Business
Knowledge Representation and Reasoning
Intelligent Agents (Ch. 2)
CHAPTER
The Movement To Objects
For Massively Parallel Computation The Chaotic State of the Art
Self-Motivated Behaviour of Autonomous Agents
Do software agents know what they talk about?
Wayne Wolf Dept. of EE Princeton University
FORM: Feature-Oriented Reuse Method
Knowledge Representation and Reasoning
Motivation, Ability, and Opportunity
Section 11.1 Class Variables and Methods
Chapter 5 The Communication Process
CIS 488/588 Bruce R. Maxim UM-Dearborn
Subsuption Architecture
Self-Managed Systems: an Architectural Challenge
Presentation transcript:

BehaviorNet An Action Selection Mechanism Aregahegn Negatu And Conscious Software Research Group

Intelligent agents Agents have Drives, agenda, primary motivation Goals, subgoals Agents live in an environment Agents continuously act in pursuit of their goals/agenda

Behavior Is a form of response to a specific environmental configuration. Such responses are modulated by the underlying goals/drives. Agents can have more than one relevant behavior in a given situation.

Action Selection Agents exhibit multiple behaviors at a time (given situation) – parallel. Not time sharing. Behaviors conflict : use same mechanism or shared resource. Agents have competing behaviors or actions.

Action Selection (cont.) Agents encounter multiple, competing, relevant behaviors to choose from. The major intelligence of an agent is used to decide “what to do next.” Franklin: Artificial minds Thus, the action-selection problem. MASM: Maes’ Action Selection Mechanism How to do the Right thing? (Maes,1990).

MASM: Behavior Behavior (Competence module) is like a production rule: Situation: precondition Action: (addition, deletion) Behavior has an activation: a level of strength.

MASM: BehaviorNet BehaviorNet is a digraph. With Behaviors as nodes, and Three types of links: Successor Predecessor Conflicter Links are determined and created by behaviors (local decision).

A behavior stream Send an Acknowledge- ment Compose an Acknowledge- ment Get address Find a Message template Acknowledged Behavior codelets From sideline Environmental activation Drive to acknowledge Goal-directing Activation

B1 a b c w y B3 w x y r s B2 c d e x z MASM: Building BehaviorNet

MASM: Activation Spreading Global goals: built-in source of motivation Environment: Situational relevance. Behaviors Activation by successors and predecessors. Inhibition by conflicters. Activation spreads in a greedy way.

MASM: Algorithm Loop for ever Add external activation from goals & environment. Spread activation/inhibition among behaviors Forward activation via successor links Backward activation via predecessor links Backward inhibition via conflicter links Decay: total activation in system is constant. Behavior fires if: It’s executable (all it’s preconditions are satisfied). It’s activation level is over a threshold (theta). It’s activation is the maximum of such.

MASM: Algorithm (cont.) If one behavior fires, its activation is set to zero. Threshold value is reset to default. If no behavior fires, reduce threshold value by x%. System “thinks” for one more round and try again.

MASM: Tuning the dynamics Action selection emerges from the dynamics of activation spreading. Tunable parameters: Amount of activation injected by environment. Amount If activation energy injected by goals. The threshold value, theta.

MASM: Characteristics Thoughtful Reactive and fast Situation-oriented and opportunistic. Goal-oriented. Persistent: biased to ongoing goal/plan. Goals interact and avoid conflicts. Robust. Some of the characteristics are not independent of each other and are tunable. Example: thoughtfulness vs. reactive.

BehaviorNet in IDA Is based on MASM. Introduces variables with instantiation mechanism. BehaviorNet has: Drives: built-in primary motivators. Importance Intensity Streams: Action plans for specific problem. Behaviors Goals

BehaviorNet in IDA (cont.) Behavior: Precondition, addition, deletion lists Activation Variable slots Underlying codelets Goals: same as behaviors but may not have codelets to underlie them Satisfaction-condition (continuous, one-time) Streams are linked as in MASM Activation spreads as in MASM

Stream examples G B1 G B2 B4B3 G1G2 B1B2 B3 B5 B4B6

Stream instantiation Template stream: no variables bound Instantiated stream: Some or all variables are bound. Underlying codelets are instantiated Is part of the dynamics in the active behavior net

Drive 1 Drive 2 Stream 2 Stream 1 Example of instantiated streams Two streams in the same context

IDA’s Architecture “Consciousness” Perception Metacognition Associative Memory Episodic Memory Behavior Net Emotions Database Perception Linear Functional DeliberationNegotiation Write Orders Conceptual & Behavioral Learning

Goal context System Behavior: a goal context. Stream: a goal context hierarchy. Executing behavior: Dominant goal context. Its stream: dominant goal context hierarchy. BehaviorNet: a hierarchical goal context system.

Goal context hierarchy G B1B2 B3 B4 B5 G B1B2 G B1 B3B2 Stream 1 Stream 2 Stream 3 D

Working with “Consciousness” G B1 Behavior Net template Working Memory Black board Stands Broadcast Sky box Sideline Playing Field

C-U-C cycle Behavior Net System Consciousness System Environment Internal States Work Space Behavior Priming Codelets Attention Codelets Behavior Codelets

Remarks Goal hierarchy instantiation With preattentive or subliminal perception With conscious event Motivation Built-in - drives Situational Significance of action has a level of informativeness Unconscious avoidance of goal conflicts Action types unconscious, consciously mediated, voluntary Drives, as the deepest component in the goal hierarchy, are part of self-concept.