Controlling Agents with Natural Language Jared Allen 2005 University of Arkansas EiA Agent team.

Slides:



Advertisements
Similar presentations
Cyneda MODULE 1 EXAM QUESTIONS MODULE 1 EXAM QUESTIONS GCE AS GCE AS QUESTIONS QUIZ.
Advertisements

Operating Systems * Section A: Introduction * Section B: The importance of the operating system * Section C: Types of operating systems * Section D: Operating.
1 The Five Parts of an Information System
User Interface (hardware). Overview  Translate user actions into electrical control signal which controls the robot movement  Be able to input and store.
MCT260-Operating Systems I Operating Systems I Introduction to Operating Systems.
Operating Systems: Software in the Background
Information Technology
Computing ESSENTIALS     Copyright 2003 The McGraw-Hill Companies, Inc CHAPTER Information Technology, the Internet, and You computing ESSENTIALS.
Chapter 3 Software Two major types of software
Chapter 2 Hardware Trends in Computing Systems
Computers & Logic An Overview. Hardware Hardware is the equipment, or the devices, associated with a computer. For a computer to be useful, however, it.
Lesson 4 Computer Software
Chapter 1 CSF 2009 Computer Abstractions and Technology.
Introduction to Computers Personal Computing 10. What is a computer? Electronic device Performs instructions in a program Performs four functions –Accepts.
Lesson 6 Operating Systems and Software
Hardware.  Learn what hardware is  Learn different input and output devices  Learn what the CPU is.
 2008 Pearson Education, Inc. All rights reserved Introduction to Computers, the Internet and World Wide Web.
ISNE 101 Dr. Ken Cosh. Welcome to ISNE 101  Dr. Ken Cosh   Facebook – “Ken Cosh”   Don’t be Grengjai!
1 2 Basics of Computer Systems Ch.1-A,B,C FALL 2000 Rob Wolfe.
2nd Meeting Computer Essential. Can you named these parts of computer?
UNIT - 1Topic - 1. An electronic device, operating under the control of instructions stored in its own memory unit, that can accept data (input), manipulate.
Intro. to Computer Applications Instructor: Blase B. Cindric Mount Union College Spring Semester, 2002 MWF 12:00 noon - 12:50 pm KHIC 112.
Chapter I: Introduction to Computer Science. Computer: is a machine that accepts input data, processes the data and creates output data. This is a specific-purpose.
 AUTOMATION  PLC  SCADA  INSTRUMENTATION  DRIVES & MOTORS.
Relative importance Area of impact What happened! The New Role: The Widening Scope of Information Systems.
Chapter 1 Computers: Tools for an Information Age.
Spoken Dialog Systems and Voice XML Lecturer: Prof. Esther Levin.
GIANFRANCO BARBALACE Y FRANCO CAVIGLIA CATENAZZI1ºB Types and components of a computer systems.
What is a computer? Computer is a device for processing information.
The Operating System ICS3M.  The operating system (OS) provides a consistent environment for other software programs to execute commands.  It gives.
Intro to Computers Computer Applications. What is a Computer? Initially the term computer referred to an individual whose job it was to perform mathematical.
NICOLE AND LAVONTIS COMPUTER APPLICATIONS. USB Flash Drive A USB flash drive,sometimes called s pen drive or thumb drive,is a flash memory storage device.
E.g.: MS-DOS interface. DIR C: /W /A:D will list all the directories in the root directory of drive C in wide list format. Disadvantage is that commands.
J. Stover, CSD-HS.  A computer is an electronic device that is programmed to accept data (input), process it into useful information (output), and store.
ELEMENTS OF A COMPUTER SYSTEM HARDWARE SOFTWARE PEOPLEWARE DATA.
By: Dominique Vargas. Computer network Questions of computer networks.
Introduction to Computers. Are Computers Important? OF COURSE!
Software. Computers can be used to control all sorts of devices: The device follows a sequence of instructions created by the software.
Computer Components: Software Computer Technology.
Computer main parts.
© Paradigm Publishing, Inc. 4-1 Chapter 4 System Software Chapter 4 System Software.
Three Jobs of a Computer 1. Input 2. Processing 3. Output.
Different Types of HCI CLI Menu Driven GUI NLI
Adrian Janson, Melbourne High School Information Systems, Data and Information, The IPC and Organisations For VCE Software Development ¾, 2007.
HOW A COMPUTER PROCESSES DATA. What is hardware? Hardware is the electric, electronic and mechanical equipment that makes up a computer What is software?
Presentation Title 1 1/27/2016 Lucent Technologies - Proprietary Voice Interface On Wireless Applications Protocol A PDA Implementation Sherif Abdou Qiru.
Fundamentals of Information Systems, Third Edition 1 Information and Decision Support Systems: Management Information Systems Management information system.
Oman College of Management and Technology Course – MM Topic 7 Production and Distribution of Multimedia Titles CS/MIS Department.
ECE4006 Senior Design Project Linda Milor and Jay Schlag
Chapter 1: Introduction to Visual Basic.NET: Background and Perspective Visual Basic.NET Programming: From Problem Analysis to Program Design.
Introduction To Computers
What is O.S Introduction to an Operating System OS Done by: Hani Al-Mohair.
Systems Software. Systems software Applications software such as word processing, spreadsheet or graphics packages Operating systems software to control.
Sebastián Álvarez Henao.. It refers to all physical parts of a computer system; its components are: electrical, electronic, electromechanical and mechanical.
T.R.I.D.E Simon Overell (seo01) Supervisor: Keith Clark.
Chapter I: Introduction to Computer Science. Computer: is a machine that accepts input data, processes the data and creates output data. This is a specific-purpose.
computing ESSENTIALS    11 CHAPTER Information Technology, the Internet, and You computing ESSENTIALS
Java Programming: From the Ground Up
Introduction to robotics
Computer Software CS 107 Lecture 2 September 1, :53 PM.
An Introduction to Visual Basic .NET and Program Design
DT-Assessment Frame Work Term2
Unit I Flash Cards Start.
Computing Introduction.
 Is a machine that is able to take information (input), do some work on (process), and to make new information (output) COMPUTER.
Computer Electronic device Accepts data - input
Internal components of a computer.
Overview of Computer system
Integrating Educational Technology into the Classroom
Computer System.
Presentation transcript:

Controlling Agents with Natural Language Jared Allen 2005 University of Arkansas EiA Agent team

Background ● Increasing dependency upon machines - Grocery stores, household, etc. ● Complexity of devices - Examples: Thermostat, TV remote controls ● EiA vision - Everything is Alive

Natural Language ● Objective: An intuitive means of communicating and controlling electronic devices. ● Benefits - ease of use, computational power, limited hardware ● Limitations - implementation viability, scope of language

Menu-Based Natural Language Interface (MBNLI) ● Format - cascading menus, guided completion dialogue, absolute grammar coverage ● Advantages - avoids under-shooting or over-shooting the allowable language, retains ease of use

MBNLI

Components ● Grammar: The set of allowable input commands. ● Parser: The software component that keeps track of instruction progress, future options, and output to the real-world device. ● Interface: The visual element of the system that guides user input.

Input/Output ● Input: Grammar, Command String, Translation Definitions ● Output: Machine Instruction (for our purposes, this will be in XML)

Current Implementation AmigoBots

Robot Functionality ● Equipment - Sonar range devices, wireless internet adaptor, gripper ● Functionality - Move, turn, grip, release, check sonar, etc.

Example “Robot, move forward 10 feet.”

For the future... ● Larger collection of grammars ● Cooperative grammars ● Intelligent Agents (“Smart Wrappers”) ● Remote access

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.