10/1/201615-494 Cognitive Robotics1 Affordances 15-494 Cognitive Robotics David S. Touretzky & Ethan Tira-Thompson Carnegie Mellon Spring 2006.

Slides:



Advertisements
Similar presentations
Human [computer] interfaces - the car CSC 8008 John Shearer
Advertisements

Problem to motivate and unify the semester’s work The two assignments related to this problem.
Carnegie Mellon University School of Computer Science Carnegie Mellon University School of Computer Science Cognitive Primitives for Mobile Robots Development.
© 2006 Carnegie Mellon Robotics Academy Designed for use with the LEGO MINDSTORMS ® Education NXT Software and Base Set #9797 Mine Mapping Choose a Sensor.
CISB213 Human Computer Interaction Design Principles
CS 235: User Interface Design March 5 Class Meeting Department of Computer Science San Jose State University Spring 2015 Instructor: Ron Mak
Part 2c: Requirements Chapter 2: How to Gather Requirements: Some Techniques to Use Chapter 3: Finding Out about the Users and the Domain Chapter 4: Finding.
SIMS 213: User Interface Design & Development Marti Hearst Thurs, Feb 10, 2005.
Design of Everyday Things
SIMS 213: User Interface Design & Development Marti Hearst Tues, Feb 10, 2004.
Introduction What is this ? What is this ? This project is a part of a scientific research in machine learning, whose objective is to develop a system,
Human Factors Psychology Aside on Affordances PSY-4340/PSY-5340, Dr. William Langston, MTSU.
Introduction to HCI Marti Hearst (UCB SIMS) SIMS 213, UI Design & Development January 21, 1999.
SIMS 213: User Interface Design & Development Marti Hearst Tues, Feb 11, 2003.
1 Affordance and the Value of Housing Paull Robathan
1 Perception, Illusion and VR HNRS 299, Spring 2008 Lecture 19 Other Graphics Considerations Review.
1 Perception and VR MONT 104S, Spring 2008 Lecture 22 Other Graphics Considerations Review.
Conceptual Models & Interface Metaphors. Objectives By the end of this class, you will be able to… Define conceptual model Identify instances where the.
William H. Bowers – Metaphors, Idioms and Affordances Cooper 20.
Spring /6.831 User Interface Design and Implementation1 Lecture 3: Visibility.
A Model of Object Permanence Psych 419/719 March 6, 2001.
Mestrado em Informática Médica SIntS 13/14 – T5 Design Concepts Miguel Tavares Coimbra.
Design of Everyday Things. Grade summaries Assignments 1-4 (out of 10) P0 (out of 10) P1 group grade (out of 100) P1 individual grade (out of 50) Midterm.
Computer Programs and Programming Languages What are low-level languages and high-level languages? High-level language Low-level language Machine-dependent.
Moon Phase Lesson Plan 4th Grade
 A push  A pull  A twist  Using a spring balance  The unit forces are measured in is the newton (after Sir Isaac Newton)  The symbol for a newton.
Information: Perception and Representation Lecture #7 Part A.
CC111 Lec7 : Visual Basic 1 Visual Basic(1) Lecture 7.
The Design of Everyday Things Darn these hooves! I hit the wrong switch again! Who designs these instrument panels, raccoons?
Do these make any sense?. Navigation Moving the viewpoint as a cost of knowledge.
Sentry System Multiple Sensors
Cognitive Walkthrough More evaluating with experts.
Using IR For Maze Navigation Kyle W. Lawton and Liz Shrecengost.
Web Pedagogies Week 4: Theory of Affordances Schedule Review of last week Web-based research: some practical examples and hands- on searches Theory of.
The Design of Everyday Things Donald A. Norman. The psychopathology of everyday things Doors Doors Light switches Light switches Taps Taps Telephones.
Dieharder An Open Source Random Number Generator Tester Robert G. Brown Physics Department Duke TechExpo 2011.
9/29/ Cognitive Robotics1 Affordances Cognitive Robotics David S. Touretzky & Ethan Tira-Thompson Carnegie Mellon Spring 2009.
10/1/ Cognitive Robotics1 Object Recognition Cognitive Robotics David S. Touretzky & Ethan Tira-Thompson Carnegie Mellon Spring 2008.
Affordances Cognitive Robotics David S. Touretzky &
Chapter 4 The Laws of Motion.
Human Computer Interaction
San Diego May 22, 2013 Giovanni Saponaro Giampiero Salvi
Transformations Tamara Bonn Indian Springs High School
Chapter 8: More About OOP and GUIs
GUI Design and Coding PPT By :Dr. R. Mall.
Introduction to Computer CC111
Computer Software: Programming
Affordances Cognitive Robotics David S. Touretzky &
Object Recognition Cognitive Robotics David S. Touretzky &
Object Recognition Cognitive Robotics David S. Touretzky &
EET 2259 Unit 3 Editing and Debugging VIs
The User Lecture 2 DeSiaMore
Interface Design Human Factors.
Bell-Ringer PICK UP THE THREE THINGS AT THE FRONT (1 packet, 2 papers)
Most Effective Methods to Replace a Brake Light Switch.
CEN3722 Human Computer Interaction Knowledge and Mental Models
Continuous - Discrete Sampling Demo (CON2DIS) team
Chapter 2 Database Environment.
The Design of Everyday Things
D43 Measuring Earthquakes
In This Section We Will Be Studying These Topics:
Alice: Beyond the Basics
COMP444 Human Computer Interaction Design Principles
On Symmetry, Illusory Contours and Visual Perception
Design of Everyday Things
Force and Motion.
By Cecily flemate Freson pacific University
getting physical lots of physical devices around us
Comp 15 - Usability and Human Factors
Perception.
Presentation transcript:

10/1/ Cognitive Robotics1 Affordances Cognitive Robotics David S. Touretzky & Ethan Tira-Thompson Carnegie Mellon Spring 2006

10/1/ Cognitive Robotics2 J J Gibson ● American psychologist ( ) who worked in the area of visual perception. ● Coined the term “affordance”. ● “The affordances of the environment are what it offers the animal, what it provides or furnishes, either for good of ill.” ● In Gibson's formulation, affordances are properties of the environment, independent of the animal's perception.

10/1/ Cognitive Robotics3 Don Norman ● Cognitive scientist at UC San Diego who studied under Gibson. ● Replaced Gibson's objective affordances with the notion of perceived affordances. ● “... the term affordance refers to the perceived and actual properties of the thing, primarily those fundamental properties that determine just how the thing could possibly be used... Affordances provide strong cues to the operation of things.”

10/1/ Cognitive Robotics4 The Design of Everyday Things ● Norman's book “The Psychology of Everyday Things” helped popularize the notion of affordances. ● Later reissued with updated frontmatter as “The Design of Everyday Things”. ● Looked at examples of physical objects such as door handles and light switches.

10/1/ Cognitive Robotics5 Affordance Examples from Norman ● Plates (on doors) are for pushing. ● Knobs are for turning. ● Slots are for inserting things into. ● Balls are for throwing or bouncing. “When affordances are taken advantage of, the user knows what to do just by looking; no picture, label, or instruction needed.”

10/1/ Cognitive Robotics6 Affordances Are An Important Concept in GUI Design ● Buttons drawn as 3D shapes appear to “stick out” and hence afford pushing. ● Sliders and scroll bars afford dragging.

10/1/ Cognitive Robotics7 What Does This Have To Do with Robotics? 1. Robots must be able to deal with unfamiliar objects. – Recognizing affordances can lead them to effective strategies for interacting with objects. ● 2. Humans needs ways of instructing robots. – Language for describing object interactions would be helpful. – This is the language in which affordances are described.

10/1/ Cognitive Robotics8 Stoytchev (2005): Recognizing Tool Affordances ● Robot experiments randomly to learn the effect of actions using various tool shapes to move an orange puck.

10/1/ Cognitive Robotics9 Robert St Amant: Tool Use With the AIBO ● “Some tools seem to have the property that one can tell how they should be used just by looking and experimenting – no instruction or specialized knowledge is needed. Affordances are part of the explanation why, as is general tool-using ability.” (movie)

10/1/ Cognitive Robotics10 Recognizing Affordances ● Physical properties of the object ● Understanding how the robot's body could interface with that object. PLUS

10/1/ Cognitive Robotics11 Affordances of Known Objects ● For familiar objects such as balls, we already know a variety of strategies for interacting with them. ● Which ones are applicable depend on factors such as size and position.

10/1/ Cognitive Robotics12 Ball Affordances ● Can build a library of ball affordances. ● Write code to detect when particular ones are applicable. – push with paw – push with chest – push with head – kick ball...

10/1/ Cognitive Robotics13 Line Affordances ● Lines afford a variety of actions. – Visually trace line – Walk to line – Cross line – Touch point on line

10/1/ Cognitive Robotics14 Brick Affordances ● Brick affordances include: – Push brick to location x – Rotate brick to orientation q – Flip brick over – Stand on brick

10/1/ Cognitive Robotics15 Problems of Action Representation ● Preconditions for feasibility ● Parameterization ● Interactions between affordances ● Recognizing failures

10/1/ Cognitive Robotics16 Preconditions for Actions ● When is an action feasible? ● Example: when can we push a ball? – Must be close enough to touch the ball – Must be oriented properly to push in desired direction – Must have freedom of motion – Ball must not be obstructed ● What if we're not close enough to push? – Balls could afford “moving into position to push” actions.

10/1/ Cognitive Robotics17 Parameterized Actions ● We don't usually want to just push at random. – “Push ball in direction q” ● Do we recognize an infinite number of affordances? ● Special cases? – Push ball toward object/landmark x

10/1/ Cognitive Robotics18 Interactions Among Affordances ● A wad of paper affords tossing. ● A wastebasket affords receiving tossed objects. – Potential for combinatorial explosion? ● Interactions can supply parameter values. – Where to push

10/1/ Cognitive Robotics19 Recognizing Failures ● Trace line affordance fails: – Neck pan limits exceeded. ● Need to understand why the action failed. ● Failure codes: – positioning problem – lost sight of object – lost contact with object (dropped it) – etc.

10/1/ Cognitive Robotics20 Dealing with Novel Objects ● How do you turn on the shower?

10/1/ Cognitive Robotics21 How Can Robots Handle Novel Objects? ● Perceive the object in terms of its parts. – Surfaces, protuberances, axes of symmetry ● Part geometry suggests possible actions. – Knobs are for pulling or twisting. – Plates are for pressing. – etc. ● Robot must be able to perceive and evaluate the effects of its actions.