Interpretation of Geometric Shapes Miquel Prats Steve Garner The Design Group The Open University UK ETRA – Eye Tracking Research & Applications 22-24.

Slides:



Advertisements
Similar presentations
Extracting cues to intention utilising animacy displays derived from human activity Phil McAleer & Frank E. Pollick Department of Psychology, University.
Advertisements

Methods 9 scenarios were used in total: 5 scenarios invovled interactions between 2 people, such as dancing, chasing, following and circling. 3 scenarios.
Intention Recognition in Autistic Spectrum Condition (ASC) using Video Recordings and their Corresponding Animacy Display. Phil McAleer 1, Lawrie McKay.
METHODS AND RESULTS: VERBAL TOM Participants: 72 young (18-39), 46 middle-aged (40-64) and 48 older (65-88) adults. Tasks: Participants completed 16 theory.
CONSTRAINTS ON IMAGERY I David Pearson Room T10, William Guild Building
MENTAL CONSTRUCTION David Pearson Room T10, William Guild Building
Complexity Metrics for Design & Manufacturability Analysis
1 Using the HTK speech recogniser to analyse prosody in a corpus of German spoken learners English Toshifumi Oba, Eric Atwell University of Leeds, School.
CONTRIBUTIONS Ground-truth dataset Simulated search tasks environment Multiple everyday applications (MS Word, MS PowerPoint, Mozilla Browser) Implicit.
BARRY DAUPHIN, PH.D. HAROLD GREENE, PH.D. MINDEE JUVE, M.A. Cognitive Mediation and Information Processing on the Rorschach.
A Project Overview. Faculty of Engineering Prof. Alison McKay Prof. David Hogg Prof. Alan de Pennington Dr. Hau Hing Chau Dr. Iestyn Jowers Department.
HUMAINE Summer School - September Basic Emotions from Body Movements HUMAINE Summer School 2006 Casa Paganini Genova, Italy Ahmad S. Shaarani The.
Office of SA to CNS GeoIntelligence Introduction Data Mining vs Image Mining Image Mining - Issues and Challenges CBIR Image Mining Process Ontology.
A shape grammar interpreter for curved shapes Iestyn Jowers University of Leeds Design Computing and Cognition 2010 Workshop on Shape Grammar Implementation.
Shape grammar implementation with vision Iestyn Jowers University of Leeds Design Computing and Cognition 2010 Workshop on Shape Grammar Implementation.
In-Class Case Study: Determining the Mechanical Properties of Bone Using State-of-the-art Mechanical Testing System (MTS Bionix) Prepared by Prof. Deepak.
Non Verbal Communication What does the following sign mean to you?
Don't Look Now: The relationship between mutual gaze, task performance and staring in Second Life Don't Look Now: The relationship between mutual gaze,
Enhanced secondary mathematics teaching Gesture and the interactive whiteboard Dave Miller and Derek Glover
Detail to attention: Exploiting Visual Tasks for Selective Rendering Kirsten Cater 1, Alan Chalmers 1 and Greg Ward 2 1 University of Bristol, UK 2 Anyhere.
Getting a Measure of Satisfaction from Eyetracking in Practice Workshop 24 Organisers: Tony Renshaw, Leeds Metropolitan University, UK Natalie Webb, Amberlight.
Sketching in Design: Formalising a transformational process Sketching in Design: Formalising a transformational process Sungwoo Lim Strathclyde University,
Application: driving Gemma Briggs
Eye Movements of Younger and Older Drivers Professor: Liu Student: Ruby.
Module 2: Assessment in Creative Arts © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.
Chapter 6: Visual Attention. Scanning a Scene Visual scanning – looking from place to place –Fixation –Saccadic eye movement Overt attention involves.
Image Retrieval Using Eye Movements Fred Stentiford & Wole Oyekoya University College London.
The Use of Eye Tracking Technology in the Evaluation of e-Learning: A Feasibility Study Dr Peter Eachus University of Salford.
Graphics-1 Gentle Introduction to Computer Graphics Based on: –David Brogan’s “Introduction to Computer Graphics” Course Slides, University of Virginia.
Supporting Collaboration: Digital Desktops to Intelligent Rooms Mary Lou Maher Design Computing and Cognition Group Faculty of Architecture University.
1 Voice Command Generation for Teleoperated Robot Systems Authors : M. Ferre, J. Macias-Guarasa, R. Aracil, A. Barrientos Presented by M. Ferre. Universidad.
Visual Imagery One of the greatest problems confronting psychology is the nature of mental representation. Part of this debate is the nature of representations.
Towards a stochastic theory of saccadic eye movement GURU Oct 1, 2001 Jonathan Nelson.
 For many years human being has been trying to recreate the complex mechanisms that human body forms & to copy or imitate human systems  As a result.
Supporting Reinterpretation in Computer-Aided Conceptual Design Iestyn Jowers University of Leeds, UK Miquel Prats The Open University, UK Sungwoo Lim.
Applying Eye Tracking for Usability Evaluations of E-Commerce sites Ekaterini Tzanidou, Shailey Minocha, Marian Petre Department of Computing, The Open.
Introduction To know how perceptual and attentional processes and properties of words guide the eyes through a sentence, the following issues are particularly.
Evaluating Eye Movement Differences when Processing Subtitles Andrew T. Duchowski COMPUTER SCIENCE CLEMSON UNIVERSITY Abstract Our experimental.
Qualitative Research.
Studying Visual Attention with the Visual Search Paradigm Marc Pomplun Department of Computer Science University of Massachusetts at Boston
Basic Communication Chapter 6. Was there communication as I read the Jabberwocky? How did the communication come about? Were you familiar with all the.
Eye Tracking in the Design and Evaluation of Digital Libraries
Active Vision Key points: Acting to obtain information Eye movements Depth from motion parallax Extracting motion information from a spatio-temporal pattern.
1 Brief Review of Research Model / Hypothesis. 2 Research is Argument.
The Value of Visual Elements in Web Search Lizzeth Cabana Tejada School of Computer Sciencie San Pablo Catholic University 2010.
The effects of relevance of on-screen information on gaze behaviour and communication in 3-party groups Emma L Clayes University of Glasgow Supervisor:
How do university students solve problems in vector calculus? Evidence from eye tracking Karolinska institutet Stockholm 4th of May 2012 Magnus Ögren 1.
Cognitive Systems Foresight 3D Vision. Cognitive Systems Foresight What are the potential implications of computer vision research for the study of biological.
Partner presentation COGAIN camp th September, De Montfort University, Leicester, UK Faculty of Mathmatics and Natural Sciences Institute of Psychology.
From Here to There “ From Here to There ” Louise Van de Water Kelston Girls College.
Qualitative Research EDUC 7741/Paris/Terry.
Monitoring and Enhancing Visual Features (movement, color) as a Method for Predicting Brain Activity Level -in Terms of the Perception of Pain Sensation.
1 Galatea: Open-Source Software for Developing Anthropomorphic Spoken Dialog Agents S. Kawamoto, et al. October 27, 2004.
University of Derby (UoD) Education, Health & Sciences Arts, Design & Technology Derbyshire Business School UoD College Buxton Business Development Unit.
Conclusions This method for the production of animacy displays is viable. Displays filmed from the TopView are more often rated as being self- propelled.
Immersive Virtual Characters for Educating Medical Communication Skills J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine)
Eye Movements and Working Memory Marc Pomplun Department of Computer Science University of Massachusetts at Boston Homepage:
Towards an express-diagnostics for level of processing and hazard perception Boris M. Velichkovsky et al. Transportation Research Part F 5 (2002)
Human Joint Transportation in a Multi-User Virtual Environment Stephan Streuber Astros.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
The effect of inter-letter spacing on reading Yu-Chi Tai, John Hayes, James Sheedy College of Optometry Pacific University, Forest Grove, Oregon ABSTRACT.
Background Method Results Objectives Results Discussion References
UNIT SELF-TEST QUESTIONS
Proposed research title
Saccades actively maintain perceptual continuity
TEKS 7.21: The student is expected to: (A)  differentiate between, locate, and use valid primary and secondary sources such as computer software, databases,
by Robert Froud, Martin Underwood, Dawn Carnes, and Sandra Eldridge
Computer Vision Readings
Relationship between saccade duration, endpoint accuracy, and expected value of reward. Relationship between saccade duration, endpoint accuracy, and expected.
MA in Educational Leadership (Teach First)
Presentation transcript:

Interpretation of Geometric Shapes Miquel Prats Steve Garner The Design Group The Open University UK ETRA – Eye Tracking Research & Applications March 2010 Austin, Texas Project funded by: Project partners: Iestyn Jowers Alison McKay School of Mechanical Engineering University of Leeds UK Nieves Pedreira Information and Communications Technologies University of A Coruña Spain

The Designing with Vision project investigates the possibility of using eye- tracking technology as an interface for systems intended to support the creation, exploration, and development of shape alternatives in conceptual design. Project funded by: Project partners: Interpretation of Geometric Shapes

The Designing with Vision project is interested in exploring the possibilities of using eye-tracking technology as an interface for systems intended to support the creation, exploration, and development of design shape alternatives in conceptual design. Project funded by: Project partners: Interpretation of Geometric Shapes

Project funded by: Project partners: Interpretation of Geometric Shapes

Project funded by: Project partners: Interpretation of Geometric Shapes

The Designing with Vision project seeks to: – Understand how eye-tracking technology can be used to recognise different interpretations of shapes. – Build a computational design system that supports fluid design reinterpretation and exploration. Project funded by: Project partners: Interpretation of Geometric Shapes

Project funded by: Project partners: Interpretation of Geometric Shapes Computational shape interpretation The Designing with Vision project seeks to: – Understand how eye-tracking technology can be used to recognise different interpretations of shapes. – Build a computational design system that supports fluid design reinterpretation and exploration.

Interpretation of Geometric Shapes Computational shape interpretation: recognition Gross (2001) Back of an Envelope The program has been trained to recognise ‘interesting’ shapes The program has not been trained to recognise these shapes

Saund and Moran (1994) What You Perceive Is What You Get Interpretation of Geometric Shapes Computational shape interpretation: selection Gesture-based shape selection

Interpretation of Geometric Shapes Computational shape interpretation: generation Jowers et al. (2008) Design Synthesis and Shape Generation Based on the shape grammar formalism (Stiny and Gips 1972)

Interpretation of Geometric Shapes Eye tracking and shape perception Yarbus (1967) Eye movements and fixations are influenced by the viewer’s intent

Interpretation of Geometric Shapes Our study – Analyse eye movement data with the objective to determine when a shape is recognised. – Analyse eye movement data with the objective to determine which shape is selected. Main Goals

Interpretation of Geometric Shapes Our study z – Analyse eye movement data with the obj the moment when a shape is recognised.. Main Goals We call it ‘Now moment’

Interpretation of Geometric Shapes Our study The experiment 7 participants 3 tasks Task 1 Find the squareFind the arrow

Interpretation of Geometric Shapes Our study The experiment 7 participants 3 tasks Task 1 Find the squareFind the arrow

Interpretation of Geometric Shapes Our study The experiment 7 participants 3 tasks Task 1

Interpretation of Geometric Shapes Our study The experiment 7 participants 3 tasks Task 2 Say which shapes each image is composed of

Interpretation of Geometric Shapes Our study The experiment 7 participants 3 tasks Task 2 Extract of participants’ transcript

Interpretation of Geometric Shapes Our study The experiment 7 participants 3 tasks Task 3 Find this shape in the following figures

Interpretation of Geometric Shapes Our study The experiment 7 participants 3 tasks Task 3

Interpretation of Geometric Shapes Main conclusions Our results… … support previous findings that indicate the relationship between saccade amplitude and fixation duration in visual fixations (Unema et al. 2005, Velichkovsky et al. 2005). … show that fixation duration and saccade amplitude can be used as indicators of shape interpretation. … support the hypothesis that eye movements could be used to select shapes in a natural and non intrusive way.

Interpretation of Geometric Shapes Future work – Evaluate the data by means of statistical analysis. – Examine whether fixation duration and saccade amplitude are also indicators of shape recognition in ‘designerly’ tasks. – Explore ways to determine which shapes are selected. – Build a computational drawing system that uses eye movement data to recognise any shape interpreted in a design.

Interpretation of Geometric Shapes Future work Experiments to determine which shape is interpreted Development of Designing with Vision software

Project funded by: Project partners: Interpretation of Geometric Shapes

Project funded by: Project partners: Interpretation of Geometric Shapes

Project funded by: Project partners: Interpretation of Geometric Shapes

Project funded by: Project partners: Interpretation of Geometric Shapes

Project funded by: Project partners: Interpretation of Geometric Shapes