Presentation is loading. Please wait.

Presentation is loading. Please wait.

Perceiving and Representing Structured Information using Objects

Similar presentations


Presentation on theme: "Perceiving and Representing Structured Information using Objects"— Presentation transcript:

1 Perceiving and Representing Structured Information using Objects

2

3 Organization Image based theories Structural 3D theories
Object perception: Object displays

4 Image Based vs Structure Theories
Template theories based on 2D image processing In structural theories we extract the structure of a scene in terms of 3D primitives

5 Template theories A template with simple morphing operations

6 Objects as patterns of (2D) patterns

7

8

9

10 Scenes (gist in 100 msec) Patterns of patterns Torralba and Oliva

11 Properties of Image Recognition
Remarkable image recognition memory Up to 5 images for second in object identification Applications in image searching interfaces RSVP Rapid serial visual presentation

12 Perception of object structure

13 Geon Theory

14 Geon Theory 3D Primitives “Geons” Structural skeleton
Shape from shading is also primitive

15 How Does the Brain Find Geons?

16

17 Canonical Views To make things clear both component parts and the critical joints must be clear

18 Processing stages for recognition

19 The Geon Diagram Pourang Irani
3D shape primitives for architecture - entities and relationships Surface texture and color for attributes

20 Pattern finding & Recognition
13% errors: 4.3 sec sub-structure 22% memory errors 26% errors 7.1 sec sub-structure 42% memory errors

21 Semantics On top of - relies on Underneath – support, foundation
Inside – containment (private code) Attachment points (external interfaces; part_of relationships) more than topology mid Upper Lower

22 Natural semantics Instances Dependency Multiplicity
Strength of Relationship

23

24

25 The Object Display (Wickens)
Use complex objects to fuse variables Map entities to object parts Map structure to object structure Can be pictorial (simplified) – an engine + fuel tank Map attributes to object attributes - color, size, motion etc.

26 Object Display Vol : 45 L Temp: 45 deg Flow: 20% Solids: 23% 100 L
0.2/1.0 45 deg Solids: 23%

27 Approx 1/3 errors with anesthiologists Dr George Blike

28 A medical ventilator Such displays Must be custom

29 Chart Junk (ducks) Tufte or Effective Communication

30 A Duck? (Tufte)

31

32 The concrete/abstraction tradeoff
Object displays may lead to lower errors Lend themselves to overly literal interpretation. They are not general purpose. Object displays must be custom designed More abstract representations leave more room for interpretation (better support the creative process)

33 2 ½ D design Use 3D objects to represent entities
Layout to make structure clear in 2D. -Connections, basic shapes Use canonical views

34 Holding attention -Object scene conflict
Used in advertising

35 Emotional and motivational effects

36 Conclusion There is a great future in 3D object icons and object structures It is happening anyway, but nice to know that it is not always “chart junk”.

37 Conclusions Visual space is non-homogenous
The plane orthogonal to the line of sight and the forward direction are very different. A 21/2D design attitude recognizes the cost of actions.

38 3D versus 2D 11.4% errors 3.7 sec sub-structure 21% errors 5.1 sec
20% memory errors 34% memory errors


Download ppt "Perceiving and Representing Structured Information using Objects"

Similar presentations


Ads by Google