Resolving Ambiguities to Create a Natural Sketching Environment Christine Alvarado and Randall Davis MIT AI Laboratory.

Slides:

Advertisements

Similar presentations

Recommender System A Brief Survey.

Advertisements

Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California USA

1 st Free-body HW Assignment Examples in real life.

An Adaptive System for User Information needs based on the observed meta- Knowledge AKERELE Olubunmi Doctorate student, University of Ibadan, Ibadan, Nigeria;

Interaksi Manusia Komputer – Marcello Singadji. design rules Designing for maximum usability – the goal of interaction design Principles of usability.

Natural Language Understanding Difficulties: Large amount of human knowledge assumed – Context is key. Language is pattern-based. Patterns can restrict.

Rulebase Expert System and Uncertainty. Rule-based ES Rules as a knowledge representation technique Type of rules :- relation, recommendation, directive,

“Face Recall Systems” Jennifer Shieh Indecent Act /9696 Aggravated Robbery /8515 Aggravated Robbery /0730.

Putting Research Evidence to Work Research Seminar 14 th January 2009.

Intelligent Profiling by Example From: “Intelligent profiling by Example”, Sybil Sherin, Henry Lieberman

Freehand Drawing System based on Geometric Constraints Kaisuke Nakajima Joint work with Takeo Igarashi User Interface Research Group The University of.

Markov Logic Networks Instructor: Pedro Domingos.

Modeling Student Knowledge Using Bayesian Networks to Predict Student Performance By Zach Pardos, Neil Heffernan, Brigham Anderson and Cristina Heffernan.

Bayesian Networks. Contents Semantics and factorization Reasoning Patterns Flow of Probabilistic Influence.

Visualization and Cluster

Recommender Systems Aalap Kohojkar Yang Liu Zhan Shi March 31, 2008.

Part 2c: Requirements Chapter 2: How to Gather Requirements: Some Techniques to Use Chapter 3: Finding Out about the Users and the Domain Chapter 4: Finding.

Integrative Analysis of Biological Data Sai Moturu.

Properties of Real-World Digital Logic Diagrams Christine Alvarado, Harvey Mudd College Michael Lazzareschi, Pomona College May 24, 2007.

Example applications of Bayesian networks

Evaluation Through Expert Analysis U U U

Marakas: Decision Support Systems, 2nd Edition © 2003, Prentice-Hall Chapter Chapter 7: Expert Systems and Artificial Intelligence Decision Support.

Robotics for Intelligent Environments

Identifying and Compensating for Biases in User Feedback A Case Study Team Chartreuse.

Chapter 7 design rules.

Learn how to make your drawings come alive…  COURSE: SKETCH RECOGNITION Analysis, implementation, and comparison of sketch recognition algorithms, including.

Building the Design Studio of the Future Aaron Adler Jacob Eisenstein Michael Oltmans Lisa Guttentag Randall Davis October 23, 2004.

A Survey of Mobile Phone Sensing Michael Ruffing CS 495.

Vectors 1D kinematics 2D kinematics Newton’s laws of motion

The Future Of AI What’s Possible, What’s Not, How Do We Get There? Adam Cheyer Co-Founder, VP Engineering Siri Inc.

Managing Social Influences through Argumentation-Based Negotiation Present by Yi Luo.

Ink and Gesture recognition techniques. Definitions Gesture – some type of body movement –a hand movement –Head movement, lips, eyes Depending on the.

Chapter 14: Artificial Intelligence Invitation to Computer Science, C++ Version, Third Edition.

What We Can Learn From SILK and DENIM Presenter: Shahla Almasri COMP 762B: Modelling and Simulation Based Design March 2 nd, 2005.

Unit 6 Lesson 1 An inequality is like an equation, but instead of an equal sign (=) it has one of these signs: < : less than ≤ : less than or equal to.

© 2005 Ritsumeikan Univ. All Rights Reserved. Embedded Action Detector to Enhance Freedom from Care Ritsumeikan University Graduate School of Computer.

Enabling Natural Interaction Randall Davis, Howard Shrobe Aaron Adler, Christine Alvarado, Mark Foltz, Tracy Hammond, Mike Oltmans, Metin Sezgin,Olga Veselova.

Combining geometry and domain knowledge to interpret hand-drawn diagrams As Presented By: Andrew Campbell Christopher Dahlberg.

HCI For Pen Based Computing Cont. Richard Anderson CSE 481 B Winter 2007.

Automated Critique of Sketched Mechanisms Jon Wetzel and Ken Forbus Qualitative Reasoning Group Northwestern University.

MIT 6.893; SMA 5508 Spring 2004 Larry Rudolph Lecture Introduction Sketching Interface.

Theme 2: Data & Models One of the central processes of science is the interplay between models and data Data informs model generation and selection Models.

Argunaut’s 1 st teachers’ workshop An example of a design workshop in the initial stages of tool development.

Feature Point Detection and Curve Approximation for Early Processing of Free-Hand Sketches Tevfik Metin Sezgin and Randall Davis MIT AI Laboratory.

Bayesian Networks for Sketch Understanding Christine Alvarado MIT Student Oxygen Workshop 12 September 2003.

Gesture recognition techniques. Definitions Gesture – some type of body movement –a hand movement –Head movement, lips, eyes Depending on the capture.

Suzanne Kieffer, Adrien Coyette, Jean Vanderdonckt Université catholique de Louvain, Belgium {suzanne.kieffer, adrien.coyette,

Chapter 3 The Knowledge Leader

Artificial Intelligence: Research and Collaborative Possibilities a presentation by: Dr. Ernest L. McDuffie, Assistant Professor Department of Computer.

The Road to Intelligence Is Paved with a Million Million Expert Systems Christine Alvarado 6 November 2002.

Understanding Naturally Conveyed Explanations of Device Behavior Michael Oltmans and Randall Davis MIT Artificial Intelligence Lab.

Pen Based User Interface Issues CSE 490RA January 25, 2005.

Making Research Tools Accessible for All AI Students Zach Dodds, Christine Alvarado, and Sara Sood Though a compelling area of research with many applications,

GoRelations: an Intuitive Query System for DBPedia Lushan Han and Tim Finin 15 November 2011

Holland Code One Career theory to help students give a framework to their career exploration….. Based on 6 personality types and on the evidence based.

Enabling Natural Interaction Randall Davis Aaron Adler, Sonya Cates, Jacob Eisenstein, Tracy Hammond, Mike Oltmans, Metin Sezgin, Chen Li, David Pitman.

Speech and multimodal Jesse Cirimele. papers “Multimodal interaction” Sharon Oviatt “Designing SpeechActs” Yankelovich et al.

Unit Four – Force Interaction Model PRS - Forces 10/25/06

Randall Davis Howard Shrobe

Learning Probabilistic Graphical Models Overview Learning Problems.

Chapter 7 design rules.

©2009 – Not to be sold/Free to use

Chapter 7 design rules.

Chapter 7 design rules.

Flow of Probabilistic Influence

Agenda 11/19/15 SB #17 Photoshop Skills to Learn: pen tool, anchor points, paths, fill, stroke, line weight 3) Pen tool Practice #2 4) Line Art Portrait.

Randall Davis Howard Shrobe

Chapter 7 design rules.

Solution Free Body Diagram.

Presentation transcript:

Resolving Ambiguities to Create a Natural Sketching Environment Christine Alvarado and Randall Davis MIT AI Laboratory

Christine Alvarado Our Model The Designer Sketches with Pen and Paper The Observer Interprets the Sketch The Observer and Designer Interact

Christine Alvarado Sketch Interpretation

Christine Alvarado Accuracy vs. Freedom Drawing Freedom Recognition Difficulty Menu “Put That There” Single Stroke Recognition Free Sketch ASSIST

Christine Alvarado Accuracy and Freedom Smarter interpretation increases accuracy Better interaction design increases perceived freedom

Christine Alvarado Resolving Ambiguities Levels of Interpretation Fluid Interpretation Commitment to an Interpretation

Christine Alvarado 3 Stages of Interpretation Recognition Reasoning Resolution

Christine Alvarado Recognition Generate All Possible Interpretations: –Circle –Circular Body –Pin Joint

Christine Alvarado Reasoning: Heuristics Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback

Christine Alvarado Reasoning: Heuristics Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback

Christine Alvarado Reasoning: Heuristics Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback 1 arrow or 3 rods?

Christine Alvarado Reasoning: Heuristics Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback

Christine Alvarado Reasoning: Heuristics Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback

Christine Alvarado Reasoning: Heuristics Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback

Christine Alvarado Reasoning: Heuristics Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback Total Score

Christine Alvarado Resolution

Christine Alvarado Resolution 0 3 6

Christine Alvarado Resolution 0 3 6

Christine Alvarado Resolution

Christine Alvarado Resolution

Christine Alvarado Resolution

Christine Alvarado Resolution

Christine Alvarado Resolution

Christine Alvarado Resolution

Christine Alvarado Resolution

Christine Alvarado Relies heavily on bottom-up recognition Limitations line ??? Line + Line + Line + ???  ???

Christine Alvarado Relies heavily on bottom-up recognition Heuristics all weighted equally Limitations H1: H2:Prefer objects drawn with contiguous strokes Prefer interpretations resulting in fewer objects

Christine Alvarado Relies heavily on bottom-up recognition Heuristics all weighted equally Limitations H1: H2:Prefer objects drawn with contiguous strokes Prefer interpretations resulting in fewer objects

Christine Alvarado Relies heavily on bottom-up recognition Heuristics all weighted equally Limitations H1: H2:Prefer objects drawn with contiguous strokes Prefer interpretations resulting in fewer objects

Christine Alvarado Structured Application of Context Blackboard recognition architecture Heuristics applied probabilistically

Christine Alvarado Recognition Blackboard Sketch Blackboard Line(l1)Line(l2)Line(l3) Line(l5)Line(l4)Line(l7) Connects(l1, l2) Arrow(a1) Force(f1) Stroke(s2)Stroke(s1)Stroke(s3)Stroke(s5)Stroke(s7)Stroke(s6)Stroke(s4) Connects(l4, l5) Connects(l7, l4) Forces push bodies Line(l6) Connects(l5, l6) Connects(l6, l7) Polygon(p1) Body(b1)

Christine Alvarado Bayesian Network Structure Heuristics influence prior Line1Line2Line3 Property1Property2 … … Low-level information influences recognition

Christine Alvarado Related Work Gross and Do (1996) Landay and Meyers (2001) Stahovich (1998) Matsakis (1999)