HUMAN COMPUTATION IN VISUALIZATION: USING PURPOSE DRIVEN GAMES FOR ROBUST EVALUATION OF VISUALIZATION ALGORITHMS VISUAL ANALYTICS AND IMAGING LAB DEPT.

Slides:

Advertisements

Similar presentations

Project Based Learning

Advertisements

What is Portfolio Learning? An introduction to Portfolio Learning ? Portfolio Education is an experience, which focuses on you, the learner! Where am I?

Clustering Crowdsourced Videos by Line-of-Sight FOCUS: Clustering Crowdsourced Videos by Line-of-Sight Puneet Jain, Justin Manweiler, Arup Acharya, and.

Getting Started Genevieve Hartman, PhD Director of Platform Operations.

Presenting work by various authors, and own work in collaboration with colleagues at Microsoft and the University of Amsterdam.

NAFEES AHMED Klaus mueller

A Graph based Geometric Approach to Contour Extraction from Noisy Binary Images Amal Dev Parakkat, Jiju Peethambaran, Philumon Joseph and Ramanathan Muthuganapathy.

Prescriptive Analytics Part I Nick Gonzalez, 2/10/14.

Game Theoretic Aspect in Human Computation Presenter: Chien-Ju Ho

Eyes for Relighting Extracting environment maps for use in integrating and relighting scenes (Noshino and Nayar)

IView: A Feature Clustering Framework for Suggesting Informative Views in Volume Visualization Ziyi Zheng, Nafees Ahmed, Klaus Mueller Visual Analytics.

Histogram Analysis to Choose the Number of Clusters for K Means By: Matthew Fawcett Dept. of Computer Science and Engineering University of South Carolina.

Integrating Bayesian Networks and Simpson’s Paradox in Data Mining Alex Freitas University of Kent Ken McGarry University of Sunderland.

John S Gero Agents – Agent Simulations AGENT-BASED SIMULATIONS.

Combining Web, Mobile Phones and Public Displays in Large-Scale: Manhattan Story Mashup Ville H. Tuulos, J¨urgen Scheible, and Heli Nyholm Arjun Bir Singh.

Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,

Peekaboom: A Game for Locating Objects in Images

Human Computation CSC4170 Web Intelligence and Social Computing Tutorial 7 Tutor: Tom Chao Zhou

Random Sample Consensus: A Paradigm for Model Fitting with Application to Image Analysis and Automated Cartography Martin A. Fischler, Robert C. Bolles.

Chapter 10.  Basic Functions  Insert Graphics, Audio/Video  Add Text  Create Links  Capture Brainstormed Ideas  Generate Outline  Organize Graphics,

© 2013 IBM Corporation Efficient Multi-stage Image Classification for Mobile Sensing in Urban Environments Presented by Shashank Mujumdar IBM Research,

It’s an Element, Dear Watson! Project Overview Teacher Planning Work Samples & Reflections Teaching Resources Assessment & Standards Classroom Teacher.

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) Building Momentum Launch Strategy 5.1.

Biointelligence Laboratory School of Computer Science and Engineering Seoul National University Cognitive Robots © 2014, SNU CSE Biointelligence Lab.,

Web Design Process CMPT 281. Outline How do we know good sites from bad sites? Web design process Class design exercise.

Visual Communication. Agenda Visual literacy Visual design guidelines Research on visuals in education.

CSDT: BeadLoom Game Acey Boyce UNC Charlotte. We Love Virtual Bead Loom  Our most successful CSDT  Extremely effective at teaching Cartesian Coordinates.

Auto Mania is a virtual simulation, which will allow you to experience purchasing, maintaining, and using a vehicle.

Canyon Adventure Technology David Maung, Tristan Reichardt, Dan Bibyk, Juan Roman Department of Computer Science and Engineering The Ohio State University.

Test Preparation STRATEGIES BASED ON MAKE IT STICK: THE SCIENCE OF SUCCESSFUL LEARNING BY PETER BROWN, HENRY ROEDIGER, AND MARK MCDANIEL POWERPOINT DEVELOPED.

Football Coaching By Year 9 student 2007.

Exploration Seminar 3 Human Computation Roy McElmurry.

 The most intelligent device - “Human Brain”.  The machine that revolutionized the whole world – “computer”.  Inefficiencies of the computer has lead.

Computer/Human Interaction Spring 2013 Northeastern University1 Bricolage: Example-Based Retargeting for Web Design Kumar, R.,Talton, J.O., Ahmad, S.,

Towards Cognitive Robotics Biointelligence Laboratory School of Computer Science and Engineering Seoul National University Christian.

Scanner Run Jared Wilkin Chris Good. A Children’s Game.

Crowdsourcing Color Perceptions using Mobile Devices Jaejeung Kim 1, Sergey Leksikov 1, Punyotai Thamjamrassri 2, Uichin Lee 1, Hyeon-Jeong Suk 2 1 Dept.

Class Usability Experience User slides are in BLUE.

An Analytical Study of Puzzle Selection Strategies for the ESP Game Ling-Jyh Chen, Bo-Chun Wang, Kuan-Ta Chen Academia Sinica Irwin King, and Jimmy Lee.

An Interactive Tutorial for NP-Completeness. Outline  Background and Motivation  Visualizations  The NP-Complete Problems  Practice Exercises on NP-Complete.

Playing GWAP with strategies - using ESP as an example Wen-Yuan Zhu CSIE, NTNU.

© 2009 All Rights Reserved Jody Underwood Chief Scientist

Human Interaction with Data “Meaningful Interpretations” “The Power of Crowdsourcing” &

By: Kelsi Daly Wiki:

Topic: ORIENTATION & TRAINING Presented to: Sir.Tasman Pasha Presented by: Beenish Jahangir BsIT-3 rd Department of Computer Science BZU, Multan.

CHAPTER 4 THE VISUALIZATION PIPELINE. CONTENTS The focus is on presenting the structure of a complete visualization application, both from a conceptual.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 A personal route prediction system base on trajectory.

Ghislain Fouodji Tasse Supervisor: Dr. Karen Bradshaw Computer Science Department Rhodes University 24 March 2009.

Instructional Design The practice of arranging media and content to help learners and teachers transfer knowledge effectively.

1 Some Guidelines for Good Research Dr Leow Wee Kheng Dept. of Computer Science.

Identifying “Best Bet” Web Search Results by Mining Past User Behavior Author: Eugene Agichtein, Zijian Zheng (Microsoft Research) Source: KDD2006 Reporter:

Debugging, The Scientific Method, and Mastermind.

Personalizing Web Search Jaime Teevan, MIT with Susan T. Dumais and Eric Horvitz, MSR.

1 Per-Pixel Opacity Modulation for Feature Enhancement in Volume Rendering Speaker: 吳昱慧 Date:2010/11/16 IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER.

Background/Motivation Abstract Tutorials Recording Acknowledgments Graph Games started as Pebble It, a game to solve one type of graph problem. The goal.

Vision & Image Processing for RoboCup KSL League Rami Isachar Lihen Sternfled.

PAIR project progress report Yi-Ting Chou Shui-Lung Chuang Xuanhui Wang.

A Framework for Perceptual Studies in Photorealistic Augmented Reality Martin Knecht 1, Andreas Dünser 2, Christoph Traxler 1, Michael Wimmer 1 and Raphael.

Introduction GAA Foundation Award. © GAA 2 Presentation title in footer FÁILTE Welcome Coach Education Programme-Level 1.

Assessment Centres workshop Arti Kumar, Senior Careers Adviser / CETL Fellow Marie O’Flaherty Careers Adviser.

Zachary Starr Dept. of Computer Science, University of Missouri, Columbia, MO 65211, USA Digital Image Processing Final Project Dec 11 th /16 th, 2014.

Brain-Based Challenge: Matching Fractions to Decimals, Percents, and Geometric Representations J. Reed Students will prepare for a challenge where they.

INSTRUCTIONAL DESIGN Many definitions exist for instructional design 1. Instructional Design as a Process: 2. Instructional Design as a Discipline: 3.

Answering ‘Where am I?’ by Nonlinear Least Squares

Shane Bric and Kevin Paprocki

‘REAL’ RACING (game idea)

Chapter 6 Perception Chapter 6 perception.

DMAIC Roadmap DMAIC methodology is central to Six Sigma process improvement projects. Each phase provides a problem solving process where-by specific tools.

Evaluate the integral {image}

COURSE EVALUATION Spring 2019 Pilot August 27, 2019.

Presentation transcript:

HUMAN COMPUTATION IN VISUALIZATION: USING PURPOSE DRIVEN GAMES FOR ROBUST EVALUATION OF VISUALIZATION ALGORITHMS VISUAL ANALYTICS AND IMAGING LAB DEPT OF COMPUTER SCIENCE NAFEES AHMED, ZIYI ZHENG, KLAUS MUELLER

VISUAL ANALYTICS AND IMAGING LAB  HUMAN COMPUTATION  Relevance in visualization  AN Example: Disguise  Findings  Future thoughts

human Computation WHAT & WHY?

VISUAL ANALYTICS AND IMAGING LAB ?

?

? Crowd sourcing VizWiz Soylent

VISUAL ANALYTICS AND IMAGING LAB ? PURPOSE DRIVEN games ESP Game Tag a tune verbosity fold.it Ete-RNA Phylo Eye-wire

HUMAN COMPUTERS in VISUALIZATION WHY DOES IT MAKE SENSE?

VISUAL ANALYTICS AND IMAGING LAB VISUALIZATION Creates Understandable and Meaningful pictures from data In analyzing pictures and patterns still far better than any computers Human brain and vision

VISUAL ANALYTICS AND IMAGING LAB Image Data VISUALIZATION DESIGN RAW Data Data Analysis Prepared Data Focus Data Geometric Data Image Data FilteringMappingRendering Design/Select Candidate Visualize Data Evaluate Finalized Method Not Satisfactory Satisfactory RAW Data VISUALIZATION rendering

VISUAL ANALYTICS AND IMAGING LAB Evaluation of visualization User evaluation controlled environment Cost Small number of samples Crowd sourced Noisy data Cost

evaluation: using an online game Design, implementation and findings

VISUAL ANALYTICS AND IMAGING LAB problem Transparency perception ability to perceive the ordering given the blended color Evaluate blending algorithm In terms of transparency perception

VISUAL ANALYTICS AND IMAGING LAB Porter & Duff Hue Preserving Local blending Local blending with blurring Algorithms [Chuang 09][Porter 84] [Wang 09]

VISUAL ANALYTICS AND IMAGING LAB ARCADE | survival

VISUAL ANALYTICS AND IMAGING LAB ARCADE | survival

VISUAL ANALYTICS AND IMAGING LAB INTRUDER OVER COLLECTOR HIT INTRUDER COLLECTOR OVER INTRUDER HIT INTRUDER SCORE HEALTH SCORE HEALTH ANY STATE HIT COLLECTOR SCORE HEALTH ANY STATE NO ACTION SCORE HEALTH INTRUDER EXPLODES ANY STATE CLICK EMPTY SPACE SCORE HEALTH correctness

VISUAL ANALYTICS AND IMAGING LAB correctness PLAYERS try to Optimize score Score only improves with correct guessing of order Each click gives us feedback about human perception of transparency ordering

VISUAL ANALYTICS AND IMAGING LAB observations 1.Playability within 15 days of launch… 261 players 30,000+ data-points generated.

VISUAL ANALYTICS AND IMAGING LAB observations 2.Data collection speed 14.6 clicks per minute 1000 players x 24hr playtime = 21 million data points!

VISUAL ANALYTICS AND IMAGING LAB observations 3.cost once developed and deployed almost FREE!

VISUAL ANALYTICS AND IMAGING LAB observations 4.Data quality Provides much less noisy data than other web-based methods. trying to optimize score, not earning! Extent of data-points collected

VISUAL ANALYTICS AND IMAGING LAB observations

VISUAL ANALYTICS AND IMAGING LAB observations 5.limitations TIME TO DEVELOP ensuring correctness and fun MAKING IT POPULAR

Future thoughts Ideas, motivations

VISUAL ANALYTICS AND IMAGING LAB Future thoughts INTEGRATION WITH A LEARNING AGENT FOR ADAPTIVE DESIGN OF NEW ALGORITHMS

VISUAL ANALYTICS AND IMAGING LAB Future thoughts OPTIMIZATION OF VISUALIZATION PARAMETERS (transfer functions/ view angles)

THANK you VISUAL ANALYTICS AND IMAGING LAB DEPT OF COMPUTER SCIENCE NAFEES AHMED Ziyi zheng Klaus mueller