Supporting Collaborative Interpretation in Distributed Groupware Donald CoxSaul Greenberg IBM Canada LaboratoryUniversity of Calgary Presented at ACM CSCW.

Slides:



Advertisements
Similar presentations
Performance Assessment
Advertisements

1 Statistical concepts Module 1, Session 1. 2 Objectives From this session participants will be able to: Outline the content of the set of modules in.
Mobile Data from a Research Perspective Institute of Educational Technology The Open University Agnes Kukulska-Hulme JISC/CNI conference, Edinburgh, 1-2.
Helen He, CPSC681, 10/29/07 Results Synthesis Developed by: Donald A. Cox and Saul Greenberg.
Enhanced secondary mathematics teaching Gesture and the interactive whiteboard Dave Miller and Derek Glover
Using Video Segments to Enhance Early Clinical Experiences of Prospective Teachers Kristen Cuthrell, Michael Vitale, College of Education, East Carolina.
The Same Old Remote Misunderstandings: Object-Focused Interaction in e-Social Science Mike Fraser University of Bristol.
What Happened? In your group, discuss what happened in your district regarding SB 1 after our last meeting. Each group will share (1)one positive outcome.
Cognitive Walkthrough More evaluation without users.
Providing Artifact Awareness to a Distributed Group through Screen Sharing Kimberly Tee, University of Calgary Saul Greenberg, University of Calgary Carl.
DEMONSTRATIONS IN TEACHING
James Tam Group Work And Technology Collaboration and designing interfaces Groupware and CSCW Categories of interaction.
Shared Workspaces: Behavioural Foundations Petra Neumann 781 October 12 th, 2005.
Spatial Hypermedia and Augmented Reality
The Design of Come Together Places for light-weight group meetings Yibo Sun and Saul Greenberg University of Calgary Note. This slide deck was used as.
Discount Evaluation Evaluating with experts. Agenda Online collaboration tools Heuristic Evaluation Perform HE on each other’s prototypes Cognitive Walkthrough.
Visual Awareness in Shared Workspaces Presentation by Marc Leonard.
Discount Evaluation Evaluating with experts. Agenda Part 4 preview Heuristic Evaluation Perform HE on each other’s prototypes Cognitive Walkthrough Perform.
Part 4: Evaluation Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what, where, and when Chapter.
Heuristic Evaluation Evaluating with experts. Discount Evaluation Techniques  Basis: Observing users can be time- consuming and expensive Try to predict.
Evaluating with experts
1 CS 430 / INFO 430 Information Retrieval Lecture 24 Usability 2.
Discount Evaluation Evaluating with experts. Agenda Project was due today – You will demo your prototype next class Heuristic Evaluation Cognitive Walkthrough.
Collaborative Software Engineering – Awareness and Concurrency Agam.
Lecture 3: Shared Workspace and Design Coordination Dr. Xiangyu WANG.
Principles of High Quality Assessment
Lecture 3: Shared Workspace Awareness Dr. Xiangyu WANG 11 th August 2008.
English Word Origins Grade 3 Middle School (US 9 th Grade) Advanced English Pablo Sherman The etymology of language.
Classroom Action Research Overview What is Action Research? What do Teacher Researchers Do? Guidelines and Ideas for Research.
Why Children Draw  To communicate their own feelings, ideas and experiences and express them in ways that someone else can understand.  Provides a nonverbal.
Evaluating Your Prototype without Users Class 29.
Predictive Evaluation
HagIT: The future is in your hands Designed and presented by: Hamza Khurshid Ahmad Ghunaim Ghassan Knayzeh.
GUI: Specifying Complete User Interaction Soft computing Laboratory Yonsei University October 25, 2004.
Sarah Drummond Dept. Computer Science University of Durham, UK MSc Research An Investigation into Computer Support for Cooperative Work in Software Engineering.
Guided tours and on-line presentations: how authors make existing hypertext intelligible for readers C. C. Marshall, P. M. Irish, Guided tours and on-line.
Results Synthesis Phuoc Lam. Schedule What is it? How it works Benefits & Drawbacks Activity.
Football Coaching By Year 9 student 2007.
INSTRUCTIONAL DESIGN JMA Review Principle Review Principle 2. Toolbook (Data) Toolbook (Data) 3. M-Learning M-Learning Objectives.
Chapter 26 Inspections of the UI. Heuristic inspection Recommended before but in lieu of user observations Sort of like an expert evaluation Heuristics.
Object-Oriented Software Engineering Practical Software Development using UML and Java Chapter 7: Focusing on Users and Their Tasks.
Computer Vision Technologies for Remote Collaboration Using Physical Whiteboards, Projectors and Cameras Zhengyou Zhang Microsoft Research mailto:
ATL’s in the Personal Project
CS2003 Usability Engineering Usability Evaluation Dr Steve Love.
Guide to Programming with Python Chapter One Getting Started: The Game Over Program.
Collaborative Annotation of the AMI Meeting Corpus Jean Carletta University of Edinburgh.
Targets, Tasks and Texts Across the Day (Grades 3-5) Experienced with NTI Teachers/ Coaches Session 5.
CS2003 Usability Engineering Human-Centred Design Dr Steve Love.
MJM22 Digital Practice and Pedagogy Week 9 Collaboration Tools.
Matthew van Cittert Supervisor: Prof. Shaun Bangay A second look at the “glorified text-editor”
Team name Usability testing plan for BelleViews School of Business and Information Management Oulu University of Applied Sciences.
“Train-the-Trainer” Offering Great Instruction. Workshop Goals  Understand a variety of learning styles  Develop goals, objective & manageable lesson.
Study Skills With Audio Notetaker. How to use Audio Notetaker for: Note taking Brainstorming Presentation practice Feedback and assessment Research.
© Prentice Hall, 2007 Excellence in Business Communication, 7eChapter Communicating in Teams and Mastering Listening and Nonverbal Communication.
© Prentice Hall, 2005 Business Communication Today 8eChapter Communicating in Teams and Mastering Listening and Nonverbal Communication.
Human Computer Interaction
Thomas Kern | The system documentation as binding agent for and in between internal and external customers April 24th, 2009 | Page 1 The system documentation.
Cognitive Walkthrough More evaluating with experts.
Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users Daniel Vogel, Ravin Balakrishnan Department of Computer Science.
Hippie A Nomadic Information System Oppermann, et al. International Symposium on Handheld and Ubiquitous Computing (HUC 99)
SWE 214 (071) Introduction to UML Slide 1 Introduction to UML.
Design Evaluation Overview Introduction Model for Interface Design Evaluation Types of Evaluation –Conceptual Design –Usability –Learning Outcome.
Implementing the Professional Growth Process Session 3 Observing Teaching and Professional Conversations American International School-Riyadh Saturday,
IOC = Individual Oral Commentary. IOC - Basics The individual oral commentary (IOC) assesses your ability to analyse a passage from a text that you have.
Instructional Practice Guide: Coaching Tool Making the Shifts in Classroom Instruction Ignite 2015 San Diego, CA February 20, 2015 Sandra
Animals use their senses for survival
Supporting Awareness in Mixed Presence Groupware
Video 6: Practice Papers for
Indented Tree or Graph? A Usability Study of Ontology Visualization Techniques in the Context of Class Mapping Evaluation 本体可视化技术在类型匹配评估中的可用性研究 Qingxia.
Presentation transcript:

Supporting Collaborative Interpretation in Distributed Groupware Donald CoxSaul Greenberg IBM Canada LaboratoryUniversity of Calgary Presented at ACM CSCW Note: the talk included a demonstration of the system, which is not shown here

Agenda Collaborative Interpretation Supporting Emergence Supporting Distributed CI

Collaborative Interpretation A process where a group interprets and transforms a diverse set of information fragments into a smaller, coherent set of meaningful descriptions.

Steps in CI Preparation Familiarization Interpretation (emergence) Recording the interpretation

Preparation

Familiarization

Interpretation

Reporting

Moving to Distributed Groupware

Preparation/Familiarization

Interpretation

Reporting

Emergence Ideas do not arise well formed. At first there are expressions of fragments of thoughts. Once there is some rough material to work with, interpretations gradually begin to emerge as they are discussed. -- Moran, Chiu, & van Melle, UIST ‘97

Spatial and visual workspace Supporting Emergence Use spatial proximityFree creation & movementFree-form annotation

Spatial Visual Workspace Main View Overview Info Area

Spatial Proximity

Free-form Annotation

Free Creation & Movement

Supporting Distributed CI Collaborative Interpretation is a “classic” CSCW activity.

Design Principles Emergence  Spatial visual workspace  Use spatial proximity  Free-form annotation  Free creation and movement Distributed CI  Provide a common visually similar space.  Provide timely feedback and feed-through.  Support gesture and diectic references.  Support workspace awareness.

Summary

The End The next sequence shows extra slides not shown at the presentation…

Are You Familiar with Collaborative Interpretation? Have you ever written down bits of information on Post-It Notes or Index cards? Then spread the cards out over a work surface? Then worked with others to organize the cards so they made sense? If so, you’ve probably engaged in collaborative interpretation

Initial Interpretation

Emergence (demo) Spatial Visual workspace  Theoretically unbounded  Undifferentiated, conventional space Free form annotation  Free hand annotation Free creation and movement  Notes  Text annotations  TA list  Drop to overview  Navigation techniques

Collaboration Sense-making requires multiple participants Groups may be hetero- or homogeneous Differences require effective and efficient communication Collaborators often are not co-located

Interpretation Starts with fragments – ill-conditioned data Meaning created through process, one of many possible Meaning of data changes through and through-out process - emergence

Scenario Walkthrough (demo) Preparation Familiarization & duplicate identification Initial organization Re-organization Finalizing the interpretation

Related Work Supporting Emergence  Monty  Marshall et al  Moran et al  … Supporting Distributed Groupware  Randy Smith (Overview)  Carl Gutwin (Workspace awareness)  …

Results Synthesis Group = heuristic evaluators Fragments = notes on observed issues Descriptions = problem reports

Results Synthesis (demo) Cards/Problem descriptions as the information fragments Show only summary on card Creation of new cards not permitted Separate tool for capturing descriptions from which raw data is imported

Single User Evaluations The goal was to find bugs in a simple environment. Users performed interpretation task. Users made progress in time allowed. Defects were fixed, and enhancements made

Multi-user Evaluations The goal was to see if the system deserved the name “groupware”. Three 2-user and one 3-user session. Users performed interpretation task. We saw differences in behaviour from face- to-face.

Conclusions CI is a widespread and important phenomenon Distributed CI is as well Principles we identified led to creation of a usable system

Closing Thoughts Collaborative Interpretation is a widespread, important phenomenon. We have design principles that can guide us in constructing systems supporting CI. PReSS is usable for Results Synthesis. There are many avenues for further research.