Fun Learning Stagecast Creator: An Exercise in Minimalism and Collaboration Cheryl Seals, Mary Beth Rosson, John M. Carroll, Tracy Lewis, and Lenese Colson.

Slides:



Advertisements
Similar presentations
Chapter 14: Usability testing and field studies
Advertisements

When Students Can’t Read…
Strategies for Integrating Technology into Every Class Joseph Chmielewski Center for Creative Learning Center for Creative Learning.
PD Plan Agenda August 26, 2008 PBTE Indicators Track
Fostering Learners’ Collaborative Problem Solving with RiverWeb Roger Azevedo University of Maryland Mary Ellen Verona Maryland Virtual High School Jennifer.
Chapter 9 User-centered approaches to interaction design By: Sarah Obenhaus Ray Evans Nate Lynch.
User Interface Structure Design
EDD/581 Action Research Proposal
6.811 / PPAT: Principles and Practice of Assistive Technology Wednesday, 16 October 2013 Prof. Rob Miller Today: User Testing.
Who wants to be a Millionaire Board Game!. Unit Plan Summary Compete against your class mates and see who can become the first Millionaire! The learners.
I-Room : Integrating Intelligent Agents and Virtual Worlds.
Exploring Visual Programming Stagecast Creator Tutorial, Activity II: Kids Smoking Cigarettes and Cigars on the Playground Visual Programming Group Center.
Chapter 14: Usability testing and field studies. 2 FJK User-Centered Design and Development Instructor: Franz J. Kurfess Computer Science Dept.
Chapter 14: Usability testing and field studies. Usability Testing Emphasizes the property of being usable Key Components –User Pre-Test –User Test –User.
1 User Centered Design and Evaluation. 2 Overview Why involve users at all? What is a user-centered approach? Evaluation strategies Examples from “Snap-Together.
1 Exploring Stagecast Creator Stagecast Creator Tutorial: Kids Smoking on the Playground By: Community Simulations Team Center for Human-Computer Interaction.
PowerPoint Presentation for Dennis, Wixom & Tegarden Systems Analysis and Design Copyright 2001 © John Wiley & Sons, Inc. All rights reserved. Slide 1.
Exploring Visual Programming Stagecast Creator Tutorial, Activity I: Kids Smoking on the Playground Visual Programming Group Center for Human-Computer.
IIS Seminar Computer Human Interaction: Improving Computing for Novice Programmers Cheryl Seals Auburn University Computer Human Interaction Laboratory.
1 User Centered Design and Evaluation. 2 Overview My evaluation experience Why involve users at all? What is a user-centered approach? Evaluation strategies.
COMP 4640 Intelligent & Interactive Systems Programs Supporting Model - Based Reflex Agents November 2008 Dr. Cheryl Seals.
Chapter 11 Instructional Procedures © Taylor & Francis 2015.
Web Design cs414 spring Announcements Project status due Friday (submit pdf)
INACOL National Standards for Quality Online Teaching, Version 2.
Instructional Strategies
COMPONENTS OF AN EFFECTIVE WRITING PROGRAM
PHP Basics Polly, Sanser and Young R547, Fall 2002.
Wanderlust Pilot Field Study Presented by Brandon Bond.
Chapter 14: Usability testing and field studies
Yeonjeong Park School of Education, Virginia Tech. Blacksburg, VA Educational Technology Lab : A place of learning, teaching, researching, and discovering…
Interstate New Teacher Assessment and Support Consortium (INTASC)
Seeking and providing assistance while learning to use information systems Presenter: Han, Yi-Ti Adviser: Chen, Ming-Puu Date: Sep. 16, 2009 Babin, L.M.,
1 SWE 513: Software Engineering Usability II. 2 Usability and Cost Good usability may be expensive in hardware or special software development User interface.
Effective Online Course Development By Dr. Rena Palloff and Dr. Keith Pratt.
Author: James Allen, Nathanael Chambers, etc. By: Rex, Linger, Xiaoyi Nov. 23, 2009.
Evaluation of Adaptive Web Sites 3954 Doctoral Seminar 1 Evaluation of Adaptive Web Sites Elizabeth LaRue by.
Universal Access to Programming Mary Beth Rosson Department of Computer Science Virginia Tech.
Usability testing. Goals & questions focus on how well users perform tasks with the product. – typical users – doing typical tasks. Comparison of products.
* Research suggests that technology used in classrooms can be especially advantageous to at-risk, EL, and special ed students. (Means, Blando, Olson,
Heuristic evaluation Functionality: Visual Design: Efficiency:
User Interface Structure Design Chapter 11. Key Definitions The user interface defines how the system will interact with external entities The system.
Slide 1 Chapter 11 User Interface Structure Design Chapter 11 Alan Dennis, Barbara Wixom, and David Tegarden John Wiley & Sons, Inc. Slides by Fred Niederman.
CS2003 Usability Engineering Usability Evaluation Dr Steve Love.
Assessing Your Assessments: The Authentic Assessment Challenge Dr. Diane King Director, Curriculum Development School of Computer & Engineering Technologies.
The Impact of the Interface Design on web-base Learning: Visual and Navigation Dynamics on Learners’ Satisfaction 指導教授: Chen, Ming- Puu 報告者 : Chang, Chen-Ming.
Quest Atlantis Homepage Tutorial Project Min-joung Kim Ming Ma Pil-Won On.
Evaluating CAI Lessons Dr. Ennis-Cole CECS 5130 Lesson Objectives Have the expected outcomes been realized ? Were the desired outcomes a result of the.
Course Outcomes, Assessments, and Activities AGENDA.
EVALUATION PROfessional network of Master’s degrees in Informatics as a Second Competence – PROMIS ( TEMPUS FR-TEMPUS-JPCR)
By Nicole Lopez & Travis Smith Motivating Adult Learners.
????????? Lecture # 9 Textbook: Larsen-Freeman, D. (2000). Techniques and Principles in Language Teaching. (2th ed.). Oxford University Press.
 The Business Education Department of Pasco High School needs a 3D curriculum that guide/support a diverse group of students to meet the demanding skills.
T/TAC I Final Presentation George Mason University Graduate School of Education Immersion Program May 11, 2004 T/TAC I & II.
Motivating adult learners can sometimes be a challenge. This module will provide you with information on how to design instructional content that will.
Writing to Teach - Tutorials Chapter 2. Writing to Teach - Tutorials The purpose of a tutorial is to accommodate information to the needs of the user.
ISTE Standards for Teachers Anja Whitehead IDT 3600 Fall 2015.
SARAH LEE GRACE UCHIDA MASIS NGUYEN MICHAEL HART JERAMY ZAPOTOSKY INF 132 Pair Programming.
Welcome to the BFS Introduction to Literacy by Design: Reader’s and Writer’s Workshop.
Design Evaluation Overview Introduction Model for Interface Design Evaluation Types of Evaluation –Conceptual Design –Usability –Learning Outcome.
Activity Design Goal: work from problems and opportunities of problem domain to envision new activities.
School of Engineering and Information and Communication Technology KIT305/607 Mobile Application Development Week 7: Usability (think-alouds) Dr. Rainer.
By: Jamie Morgan  A wiki is a web page or collection of web pages which you and your students can access to contribute or modify content without having.
Generating data with enacted methods
INF385G: Topic Discussion Huang, S. C.
Preparing to Teach and Overview of Teaching Assignments
Prototyping.
Scaffolding Lifelong Literacy Practices for All Students
Preparing to Teach and Overview of Teaching Assignments
Presentation transcript:

Fun Learning Stagecast Creator: An Exercise in Minimalism and Collaboration Cheryl Seals, Mary Beth Rosson, John M. Carroll, Tracy Lewis, and Lenese Colson Center for Human Computer Interaction Virginia Tech, Blacksburg VA

Introduction We are attempting to create a cross-generational web based learning community for students, teachers, and seniors. Learning community will design, construct, and discuss simulations of community issues. Paper reports results of formative evaluation with students creating simulation projects.

Stagecast Creator Based on a movie metaphor Programming is facilitated by macro recorder to allow “programming by demonstration” Behaviors are represented as a set of as a set of “if-then” rules

Visual Programming Spatial context and visual appearance are required elements in a rule’s precondition Correct position and appearance are preconditions for rules

Minimalist Instruction Aim is to engage people in simulation creation and discussion, but their participation is discretionary Instructions are a set of Minimalist Instructional manuals. Minimalism has been successfully used for training and emphasized that people learn well by engaging in real activities; it encourages an “action and task oriented approach to instruction and documentation.” Minimalism= Getting started quickly Engaging in real task-oriented activities Supporting error recovery Reducing textual information

Tutorial Example Smoking kids simulation Confirmed by middle school teachers as a big issue for this age group

Minimalist Tutorial Activity IActivity II Explore simulation Explore role of sickness variable Modify and test variable change Add new character Add rule of behavior for new character Reuse existing character,to create new character Create new appearances Edit a rule to use the new appearances correctly Add a new character to change the simulation

Procedure Participants: 10 middle school students Background survey Performed in usability testing lab study with “think aloud” protocol Recorded critical incidents Captured video, audio, and screen Subjective questionnaire, knowledge survey, retrospective interview

Observations and Results Duration minutes Activity I Duration minutes Activity II Most students were successful in modifying simulations and adding new characters. Usability satisfaction Easy and fun to use Would like to use it in their classes But needed more exposure to feel confident No problems with drawing tools Problems with tools for rule creation

Stagecast Usability Problems IssueLikely Cause Directing input to the wrong window Too many similar-looking windows Confused between rules and rule- actions lists Lists that look similar but have different meanings Select wrong iconMultiple similar icons Inability to find rules or other content in window Non-traditional method of scrolling Misunderstand spotlight and concept of stretching it Spotlight metaphor is not obvious or intuitive

Visual Programming Challenges Practical metaphors for icons Bigger Icons Fewer layers of scaffolding Relation between internal variables and visual state of the simulation. Role of visual context in rules Rules must match exact visual context, most PBD system make rules to specific to be reused

Minimalism All learners quickly engaged by activities Error recovery tools worked properly Most learners were able to recover without evaluator prompting Evaluator only provided assistance twice during entire experiment Minimal text, with screen shots and icons enabled rapid exploration

Collaboration Students were paired as driver&navigator. All groups had fun and except one group were very cooperative. Ex: Group2. The driver was inquisitive, but the navigator was more pragmatic which kept the group successfully on task.

Knowledge Survey Conducted to gauge user understanding Ideas for future simulations The role of variables Understanding visual context

Summary Minimalist Tutorial successful in exposing students to basics of visual programming All participants completed simple modification tasks. Students had problems matching visual state of rule to exact visual syntax. PBD great technique to get novices started quickly, but very limiting when trying to create sophisticated behaviors. Students are willing and able to use this tool to work on community related simulations.

Ongoing and Future Research Participatory Design Workshop with teachers and seniors Empirical analysis with students and seniors Workshop with students and seniors Gained broader insight into computing habits of these groups. Utilized this knowledge to refine Community Simulations.

Community Simulations

Acknowledgements NSF Graduate Research: NSF ITR Partnerships: Thanks to Stagecast Creator for allowing us to experimental test, review, and critique their software;Also to Montgomery County Schools teachers and students. Virginia Tech Center for HCI-Community Simulations Team: Mary Beth Rosson, John Carroll, Tracy Lewis, Erik Dooley, Justin Gortner, Jason Snook. Publications: Proceedings of IEEE Visual Languages 2001, CHI 2001, DIS 2002