COMP 7970 Playtesting Cheryl Seals

Slides:



Advertisements
Similar presentations
6.811 / PPAT: Principles and Practice of Assistive Technology Wednesday, 16 October 2013 Prof. Rob Miller Today: User Testing.
Advertisements

Web E’s goal is for you to understand how to create an initial interaction design and how to evaluate that design by studying a sample. Web F’s goal is.
Each individual person is working on a GUI subset. The goal is for you to create screens for three specific tasks your user will do from your GUI Project.
Deciding How to Measure Usability How to conduct successful user requirements activity?
PLAYTESTING GAME MOD WORKSHOP – BRIAN SCHRANK. YOU PLAYERS GAME X.
Speaking at GenCon: People Really DO Care!  Super easy to submit talks  Your description is your pitch  Your description should match your talk  Supply.
COMP 6620 Chapter Presentation Karthik Vemula. Agenda:-  User Centered Approach  Basic Activities of Interaction Design.  In Class Assignment.
MS3307 Methods. There are four essential activities Project stageDescription Requirements gatheringUnderstanding and specifying the context of use Requirements.
CS CS 5150 Software Engineering Lecture 12 Usability 2.
Project Work Playtesting + Postmortem. Plan for today Lecture + discussion Groups status report New Features /Changes in game engine LUNCH BREAK Group.
Focus Groups. Contents What is a focus group and why use it Methods When to use Focus Groups Advantages and Disadvantages Example.
Empirical Methods in Human- Computer Interaction.
Game playtesting, Gameplay metrics (Based on slides by Michael Mateas, and Chapter 9 (Playtesting) of Game Design Workshop, Tracy Fullerton) UC Santa Cruz.
Energy Information Administration Usability Testing Colleen Blessing.
Observation, Focus Groups, and Other Qualitative Measures
Part 4: Evaluation Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what, where, and when Chapter.
Fall 2006ITCS4230 Playtesting Tiffany Barnes
Nov 20, Fall 2006IAT 4101 Play Testing Software Testing Play Testing Team Structures.
Lecture 5 CS171: Game Design Studio 1I UC Santa Cruz School of Engineering 18 Feb 2010.
Testing and Modeling Users Kristina Winbladh & Ramzi Nasr.
Valve’s Design Process for Creating Half-Life 2  Presented by David Speyrer and Brian Jacobson.
Chapter 29 conducting marketing research Section 29.1
Damian Gordon.  Summary and Relevance of topic paper  Definition of Usability Testing ◦ Formal vs. Informal methods of testing  Testing Basics ◦ Five.
CS4455 CS4455: Video Game Design and Architecture Blair MacIntyre
8/9/2015Spring 2007COMP COMP 7970 Intro to Computer Game Design and Development Dr. Cheryl D. Seals Ramsey.
CS 4730 Play Testing CS 4730 – Computer Game Design Credit: Several slides from Walker White (Cornell)
Web Usability 101: Watch (and Discuss) A Live Test John Fritz UMBC.
Mantova 18/10/2002 "A Roadmap to New Product Development" Supporting Innovation Through The NPD Process and the Creation of Spin-off Companies.
Presentation: Techniques for user involvement ITAPC1.
Chapter 23 How to collect data. This chapter is about the tools/techniques used to collect data Hang on, let’s review: what are we collecting? What’s.
Playtesting Game Design Vishnu Kotrajaras, PhD. What is playtesting? Something a designer performs throughout the game design process, to gain insight.
FCN = Functionality, completeness, Balance. Refinement You have a playable system Play, tweak, play, tweak, play, tweak, … Question smaller and smaller.
S556 SYSTEMS ANALYSIS & DESIGN Week 11. Creating a Vision (Solution) SLIS S556 2  Visioning:  Encourages you to think more systemically about your redesign.
+ Interaction Design User Centred Design. + Does the Interface Make sense? Characteristics of successful ID Products makes sense to the users when they.
CHAPTER 1 Role of the Game Designer. AN ADVOCATE FOR THE PLAYER  The role of the game designer is, first and foremost to be an advocate for the player.
Think Game Play! advanced-prototyping/ 016.
This slide presentation is Confidential and Proprietary to ProtoTest LLC.
Usability Testing intro.12.ppt CS 121 “Ordering Chaos” “Mike” Michael A. Erlinger.
What is Usability? Usability Is a measure of how easy it is to use something: –How easy will the use of the software be for a typical user to understand,
Usability testing: A reality check for Plain Talk A brief overview October 7, 2008 Dana Howard Botka Manager, Customer Communications, L&I Plain Talk Coordinator,
CS2003 Usability Engineering Usability Evaluation Dr Steve Love.
Conducting Usability Tests 4 Step Process. Step 1 – Plan and Prep Step 2 – Find Participants Step 3 – Conduct the Session Step 4 – Analyze Data and Make.
Effective Methods for Educational Research The value of prototyping, observing, engaging users Diana Laurillard.
Team name Usability testing plan for BelleViews School of Business and Information Management Oulu University of Applied Sciences.
CS5714 Usability Engineering Formative Evaluation of User Interaction: During Evaluation Session Copyright © 2003 H. Rex Hartson and Deborah Hix.
12/6/ Spring 2009Computer Gaming1 COMP 7970 Intro to Computer Game Design and Development Dr. Cheryl D. Seals Shelby Center.
EVALUATION PROfessional network of Master’s degrees in Informatics as a Second Competence – PROMIS ( TEMPUS FR-TEMPUS-JPCR)
Z556 Systems Analysis & Design Session 10 ILS Z556 1.
March 24, Spring 2004CS44551 Play Testing Software Testing Play Testing Team Structures.
Why do we do research?. The one-on-one interview.
Marketing Research Aaker, Kumar, Day and Leone Ninth Edition Instructor’s Presentation Slides.
Usability Engineering Dr. Dania Bilal IS 587 Fall 2007.
UCI Library Website Chris Lee Archana Vaidyanathan Duncan Tsai Karen Quan.
1. TESTING with users... client dinners focus groups usability centers surveys web analytics beta testing pre-release TESTING with users...
Playtesting From “Game Design Workshop” By Tracy Fullerton, Christopher Swain And Steven Hoffman.
Sound Practices of Games Business and Design Presented by Brian Jacobson.
Creating User Interfaces User Observation assignment. Classwork / Homework: get started.
Playtesting.
Testing Multimedia Products
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Presented by Arseniy Mstislavskiy
Usability Evaluation, part 2
IENG 451 / 452 Voice of the Customer: Analysis (KANO, CTQ)
Game playtesting, Gameplay metrics (Based on slides by Michael Mateas, and Chapter 9 (Playtesting) of Game Design Workshop, Tracy Fullerton) UC Santa Cruz.
Collaboration with Google Drive
Chapter 23 Deciding how to collect data
Game Project IMGD 4000 Due Dates: Form Teams Treatment Website
Evaluation tools training
Empirical Evaluation Data Collection: Techniques, methods, tricks Objective data IRB Clarification All research done outside the class (i.e., with non-class.
Presentation transcript:

COMP 7970 Playtesting Cheryl Seals

COMP 7970 Assignment Read Chapter 8 Game Design Workshop: Designing, Prototyping, and Playtesting Games By Tracy Fullerton, Chris Swain, Steve Hoffman 7.html

COMP 7970 Playtest & Final report Select playtesters: friends/classmates, not on team 5+ required; plan the playtest (see rest of slides) Observe playing your game –What is harder/easier than expected Interview them after –What was fun about the game –What could be improved: short & long term Improve the game based on comments! Read and follow directions on: up_Project_Specs.doc up_Project_Specs.doc

COMP 7970 What is Playtesting? The “most important” activity in game design It is NOT: –Casual weekend gaming Just “play the game and gather feedback” might not reveal real issues with the game –Internal Design Review with team Designer & team play the game and talk about the features Need real players –Bug Testing by QA team for debugging QA team goes through and rigorously test each element of software for flaws –Focus Group Testing Marketing exec sit behind two way mirror watching sample group play and discuss the game with a moderator asking them how much $$$ they would pay for game –Usability Testing Systematically analyze how user interacts with your software by recording their mouse movements, eye movements, navigation patterns, etc.

COMP 7970 What is Playtesting? It is –Something the designer performs through the entire design process –Getting insight into how players experience game –Informal/qualitative  structured/quantitative Somewhere along this continuum –Answers questions Is the game functioning the way you want? Internally complete? Balanced? Fun?

COMP 7970 When do we Playtest? Iterative Less fundamental changes as process progresses “Let’s wait till we have a beta product…Players will get the best experience” –NO!

COMP 7970 Model for iterative game design: Playtest, evaluate, and revise

COMP 7970 Steps in Playtesting Selection Recruiting Preparation Controls Analysis

COMP 7970 Recruiting and Selection Self testing –Reveal glaring problems Then testing with friends –Not objective Then test with strangers –Selection is important –Target demographics –…but widest selection possible (AOE II case study)

COMP 7970 Age of Empires II Case Study Graph of player Errors over time

COMP 7970 Running a playtest session Don’t talk too much –Use a script Let the user make mistakes/figure things out “It’s the game that’s broken, not you” Think Aloud –This practice has players talking constantly while playing –Can be distracting, but can give some good insight Interview/survey –Beware of leading questions

COMP 7970 Running a playtest session Don’t be defensive –Beware…testers will want to please you] –Really! Groups generate ideas Individuals evaluate Can use groups, individuals, or combination

COMP 7970 The Play Matrix Core aspects of all interactive experiences Stimulates discussion Have tester analyze gameplay using matrix Should your game be moved in the matrix?

COMP 7970 Play Matrix

COMP 7970 Running a playtest session Note taking critical –Video or audio recording Interview –Game specific questions needed –Don’t wear out your participant

COMP 7970 Playtest data Objective or subjective Quantitative or qualitative? What can you measure? –Develop clearly defined questions to answer with data Test control situations –New feature, special event, common technique, the end of the game