Inside the Mind of the 21st Century Customer Alan Page.

Slides:



Advertisements
Similar presentations
Web Marketing for Dummies Written by Jan Zimmerman Reviewed by Paige Petersen.
Advertisements

Smart-e or Smart-pants Retail Marketing & Advertising: How are we doing?
When you read a passage or an article,the first thing you should do is to feel the language … There are two tasks for you to accomplish when you experience.
Twitter – what is it? The School District of Haverford Township |
Student PowerPoints For IEPs
North Carolina State University ©2004 Labwrite Project.
1 Google’s Goals, User Experience Challenges Maria Stone 10/08/07 based on earlier talks by Jen Fitzpatrick, Jenny Gove, Deepak Menon and Michael Margolis.
1 Box Overview Session Getting Started on Box. 2 Agenda What is Box? Box Basics Live Q&A.
Website Design. Designing and creating different elements involved in developing a website for e- commerce can help you identify and describe the components.
Microsoft SharePoint 2010 Upgrade Preview FSU SharePoint Users Group Presents: Thursday, December 1 st, 2011.
SuccessNet- enVision Math’s online digital tool for home or school
The basics of the Online Portal
CS 235: User Interface Design February 17 Class Meeting Department of Computer Science San Jose State University Spring 2015 Instructor: Ron Mak
What a Student with Learning Difficulties Might Say Things to look for in your conversations with students. You can learn a lot about a student from the.
Microsoft ® Office 2007 Get up to speed with the 2007 system Murray State University College of Education:
Microsoft Windows LEARNING HOW USE AN OPERATING SYSTEM 1.
Why do I Need Multiplication? and how can I make it fun to learn?
GETTING STARTED 1. Click on the START menu and go up to UDT SOFTWARE, then drag over to Microsoft Office, and then down to Power Point 2. Select a theme.
Ronny Kohavi with Alex Deng, Brian Frasca, Roger Longbotham, Toby Walker, Ya Xu Slides available at
Could You Use More Traffic?. If you’re like most marketers, the answer to this question is… YES!
1 Direct Manipulation Proposal 17 Direct Manipulation is when physical actions are used instead of commands. E.g. In a word document when the user inputs.
North Carolina State University ©2005 Labwrite Project.
1. 2 OVERVIEW First Impressions Content Purpose Design Distinction Closing.
VoiceThread:. With VoiceThread, group conversations are collected and shared in one place from anywhere in the world. All with no software to install.
Testing the Xbox
Simple Shutterfly Classroom Website Creation Presented by Kristen Frame First Grade Teacher, Propel Montour
“The Power At The Click Of A Mouse” (Using Power Point To Create A Presentation)
Class Usability Experience User slides are in BLUE.
How would you optimize your SEM campaigns to get improve the efficiency?
Basic ICT Skills Getting to know Microsoft ® Office 2007 Get up to speed with the Office 2007 system.
Unit 1 – Improving Productivity Instructions ~ 100 words per box.
Create Rubrics for your Project-Based Learning Activities.
1 LIZETTE PEREZ IS 440 FEBRUARY 21, 2008 Modeling/Markup Tools: Skrbl ConceptShare ImaginationCube 1.
MADISON’S PITTSBURGH SPORTS BAR INFORMATIONAL PRESENTATION At The Pittsburgh Sports Bar we want to deliver a perfect location for fans of Pittsburgh-area.
From Pure Math to Data Science: My Perspective Paul Raff Principal Data Scientist, Analysis and Experimentation, Microsoft October 1, 2015 My
There are many holidays. At my school some of the holidays we celebrate are.
The problem that needs to be solved is if a computer career is for me.
What’s OPAC? A Guide to Acadia’s Online Catalogue.
Usability Olaa Motwalli CIS764, DR Bill – KSU. Overview Usability factors. Usability guidelines.  Software application.  Website. Common mistakes. Good.
THE “COLLEGES I AM THINKING ABOUT” LIST IN YOUR FAMILY CONNECTIONS ACCOUNT.
BLOG STARTUP. What is a blog A Blog (or weblog) is an online journal or ‘diary’ that can be immediately and easily updated. A Blog can consist of a list.
CONFIDENTIAL The Wonders of A/B Tests Some info on what you hear those people down in Consumer Insights talking about from time to time…
Your good friend enjoys uploading videos to the internet sharing top tips for Minecraft. Yesterday you went to check out his latest post and.
GOOD WEB HOSTING FOR YOUR BUSINESS. Web Host o Business, nowadays, use the Internet to tap potential customers and stay in touch with existing clients.
Reading Comprehension Strategies
Usability Testing and Web Design
TexasRealEstate.com Connect with consumers across Texas
101.
The Video About Me.
Create your Benner - intro
Get Your Food Habit Right By Opting A Food Delivery Service
Calculus Jeopardy Hosted by Bannon Welcome to Power Jeopardy
Collaboration with Google Docs
5 Principles That Shape The Best User Experience | Ui/Ux Development Company
Using OneDrive.
KELLER WILLIAMS REALTY
TexasRealEstate.com Connect with consumers across Texas
Addendum: Due to the breakneck speed at which this game was created, there are an ENORMOUS number of “crackhead” errors. Find them for board trip credit!
KELLER WILLIAMS REALTY
How to use PSCEZPRINT Web site address: prairiestate.edu/ezprint
Star Math PreTest Instructions For iPad users with the STAR app
Calculus Jeopardy Hosted by Bannon Welcome to Power Jeopardy
Mostly Solving Equations
Introduction When searching for a new mattress, you have to make sure you know where to go to find the best one. The mattress you sleep on is going to.
Blackboard Tutorial (Student)
Chartboost Help Site Competitive Analysis and Proposal
Federation Partnership Marketing Kit: Step by Step Guide
Homepage and taglines.
Степень с натуральным показателем
North Carolina State University
Presentation transcript:

Inside the Mind of the 21st Century Customer Alan Page

Evaluating a Scenario Ease of use Responsiveness UsefulnessVisual Appeal

Example: Showcase (marketing speak) Scenario (project manager speak) End-to-End Test (something actionable) (Optional) Variations Xbox Knows You Better Identity Step in front of the console, get recognized and see my curated content Light/Dark settings Child/Adult/Gender/Height/Size/Apparel Curated content

Ease of Use Am I able to complete the scenario? Is it complicated? Do I need to perform extraordinary steps to get what I need done? Are there glitches in the system that make it difficult? Was it hard to find how to execute this scenario? Are the features hidden? Is the experience consistent?

Responsiveness Did I feel like the scenario was fast and fluid? At any point did I feel like I had to wait a frustrating amount of time? Was I effectively distracted while waiting for an action to take place? (ex. Movie or animation while I wait)

Usefulness Would you use this scenario yourself to accomplish this specific outcome? Does this scenario meet a need for our consumer? Does this let me do something that I want to do?

Visual Appeal Is the experience exciting to see and hear? Is the UI polished? Does the UX make the experience enjoyable?

Evaluation Scale 5 Love It! – You love it so much you’d shout it out at the top of your lungs through a bullhorn from every rooftop you encounter 4 Like It – You like it a lot and might mention it during a lull in conversation at a dinner party 3 Meh – You can live with it and neither like it or hate it. It’s nothing special. There are some improvements that can be made 2 Don’t Like It – The experience leaves a bad taste in your mouth. You’d use it if you really had to otherwise, you’d stay away from it. 1 Hate it! – You hate it so much that you would only use it if you were under a Hogwarts compulsion spell 0 Not Implemented

ScenarioLove ItLike ItMehDon't LikeHate Do this Do that Do the other thing Do something else

Controlled “A/B” Experiments Concept: Randomly split traffic between two (or more) versions A (Control) B (Treatment) Collect metrics of interest Analyze

Let’s play a game Three choices are: A wins B wins A and B are approximately the same (*) results based on statistically significant data

MSN Real Estate “Find a house” widget variations Revenue to Microsoft generated every time a user clicks search/find button Raise your left hand if you think A Wins Raise your right hand if you think B Wins Don’t raise your hand if you think they’re about the same A B

MSN Real Estate If you did not raise a hand, please sit down If you raised your right hand, please sit down A was 8.5% better

Office Online Test new design for Office Online homepage A Clicks on revenue generating links (red below) Raise your left hand if you think A Wins Raise your right hand if you think B Wins Don’t raise your hand if you think they’re about the same B

Office Online If you did not raise a hand, please sit down If you raised your right hand, please sit down A was 64% better The Office Online team wrote A/B testing is a fundamental and critical Web services… consistent use of A/B testing could save the company millions of dollars

MSN Home Page Search Box Click-through rate for Search box and popular searches A B Differences: A has taller search box (overall size is the same), has magnifying glass icon, “popular searches” B has big search button Raise your left hand if you think A Wins Raise your right hand if you think B Wins Don’t raise your hand if they are the about the same

Search Box Search Box If you raised any hand, please sit down Don’t change for the sake of change Sometimes what you have is enough 24

Tester Developer Designer

Math Geek Developer Designer

Choose your test / experiment Measure the results Determine what to do next

BuildMeasureLearn

“Given the baseline conversion rate on opens, the sample size simply isn’t large enough to get a reliable result.”

Tracing (Build) Collect Logs & upload (Measure) Analyze (Learn) startTime = GetTime()); CoolActivity(); Trace(ID, ACTIVITY_LENGTH, GetTime() - startTime)

Is your product ready to ship?

Does your product satisfy your internal quality criteria? Is your product ready for customer feedback? Is your team ready for customer feedback?

There are no Silver Bullets

Customer data can help Use both qualitative and quantitative data Customer data can replace some testing Data does not replace excellent human testing