Measuring Skills Using Games What would you rather do … Take a test or play a game?

The Problem and Mission The value of Build-It-Yourself will be largely measured by how well we can prove that our students learn valuable skills. Tests are the most obvious way to measure skills. The Problem: No one likes to take tests! Our Mission: Create playful games that measure building skills quantitatively.

The Problem and Mission Target audience: Boys and girls 8 – 13. (playful) Parents (constructive) Game Attributes: 1)Takes less than 10 minutes to play. 2)Funky, game-like, inspired by Lemonade Stand and other Tycoon games. Choose an avatar. Your avatar will be presented with a problem. You must solve the problem. “There must be millions of people all over the world who never get any love letters... I could be their leader.” Charlie Brown “Honey, Where’s my super suit?” Mr. Incredible “Go in peace my daughter. And remember that, in a world of ordinary mortals, you are a Wonder Woman.” Queen Hippolyte Choose an avatar

Problem Solving Skills 1)Define and focus on a problem. 2)Research and build on the ideas of others. Don’t reinvent the wheel. 3)Teamwork. 4)Break a solution into simple parts. 5)Document. We want to measure how well kids know the problem solving process exercised in BIY workshops. If we cannot measure how well kids can execute the problem solving process in a short game, is it meaningful to measure how well they know a problem solving process? Lab books, finished projects and presentations are a reflection of execution.

Definitions of problem solving skills.

Measuring Skills Using Games Skill Game Storyline Prototypes Problem / Mission: 1)An important robot is broken. Fix it. (Benjamin) 2)Someone is in trouble. Rescue them. (Carolyn) 3)The economy is in trouble. Stimulate it. (Qin En)

Focus on a problem 1)View an animated clip that shows 5 things happening. and then select the best definition of the problem. (5 gold coins if you make the proper selection.)

Research Skills 1) Filter useful information from useless information. (15 of 45 bits of information are useful.) 2) Connect useful information (Decision is made that requires knowledge of two independent bits of information.) 3) Know what information is necessary to solve a problem. (Decision requires finding information in Google)

Teamwork Skills 1)Value team before individual success (Select 1 resume out of 10 that focuses on team before individual accomplishments.) 2)Communicate effectively (Select 1 resume out of 10 that communicates clearly, concisely and convincingly.) 3)Listen, be open minded, compromise, brainstorm (Select a decision that reflects compromise or win – win.) skilled / talented offer help contribute ideas if you pick bad teammates it becomes very hard to solve or your teammates will slow you down.

Break into simple parts 1)Break solution into simple, focused modules and tasks 2)Identify series vs parallel tasks

Documentation Skills 1)Clear 2)Well organized, easy to find specific info 3)Concise, Relevant, Accurate 4)Document results and edits Select user’s manuel that has 1, 2, 3 and / or 4 qualities.

Skill Measurement Matrix

Project Plan

Research Definition of problem solving skills 1) Identify the problem (Focus on problem) 2) Define the problem through thinking about it and sorting out the relevant information (Research) 3) Explore solutions through looking at alternatives, brainstorming, and checking out different points of view (Teamwork) 4) Act on the strategies (Break solution into simple parts) 5) Look back and evaluate the effects of your activity (Document) The University of Phoenix NO FUN way. Examples: Simple, intuitive, no graphics, makes you think strategically.

Skill Game Storyline Prototypes Problem / Mission: 1)An important robot is broken. Fix it. (Benjamin) 2)Explore a curious object on a remote planet. (Rahul) 3)Someone is in trouble. Rescue them. (Carolyn) 4)The economy is in trouble. Fix it. (Qin En)

RPG / Tycoon Style Game: You are a famous “Problem Solver.” (Trouble Shooter) Your fee is 50 gold coins to start plus A bonus (up to 50 GC) based on how well you solve a problem. You must make decisions that solve the problem. Each decision has a cost / benefit ratio. Your goal is to solve the problem at the lowest cost. (i.e. maximize your profit.) John’s notes for Game Graphics and Storylines:

RPG / Tycoon Style Game: A trailer presents a problem. You explore an RPG space and select: 1.Definition of the problem and goal. 2.The most important research info. 3.A strategy that solves the problem. 4.Teammates needed to solve the problem. 5.Documentation that enables your teammates to work together. John’s notes for Game Graphics and Storylines:

Intro trailer: John’s notes for Game Graphics and Storylines: Mr. Problem Solver You are … Ms. Trouble Shooter Click one

Intro trailer: The economy is in the toilet! Many kids do not have enough money to buy the candy or computer games they need. John’s notes for Game Graphics and Storylines:

Intro trailer: Some young BIY entrepreneurs have set out to build a robot that will provide a service, put people to work and make many on their team rich and famous beyond their wildest dreams. John’s notes for Game Graphics and Storylines:

Intro trailer: However, their business is failing. Your mission is to help them find the problem, fix it, and earn a fortune? John’s notes for Game Graphics and Storylines:

Intro trailer: You can go to … The Computer Cove to find information and document. John’s notes for Game Graphics and Storylines: Bank Headquarters

Possible problems: The socialists say, "There are too many greedy, scurrilous scoundrels and vile villains." A vile competitor stole your customers. The capitalists say, "Too many lazy no-gooders are looking for free rides. Not enough people are building.“ A vile employee is embezzling your profits. The robot never worked. Nobody wants to pay 25 cents. The robot costs more to run than it can earn. The robot was doing a robust business then it broke. John’s notes for Game Graphics and Storylines:

1.Financial history. 2.Parts life cycle. 3.People in the news. 4.Testimonials.

Bank Galaxy

Intro trailer: You can go to … Headquarters to recruit teammates and build. John’s notes for Game Graphics and Storylines: Bank Headquarters

Candidates Headquarters Game RoomKitchen

Wellesley Student $500/day Successful negotiator. Community organizer. Harvard Student $1000/day Can sell. Claims to be the best. MIT Student $2000/day Techno-guru. Hero is Ghandi. Applicants Value team before individual success Communicate effectively Listen, be open minded, compromise

High School Graduate $10/day Follows instructions and keeps it simple. Talks from the heart. BU Stud $400/day Doesn’t get bogged down with philosophy or politics. World Solitaire Champ ??? You design your own Teammate Applicants Value team before individual success Communicate effectively Listen, be open minded, compromise

Candidates Headquarters Game RoomKitchen

$10/day/employee 25% of prospects like the food. You can’t recruit good people with perks. $25/day/employee 50% of prospects like the food. Food is not a reason for joining your team. $50/day/employee 100% of prospects like the food. Many people want to work for you.

Intro trailer: You can go to … Bank Galactica to monitor your gold coins. John’s notes for Game Graphics and Storylines: Bank Headquarters

Bank Galaxy $56,735,000 Gold Coins Earned $Specifications $Research $Recruiting $Construction $Documentation $Balance Balance Sheet