CogSketch You Try It CPTTE 2016 Ken Forbus, Maria Chang, Madeline Usher Northwestern University

Overview Doing a worksheet –Drawing and labeling glyphs Making a worksheet –Tackling a common misconception What we’re not showing today –Using arrows (relation glyphs) to express relationships –Using annotations to provide additional information, like lengths and mass –These are described in the on-line tutorials and the manual

What You See When Starting CogSketch Choose Open Worksheet, select Cell worksheet

Cell/DNA worksheet Problem Statement = What you need to do Each element of the sketch is a glyph. Each needs to be drawn separately, or split later

Hit Finish Glyph when you’re done drawing the cell membrane

Conceptually Label What you Just Drew

CogSketch now knows what you mean

Still Need to draw the Nucleus and DNA

One Version of the Nucleus CogSketch perceives certain visual relationships, such as one glyph being inside another

Let’s be confused about the DNA

Choose the Feedback Tab

Click on Update to get advice

Select the Glyph Lasso, to move the DNA

Repositioned DNA – Note advice now out of date, so hashed out

Does the Earth go around the Sun, or does the Sun go around the Earth? Creating a Sketch Worksheet NSF, Science & Engineering Indicators 2014 Response of 26% of Americans Earth Sun

Cooking Show Model We have started such a worksheet We’ll walk through how it was made You will finish it

Sketch Worksheet Authoring 1.Create problem statement 2.Select subset of concepts student will see 3.Draw solution sketch –CogSketch automatically generates facts 4.Add coaching advice for important facts 5.Add grading rubrics

File, then New Worksheet Type in your Problem Statement

Sketch Worksheet Authoring 1.Create problem statement 2.Select subset of concepts student will see 3.Draw solution sketch –CogSketch automatically generates facts 4.Add coaching advice for important facts 5.Add grading rubrics

Select Workspace Concepts tab Collection = Concept. Think of them like sets

Start Typing a Concept Name You are browsing through the OpenCyc ontology, with 58,000 concepts. Finding the right concept can be tricky. But mostly CogSketch doesn’t care, which simplifies things.

Click Arrow to Include in Sketch

You can change the comments and name Can choose age-appropriate wording, or non-English language. CogSketch doesn’t care.

Picking Concepts, not Individuals

Adding the Orbit

Sketch Worksheet Authoring 1.Create problem statement 2.Select subset of concepts student will see 3.Draw solution sketch –CogSketch automatically generates facts 4.Add coaching advice for important facts 5.Add grading rubrics

Choose the Solution – Important Facts tab Select both of these

After Selecting Them

Draw Your Solution Make sure you’re in the Solution subsketch

A not-unreasonable solution sketch

Sketch Worksheet Authoring 1.Create problem statement 2.Select subset of concepts student will see 3.Draw solution sketch –CogSketch automatically generates facts 4.Add coaching advice for important facts 5.Add grading rubrics

Go back to Worksheet Properties Editor

Select Facts that must Hold in Student’s Sketch

Add Advice to Give if not True

Do this for all Important Facts

Sketch Worksheet Authoring 1.Create problem statement 2.Select subset of concepts student will see 3.Draw solution sketch –CogSketch automatically generates facts 4.Add coaching advice for important facts 5.Add grading rubrics

Points tied to Important Facts

Test by drawing solutions in the Workspace Should say Workspace

An Incorrect Solution

Make Sure they can Succeed

CogSketch Gradebook A tool for organizing and grading sketches submitted by students. The gradebook can contain multiple classes, each of which can have multiple assignments.

Gradebook: example grade report Opt-in “phone home” data collection, all identifying information removed

CogSketch Team + Collaborators CogSketch Developers (NU) –Ken Forbus –Madeline Usher –Andrew Lovett –Jon Wetzel –Maria Chang Geoscience Collaborators –Brad Sageman (NU) –Andrew Jacobson (NU) –Basil Tikoff (Wisconsin) –Bridget Garnier (Wisconsin) –Sarah Titus (Carleton) –Carol Ormand (Carleton) Psychology & Education Research Collaborators –Sian Beilock (U Chicago) –Dedre Gentner (NU) –Louis Gomez (Pitt) –Garett Honke (NU) –Susan Levine (U Chicago) –Nora Newcombe (Temple U) –Terry Regier (U Chicago) –Tim Shipley (Temple U) –David Uttal (NU) DTC Collaborators (NU) –Bruce Ankenman –John Anderson –Stacy Benjamin