July 8, 2008In vivo experimentation: 1 Step by Step In Vivo Experimentation Lecture 3 for the IV track of the 2011 PSLC Summer School Philip Pavlik Jr.

Slides:

Advertisements

Similar presentations

The Scientific Method: DR HERC

Advertisements

The scientific method Standard 9.

Discourse Analysis of Students’ Research Papers Roman Taraban Texas Tech University July 2010.

1 In-vivo research on learning Charles Perfetti PSLC Summer School 2009.

Using Statistics Effectively in Statistics Education Research Sterling C. Hilton Brigham Young University.

Supporting (aspects of) self- directed learning with Cognitive Tutors Ken Koedinger CMU Director of Pittsburgh Science of Learning Center Human-Computer.

July 14, 2009In vivo experimentation: 1 In vivo experimentation IV track Intro for the 2012 PSLC Summer School Philip Pavlik Jr. University of Memphis.

Engage! Think! Communicate!. Link professional world & student applications.

Explaining Contrasting Solution Methods Supports Problem-Solving Flexibility and Transfer Bethany Rittle-Johnson Vanderbilt University Jon Star Michigan.

Interview Effects on the Development of Algebraic Strategies Howard Glasser and Jon R. Star, Michigan State University Purpose/Objective This research.

Contrasting Examples in Mathematics Lessons Support Flexible and Transferable Knowledge Bethany Rittle-Johnson Vanderbilt University Jon Star Michigan.

In vivo Experimentation Timothy J. Nokes Pittsburgh Science of Learning Center Learning Research and Development Center University of Pittsburgh.

CLT Conference Heerlen Ron Salden, Ken Koedinger, Vincent Aleven, & Bruce McLaren (Carnegie Mellon University, Pittsburgh, USA) Does Cognitive Load Theory.

Learner Self-Correction in Solving Two-Step Algebraic Equations Brandy C. Judkins, School of Professional Studies in Education, Johns Hopkins University.

Educational Data Mining and DataShop John Stamper Carnegie Mellon University 1 9/12/2012 PSLC Corporate Partner Meeting 2012.

Science Inquiry Minds-on Hands-on.

Learning Sciences and Engineering Professional Master’s Program Ken Koedinger Vincent Aleven Albert Corbett Carolyn Rosé Justine Cassell.

Formulating an important research question Susan Furth, MD, PhD Welch Center for Prevention, Epidemiology and Clinical Research

1 Studying and achieving robust learning with PSLC resources Ken Koedinger HCI & Psychology CMU Director of PSLC.

Building Intelligent Tutoring Systems with the Cognitive Tutor Authoring Tools (CTAT) Vincent Aleven and the CTAT team 7th Annual PSLC Summer School Pittsburgh,

An analysis of generative dialogue patterns across interactive learning environments: Explanation, elaboration, and co-construction Robert G.M Hausmann.

PSLC DataShop Introduction Slides current to DataShop version John Stamper DataShop Technical Director.

Katie McEldoon, Kelley Durkin & Bethany Rittle-Johnson 1.

In Vivo Experimentation Lecture 1 for the IV track of the 2012 PSLC Summer School Philip Pavlik Jr. University of Memphis.

Additional Unit 2 Lecture Notes New Instructional Design Focus School of Education Additional Unit 2 Lecture Notes New Instructional Design Focus School.

NSS Learning and Teaching Strategies for the Chemistry Curriculum Series: (2) Active Reading and Writing Tasks Sing Yin Secondary School Mr. Hui Chi Kuen.

INTERNATIONAL SOCIETY FOR TECHNOLOGY IN EDUCATION working together to improve education with technology Using Evidence for Educational Technology Success.

Prompts to Self-Explain Why examples are (in-)correct Focus on Procedures 58% of explanations were procedure- based Self-explanation is thought to facilitate.

Skills Building Workshop: PUBLISH OR PERISH. Journal of the International AIDS Society Workshop Outline Journal of the International.

Usability testing. Goals & questions focus on how well users perform tasks with the product. – typical users – doing typical tasks. Comparison of products.

1 Cognitive Analysis of Student Learning Using LearnLab Brett van de Sande, Kurt VanLehn, & Tim Nokes University of Pittsburgh.

Why Do I Need to Do Science Fair? Real Research in the Real World!

The Open Learning Initiative (OLI) Candace Thille, Director, Open Learning Initiative.

Evidence-based Practice Chapter 3 Ken Koedinger Based on slides from Ruth Clark 1.

Curriculum Report Card Implementation Presentations

Noboru Matsuda Human-Computer Interaction Institute

Slide 1 Kirsten Butcher Elaborated Explanations for Visual/Verbal Problem Solving: Interactive Communication Cluster July 24, 2006.

Enquiry learning method. Outline of the presentation 1. What is enquiry? 2. Steps of enquiry learning 3. Definition of enquiry learning 4. Activity 5.

The Andes Intelligent Tutoring System: Five years of evaluations Kurt VanLehn Pittsburgh Science of Learning Center (PSLC) University of Pittsburgh.

Big data and learning: building and learning from LearnSphere (…because the next generation DataShop was just too incremental) John Stamper Pittsburgh.

Vincent Aleven & Kirsten Butcher Robust Learning in Visual/Verbal Problem Solving: Contiguity, Integrated Hints, and Elaborated Explanations.

1 Designing Knowledge Scaffolds to Support Mathematical Problem Solving Rittle-Johnson, B., Koedinger, K. R. (2005). Designing knowledge scaffolds to support.

SCIENTIFIC METHOD THE PROCESS OF THINKING SCIENTIFICALLY.

711: Intelligent Tutoring Systems Week 1 – Introduction.

1 Assessing Student Understanding David Niemi UCLA Graduate School of Education & Information Studies National Center for Research on Evaluation, Standards,

Black Box Activity: Scientific Process

Comparing Pedagogical Approaches for the Acquisition and Long-Term Robustness of the Control of Variables Strategy By: Michael São Pedro Advisor: Janice.

The Role of Comparison in the Development of Flexible Knowledge of Computational Estimation Jon R. Star (Harvard University) Bethany Rittle-Johnson (Vanderbilt.

The Power of Comparison in Learning & Instruction Learning Outcomes Supported by Different Types of Comparisons Dr. Jon R. Star, Harvard University Dr.

Data mining with DataShop Ken Koedinger CMU Director of PSLC Professor of Human-Computer Interaction & Psychology Carnegie Mellon University.

Aim: How can we use scientific inquiry to explain how the world works? DO NOW: In your notebook, describe what scientific inquiry means to you.

Writing Learning Outcomes Best Practices. Do Now What is your process for writing learning objectives? How do you come up with the information?

The Scientific Method. What is the scientific method? Collection of steps Attempt to solve a problem or answer a question Minimize the influence of bias.

The Scientific Method.

CCNT Lab of Zhejiang University

In vivo experimentation: An introduction

From the laboratory to the classroom: Creating and implementing a research-based curriculum around the use of comparison Courtney Pollack, Harvard University Dr.

Instructions Dear author(s),

Introduction to PSLC DataShop

Vincent Aleven & Kirsten Butcher

The Effect of Generation on Robust Learning

Unit 1 Scientific Inquiry

Curriculum design.

TAKS, Inquiry, Standards and Assessment

Research on Geoscience Learning

Julie Booth, Robert Siegler, Ken Koedinger & Bethany Rittle-Johnson

What Do Scientists Really Do?

Philip Pavlik Jr. University of Memphis

A Model for Building and Using Professional Learning Communities

A blueprint for experiment success.

Presentation transcript:

July 8, 2008In vivo experimentation: 1 Step by Step In Vivo Experimentation Lecture 3 for the IV track of the 2011 PSLC Summer School Philip Pavlik Jr. Carnegie Mellon University

July 8, 2008In vivo experimentation: 2 So, you want to run an in vivo experiment? u What is in vitro? –Self-explanation (Chi, Bassok, Lewis, Reimann, & Glaser, 1989) u What is in vivo? –Example take from: u Booth, Siegler, Koedinger & Rittle-Johnson (2008) Booth, Siegler, Koedinger & Rittle-Johnson (2008)

July 8, 2008In vivo experimentation: 3 Step 0 u Become an expert in a content area (e.g., electrodynamics). –Find a textbook –Talk to an expert –(Potentially the most time consuming step.)

July 8, 2008In vivo experimentation: 4 Step 1 u Hypothesis –Self-explanation: A self-generated explanation of presented instruction that integrates the presented information with background knowledge and fills in tacit inferences. (from pslc wiki) –Correct examples u Facilitate construction of high-feature validity knowledge components. –Incorrect examples u Weaken low-feature validity knowledge components.

July 8, 2008In vivo experimentation: 5 Step 2 u Select a domain –Algebra, geometry, physics, chemistry, Chinese, English u Select a LearnLab site –Riverview High School –Central Westmoreland Career & Technology Center u Talk with instructors –Collaboratively identify “hot spots” in curriculum.

July 8, 2008In vivo experimentation: 6 Step 3 u Develop materials –Assessments –Tutor implementation u Get IRB approval.

July 8, 2008In vivo experimentation: 7 Corrective self-explanation explanation of incorrect worked example

July 8, 2008In vivo experimentation: 8 Typical self-explanation explanation of correct worked example

July 8, 2008In vivo experimentation: 9 Step 4 Self-Explanation of Correct Examples NoYes No “As-is” Control Typical YesCorrective Typical + Corrective (half of each) Self-Explanation of Incorrect Examples Design Study

July 8, 2008In vivo experimentation: 10 Step 5 u Formulate a Procedure –Pretest u Two forms of the assessment –Intervention u Solve problems with Cognitive Tutor Algebra –Post-test u Talk alternate form of assessment

July 8, 2008In vivo experimentation: 11 Step 6 u Run experiment –Collect log files –Collect paper-based assessments u Send Log Data to DataShop –Test Hypotheses

July 8, 2008In vivo experimentation: 12 Step 7 u Report your results to the scientific community –Create a wiki page –Give a conference talk –Write a journal paper

July 8, 2008In vivo experimentation: 13 Number of correctly answered problems

July 8, 2008In vivo experimentation: 14 Number of conceptual errors

July 8, 2008In vivo experimentation: 15 Goto Step 1 u Using the results from your in vivo experiment: –Replicate with a new population –Replicate with a new domain –Replicate and Extend in a lab experiment

July 8, 2008In vivo experimentation: 16 Summary u Step: 0.Become an expert 1.Generate a hypothesis (in vitro => in vivo) 2.Select domain, site, instructors 3.Develop materials 4.Design study 5.Formulate a Procedure 6.Run experiment & log to DataShop 7.Report your results u Goto Step 1

July 8, 2008In vivo experimentation: 17 Any Questions?