Richard Wainess Dissertation Proposal v.3Presented 04/27/04 The Effect of Navigation Maps on Problem Solving Tasks Instantiated in a Computer-Based Video.

Slides:



Advertisements
Similar presentations
BLR’s Human Resources Training Presentations
Advertisements

The Computer as a Tutor. With the invention of the microcomputer (now also commonly referred to as PCs or personal computers), the PC has become the tool.
Training. Training & Development Definition “The systematic acquisition of attitudes, concepts, knowledge, roles, or skills, that result in improved performance.
Daniel C. Moos, PhD Amanda Miller (Elementary Teacher)
USEFUL LESSONS FROM ASSESSMENT IN AN ADULT LEARNING ENVIRONMENT: INSTRUCTIONAL STRATEGIES IN DISTANCE LEARNING Harry O’Neil University of Southern California.
The Effects of Achievement Priming on Expectations and Performance Kathryn Raso Team 14 PSY 321.
By : Zohreh Saadati Background and Purpose.
Cognitive Load Theory Sweller, van Merrienboer, and Paas, 1998 Psych 605 Fall 2009.
Chapter 14: Usability testing and field studies. Usability Testing Emphasizes the property of being usable Key Components –User Pre-Test –User Test –User.
Neag School of Education Using Social Cognitive Theory to Predict Students’ Use of Self-Regulated Learning Strategies in Online Courses Anthony R. Artino,
1 What do we Know about the Effectiveness of Instructional Strategies in Computer Games Harold F. O’Neil and Joan (Yuan-Chuang) Lang University of Southern.
Metacognition Helping students to self-regulate. Definitions  Metacognition - literally “beyond knowing”, knowing what one knows and doesn’t know - promoting.
1 Instructional Strategies to Improve Learning in Computer Games Harold F. O’Neil and Hsin-Hui Chen, University of Southern California/CRESST AERA v.5.
Integrating Educational Technology into Teaching Integrating Instructional Software into Teaching & Learning.
8/15/2015 Center for creative technologies Evaluating the Learning and Motivation Effects of Serious Games Richard E. Clark Rossier school of Education.
THE APPLICATION OF DUAL CODING THEORY IN MULTI-REPRESENTATIONAL VIRTUAL MATHEMATICS ENVIRONMENTS PME 31 SEOUL, KOREA July 8-13, 2007 Jennifer M. Suh, Ph.D.
1 Maximizing Learning in Online Training Courses: Meta-Analytic Evidence Traci Sitzmann Advanced Distributed Learning.
Richard Wainess Dissertation v.4Presented 12/09/05 The Effect of Navigation Maps on Problem Solving Tasks Instantiated in a Computer-Based Video Game Committee.
The effect of scaffolding students’ context-generating cognitive activity in technology-enhanced case-based learning Presenter: Zong-Lin Tsai Advisor:
Chapter 14: Usability testing and field studies
Cognitive Science “Instructional media are mere vehicles that deliver instruction but do not influence student achievement any more than the truck that.
Multimedia Learning Theory Tommy Gober, MS LeTourneau University.
The Cognitive Load Theory
Daniel C. Moos, PhD “I think I can!” Which motivation constructs are predictive of metacognition?
Cognitive Science “Instructional media are mere vehicles that deliver instruction but do not influence student achievement any more than the truck that.
 Increasing the amount of hours spent studying and doing homework on a daily basis  Increasing the amount of work completed while studying on a daily.
Brunning – Chapter 10 Technological Contexts for Cognitive Growth Learning is influenced primarily by good instructional methods that takes advantage of.
Instructional software. Models for integrating technology in teaching Direct instructional approach Indirect instructional approach.
DEVELOPING ART LESSONS WITH AT-RISK YOUTH AND ELLS IN MIND Delanie Holton Art Teacher Fletcher Primary and Intermediate Aurora, CO.
APA Format Abstract & Introduction Psychology 291 October 23, 2012.
The Relationship Between Student Satisfaction with Learning Online and Cognitive Load 16 th Annual Sloan Consortium International Conference on Online.
Tabbers Huib K, Martens Rob L, Merrienboer Jeroen J G van. Multimedia instructions and cognitive load theory: Effects of modality and cueing British Journal.
GETTING THE PICTURE The role of representational format in simulation-based inquiry learning Bas Kollöffel, Ton de Jong, & Tessa Eysink.
Effects of an Animated Pedagogical Agent with Instructional Strategies in Mutlimedia Learning Yung, H. I. (2009). Effects of an animated pedagogical agent.
Daniel C. Moos, PhD Caitlin Bonde. Overview Introduction Introduction to flipped classrooms Theoretical framework to examine learning Prior empirical.
Learning from errors and Feedback: Statistics Efficacy Dissertation Proposal CUI Department Simin Hall.
CRESST Conference Los Angeles, CA September 15, 2000 CRESST Conference 9/15/00 v.3 COMPUTER-BASED ASSESSMENT OF COLLABORATIVE PROBLEM SOLVING Harry O'Neil.
1 Multimedia-Supported Metaphors for Meaning Making in Mathematics Moreno & Mayer (1999)
Developing learner competency in the clinical environment GRACE Session 3 GRACE Program.
Seminar on Theories in Child Development: Overview Dr. K. A. Korb University of Jos.
Supporting learners with math anxiety: The impact of pedagogical agent emotional and motivational support 報 告 人:張純瑋 Baylor, A. L., Shen, E., & Warren,
1 Self-Regulation and Ability Predictors of Academic Success during College Anastasia Kitsantas, Faye Huie, and Adam Winsler George Mason University.
E-learning: The Science of Instruction Ruth Colvin Clark and Richard E Mayer Today we’ll cover: Chapter 1: e-learning: promise and pitfalls Chapter 2:
UCLA Graduate School of Education & Information Studies National Center for Research on Evaluation, Standards, and Student Testing The Potential of Games.
EDT 500 Session 03. SESSION OVERVIEW Share your Audience homework Audience Analysis Activity Case study activity Presentation fundamentals Share initial.
1/27 CRESST/UCLA DIAGNOSTIC/PRESCRIPTIVE USES OF COMPUTER- BASED ASSESSMENT OF PROBLEM SOLVING San-hui Sabrina Chuang CRESST Conference 2007 UCLA Graduate.
The effects of captions on deaf students’contents comprehension, cognitive load and motivation in online contents 21 June 2010 Joong-O Yoon
EFFECTIVELY INTEGRATING INSTRUCTIONAL SOFTWARE INTO TEACHING AND LEARRNING EVIRONMENT FOR THE HIGHEST POTENTIAL RELATIVE ADVANTAGE BY: BELTECH ETEC 602.
Does training on self-regulated learning facilitate students' learning with hypermedia Presenter: Jenny Tseng Professor: Ming-Puu Chen Date: March 15,
Sensory and Working Memories Reviewing Behaviorism Information Processing Memory Test your perception—top down or bottom up.
11/26/2015 Developing Intellectual Skills: What You Can Do To Help Your Students Help Themselves Friday, April 19, 2013.
Improving learning by teaching about learning Andreia Gomes.
Presenter: Han, Yi-Ti Adviser: Chen, Ming-Puu Date: March 02, 2009 Papastergiou, M.(2009). Digital Game-Based Learning in high school Computer Science.
Chapter 3 Human Resource Development
Research on Cognitive Load Theory and Its Design Implications for E-Learning Advisor : Ming-Puu Chen Reporter : Hui-Lan Juan Van Merriënboer, J.J.G., &
Developing e-Learning … November 22 nd, Objectives … Designing e-Learning e-Learning Principles Other Considerations Bringing it Together November.
Technology and Aging Eileen Wood. Why should we be talking about computers and aging? Social connections Independence Cognitive Skills.
SESSION FIVE: MOTIVATION INSTRUCTION. MOTIVATION internal state or condition that activates behavior and gives it direction; *desire or want that energizes.
The role of feedback and self-efficacy on web-based learning: The social cognitive perspective Presenter: Han, Yi-Ti Adviser: Chen, Ming-Puu Date: Jun.
STUDENT MOTIVATION TO LEARN CONCLUSION Motivation in education has a crucial impact on promoting student learning. The strategies of intrinsic and extrinsic.
Research on Cognitive Load Theory and Its Design Implications for E-Learning Jeroen J. G. van Merriënboer, Paul Ayres (2005). Research on Cognitive Load.
Using Worked Examples Dr. Mok, Y.F..
Cognitive Load and Learning Effects of Having Students Organize Pictures and Words in Multimedia Environments: The Role of Student Interactivity and Feedback.
Learning with Technology: Cognitive Tools in Multimedia Learning Materials 指導教授: Min-puu Chen 報告者 : Hui-lan Juan 報告日期: Kiili, K. (2004, July).
Harry O'Neil University of Southern California and The Center for Research on Evaluation, Standards, and Student Testing A Theoretical Basis for Assessment.
Model-Facilitated Learning Overview Gordon Graber 2008.
Interactive Media for Learning Why Are the Videos Doing All the Talking, Enable Your Students to Interact with Media! Kenith Wilson, M.Ed., Educational.
Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? 指導教授:陳明溥 學 生 :王麗君.
Cognitive Load Theory Sweller, van Merrienboer, and Paas, 1998
Presentation transcript:

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 The Effect of Navigation Maps on Problem Solving Tasks Instantiated in a Computer-Based Video Game Committee Members: Dr. Harold O’Neil (Chair) Dr. Richard Clark Dr. Edward Kazlauskas Dr. Janice Schafrik Dr. Yanis Yortsos (Outside Member) Richard Wainess Dissertation Proposal Presented to the Faculty of the Graduate School University of Southern California April 27, 2004 Slide 1 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Research Questions Will the problem solving performance of participants who use a navigation map in a 3-D, occluded, computer-based video game (i.e., SafeCracker®) be better than the problem solving performance of those who do not use the map (the control group)? Will the continued motivation of participants who use a navigation map in a 3-D, occluded, computer-based video game (i.e., SafeCracker®) be greater than the continued motivation of those who do not use the navigation map (the control group)? Slide 2 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Cognitive Load Theory Auditory/Verbal and Visual/Spatial Channels/Memory (Baddeley,1986; Mayer & Moreno, 2003) Limited Working Memory (Brunken et al., 2003) –7 +/- 2 (Miller, 1956) –Possibly only 2 or 3 novel elements (Paas et al., 2003) Unlimited Long-Term Memory (Mousavi et al., 1995) Cognitive Load = mental capacity imposed on working memory (Sweller & Chandler, 1994) –Controlled by schema development & Automation Words Pictures Prior Knowledge Selecting Words Working MemoryAudio/Visual Info Ears Eyes Sensory Memory Selecting Images Integrating Images SoundsVerbal Model Pictorial Model Organizing Words Organizing Images Mayer & Moreno, 2001 Slide 3 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Cognitive Load Theory (cont’d) Intrinsic Cognitive Load: The process of integrating new information with existing knowledge : e.g., working memory, long term memory, metacognition (Brunken et al., 2003; Paas et al., 2003). Germane Cognitive Load: The cognitive load required to process intrinsic load (Renkl & Atkinson, 2003). –Imposed by the environmental requirements related to learning (e.g., instruction, reading, searching, problem solving, interface elements) Extraneous Cognitive Load: Imposed by an unnecessary stimuli: e.g., interface artwork, extraneous sounds (Brunken et al. 2003). –Seductive Details (Mayer et al., 2001; Schraw, 1998). Learner Control: pacing & navigation (Barab et al., 1999; Cutmore et al., 2000) –Mixed or Negative Results (Bernard et al., 2003; Niemiec et al., 1996) Slide 4 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Games and Simulations Games: rules, constraints/privileges, imaginative, linear (Gredler, 1996) Simulation-Games: combination of games and simulations (Gredler, 1996) Motivation in games: fantasy, control & manipulation, challenge & complexity, curiosity, competition, feedback, fun Slide 5 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Games and Simulations Outcomes with Games and Simulations Positive outcomes: –Numerous knowledge outcomes attributed to games and simulations Warning about anecdotal and descriptive evaluations (Leemkuil et al., 2003; Wolfe, 1997) –Generalizable skills outcomes (Day et al. 2001; Green & Bavelier, 2003; Greenfield et al., 1994) Negative or null outcomes: –Reviews and meta-analyses cite mixed or negative reviews (Dekkers & Donatti, 1981; Druckman, 1995) –Positive attitude toward games doesn’t necessarily equal learning (Brougere, 1999; Salas et al., 1998; Salomon, 1984) Outcomes related to Instructional Design, not games/simulations (de Jong & van Joolingen, 1998; Garris et al., 2002; Gredler, 1996; Leemkuil et al., 2003; Thiagarajan, 1998) Slide 6 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Scaffolding (including Graphical Scaffolding) Instructional methods –Should keep cognitive load low (Clark, 2003) –External methods which replace internal processes (Clark, 2001) Scaffolding is an instructional method Scaffolding provides support during learning (Allen, 1997; Chalmers, 2003; van Merrienboer et al., 2002, 2003) Graphical Scaffolding –Includes maps and menus as advance organizers (Jones et al., 1995) –Maps supported by researchers as visual aids and organizers (Benbasat & Todd, 1993; Chou & Lin, 1998; Ruddle et al., 1999) –Should be used for visual tasks (Mayer et al., 2002) Slide 7 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Navigation Maps Navigation maps effective in 3-D, occluded, environments with simple problem solving tasks (Galimberti, 2001) Not yet examined Navigation in 3D, occluded, environments with complex problem solving tasks Slide 8 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Navigation Map Floor Plan of Mansion’s First Floor from SafeCracker® Slide 9 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Research Hypotheses Problem Solving –Hypothesis 1: Navigation maps will produce a significant increase in content understanding compared to the control group. –Hypothesis 2: Navigation maps will produce a significant increase in problem solving strategy retention compared to the control group. –Hypothesis 3: Navigation maps will produce a significant increase in problem solving strategy transfer compared to the control group. –Hypothesis 4: There will be no significant difference in self-regulation between the navigation map group and the control group. However, it is expected that higher levels of self-regulation will be associated with better performance. Motivation –Hypothesis 5: Navigation maps will produce a significantly greater amount of optional continued game play compared to the control group. Slide 10 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Method Design –Experimental: Random Assign to Treatment or Control Group –Treatment receives navigation map; Control Group doesn’t –Segregated group sessions: all Treatment or all Control Participants –60 males & females, ages 18-25, undergraduates at USC –No prior experience playing SafeCracker® Procedure ( 90 minutes ) –Demographic Information & Self-Regulation Questionnaire –Introduced to Knowledge Map –Handout Navigation Map to treatment group only –Introduced to the game ( interface, opening locks, finding objects ) –Pretest: Knowledge map Slide 11 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Method (cont’d) Procedure (cont’d) –Play game (first set of rooms) –Intermediate Test Knowledge Map; Retention/Transfer Questions; Task Check-List –Play Game (second set of rooms) –Post Test: Knowledge Map; Retention/Transfer Questions, Task Check-List –Debriefing –Optional playing time (up to 30 minutes) Measures –Problem Solving (O’Neil, 1999) Content Understanding Problem Solving Strategies Self Regulation –Motivation Verbalized desire to continue playing Amount of free play minutes Slide 12 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 key books crack room tool desk direction map safe clue brochure part of used for contains used for causes results from contains results from causes used for contains results from part of contains uses causes Sample SafeCracker ® Knowledge Map contains Slide 13 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Instrument: Problem Solving Retention & Transfer Questions Retention questions: 1.List how you opened the safe in the first room. 2.List how you opened the safe in the second room. Transfer questions: 1.List some ways to improve the way you solved opening the safe in room 1. 2.List some ways to improve the way you solved opening the safe in room 2. 3.List some ways to improve the way you navigated from room 1 to room 2. Slide 14 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Instrument: Self-Regulation Self-Regulation Questionnaire Based on O’Neil (1999) Problem Solving Model Trait self-regulation questionnaire (O’Neil & Herl, 1998). 32 Questions: 8 each of four measures –planning –self-checking/monitoring –self-efficacy –effort Slide 15 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Data Analysis Descriptive statistics: Means, Standard Deviation, etc., for all measures T-Tests for the following –Hypothesis 1: Navigation maps will produce a significant increase in content understanding compared to the control group. –Hypothesis 2: Navigation maps will produce a significant increase in problem solving strategy retention compared to the control group. –Hypothesis 3: Navigation maps will produce a significant increase in problem solving strategy transfer compared to the control group. –Hypothesis 5: Navigation maps will produce a significantly greater amount of optional continued game play compared to the control group. Pearson’s Correlation: Effect of the four self-regulation variables (planning, self-checking/monitoring, self-efficacy, and effort) on content understanding and problem solving strategies. –Hypothesis 4: There will be no significant difference in self-regulation between the navigation map group and the control group. However, it is expected that higher levels of self-regulation will be associated with better performance. Slide 16 of 16

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 BACK UP Slide 17

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Problem Solving Assessment Content Understanding Problem-Solving Strategies Self-Regulation Domain Specific Domain Independent MetacognitionMotivation PlanningSelf- Monitoring Effort Self- Efficacy Problem Solving O’Neil (1999) Problem Solving Model Slide 18

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Navigation Maps Navigation: Tracking one’s position in an environment to arrive at a destination (Cutmore et al., 2000) Occlusion: when a path is blocked visually (Cutmore et al., 2000) Navigation maps effective for occluded 3-D navigation (Cutmore et al. 2000; Dempsey, 2002) Navigation maps effective in 2-D environments with complex problem solving tasks (Baylor, 2001; Chou & Lin, 1998; Chou et al., 2000) Navigation maps effective in 3-D occluded environments with simple problem solving tasks (Galimberti, 2001) Not yet examined Navigation in 3D, occluded, environments with complex problem solving tasks Slide 19

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Instrument: Content Understanding Knowledge Mapping Software Slide 20

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Problem Solving Assessment Based on O’Neil’s (1999) Problem Solving Model –Requires content understanding, problem solving strategies, self- regulation Transfer questions are alternative to transfer tasks (Moreno & Mayer, 1998) Declarative knowledge measured by retention (Day et al., 2001) Knowledge map: concepts and links (Schau & Mattern, 1997) –Reflects the organization of knowledge (Day et al., 2001) –Reliable and efficient measure of Content Understanding (Herl et al., 1999; O’Neil, 1999; Ruiz-Primo et al., 1997; Schacter et al., 1999) –Predictive of both retention and transfer (Day et al., 2001) –Reliable measure of Problem Solving Strategies (Baker & Mayer, 1999) Slide 21

Richard Wainess Dissertation Proposal v.3Presented 04/27/04 Problem Solving Assessment (cont’d) Measuring Problem Solving Strategies –Domain general and specific (Alexander, 1992; Bruning et al., 1999) –Knowledge Mapping (Baker & Mayer, 1999) –Problem solving questions Positively correlated with retention and transfer (Mayer & Baker, 1998) Measuring Self-Regulation –Includes Metacognition & Self-efficacy (O’Neil, 1999) Metacognition: planning & self-checking (Pintrich & DeGroot, 1990) Self-efficacy: mental effort and self-efficacy (Zimmerman, 1994, 2000) –Trait self-regulation questionnaire (Hong & O’Neil, 2001) Includes planning, self-checking, mental effort, and self-efficacy 32 questions: 8 for each of the four sub-categories Slide 22