1. BTL Learning by Doing in the Context of Distance Learning Allen Munro University of Southern California Rossier School of Education Behavioral Technology Laboratory in collaboration with UCLA-CRESST AERA San Diego, CA April 13, 2004

2. BTL Overview Learning in simulation contexts requires assessment and instruction in those contexts. Cost-effective development of simulations for training requires a consistent set of services. iRides Author was used to develop a ‘simulation’ that provides a decision aiding application to advanced students. Student use of this decision aiding tool can be automatically recorded for analysis.

3. BTL How Does Learning Happen in Simulation Contexts? Simulations ==> Learning ??? Military simulations often require human teachers, frequently with one or two teachers per student. Fully exploiting the computer Not only simulation interactions But also pedagogical interactions

4. BTL The Problem of Distance Learning in Simulation Contexts Simulation learning often requires human teachers/coaches; how to bring about learning without them? Provide an artificial tutor to handle the most frequently needed interventions!

5. BTL Modes of Training in Simulation Contexts Demonstration Often with explanation Can be student-paced Monitored Practice Tight monitoring—e.g., single track Loose monitoring—a variety of measures can be utilized to assess progress and generate advice

6. BTL Assessment in Simulation Contexts Summative assessments—Like practice, but without support features Micro-assessments Used during monitored practice Types Assessing actions Assessing effects Monitoring for special states

7. BTL Universal Architecture for Teaching in Simulation Contexts STUDENT TUTOR SIMULATION (or REAL SYSTEM) USES STUDENT SIMULATION SERVICES ARTIFICIAL TUTOR Human TutoringMachine Tutoring

8. BTL Universal Service Set for Simulations that Teach Report Object Selection Ignore Manipulations Resume Manipulations Draw Attention to Set Value / Set Values Perform Manipulation Pause/Resume Manipulation Require Manipulation Require State

9. BTL One Approach Authoring application Generates data that specify simulation behavior Delivery system Incorporates the set of services required Interprets data that specify simulation behavior Developers don’t have to figure out how to re- implement the services for every simulation STUDENT SIMULATION ENVIRONMENT SERVICES ARTIFICIAL TUTOR Machine Tutoring UNIVERSAL SIMULATION ENGINE

10. BTL Simulation Behavior and Instruction Authored Separately Simulation author—Behavior accuracy g Parallel_F Normal_F Normal_F = g * sin(20º) Parallel_F = g * cos(20º)

11. BTL Relational Descriptions of Behavior Simulation author—Natural specifications

12. BTL Complex Decision Making: Learning in the Context of a Tool Support systematic evaluation

13. BTL Complex Decision Example: Dealing with a Refueling at Sea Subsystem Crisis Vendor plans to leave the business. But your project requires RAS! Evaluate alternatives List possible approaches / decisions Consider possible outcomes Evaluate the utility of each outcome in terms of several attributes Estimate the probability of each outcome Tools support this process

14. BTL Huge Project Need to consider proximate & remote outcomes 18 years!

15. BTL Using the Tool: Edit Node Labels Name the alternative decisions, resulting events, and possible outcomes.

16. BTL Define ‘Utility’ in Context Decide on number and names of attributes Weight the attributes

17. BTL Assign Utilities using Attributes Give a number to each attribute of utility: Cost, Performance, and Schedule For every possible outcome, assign values

18. BTL Assign Probabilities to Outcomes When there are exactly two possible outcomes of an event, automatic adjustment occurs.

19. BTL Tracking Student Actions Utility attribute value changes Probability changes Threshold value changes Changes to attribute weights Creation/Deletion of nodes …

20. BTL Offering Instruction