Simple Sequencing Part 2 Neil Cramer, Manager Instructional Systems Northwest Airlines neil.cramer@nwa.com

Overview Review of Basics IMS Sequencing Models Use Case Resources Definition and Tracking Process Utilities Use Case Resources

What is Simple Sequencing? A method for representing the intended behavior of an authored learning experience Any sequencing engine (e.g. LMS) can provide consistent sequencing of learning activities Based on properties and conditional rules Controls the launching of activities and access to learning resources The manifestation of an instructional strategy

What Simple Sequencing is Not AI based sequencing Schedule based sequencing Sequencing requiring data from closed systems and services (e.g. embedded simulations) Collaborative learning Customized learning Synchronization between multiple parallel learning activities Does not recognize activities of instructors, mentors, peers, etc.

Relation to Content Packaging Simple sequencing is based on the organization and structure of the Content Packaging Model Simple Sequencing does not require Content Packaging be used Currently Content Packaging is the only mechanism for exchanging definition instances

Overview of Sequencing Process WAIT for Navigation Request (Start, Resume, Choice) Navigation Event (Continue, Previous, Choice, Exit, etc.) Sequencing Process Navigation Behavior Termination Request Termination Behavior Rollup Behavior Sequencing Request Sequencing Behavior LMS Delivery Request Delivery Behavior

Activity Tree Course Lesson 1 Lesson 2 Lesson 3 Module 1 Module 1 Topic 1 Topic 2 Module 4

Components of Sequencing Sequencing Definition Model Tracking Model Activity State Model Navigation Behavior Model Termination Behavior Model Rollup Behavior Model Selection and Randomization Behavior Model Sequencing Behavior Model Delivery Behavior Model Utility Processes

Sequencing Definition Model The intended sequence and interaction with learning activities is described by these attributes: Sequencing Control Modes Sequencing Rules Limit Conditions Rollup Rules Objectives Objective Map Rollup Controls Selection Controls Randomization Controls Delivery Controls

Sequencing Control Modes Type of sequencing behavior applied to a learning activity Optional (defaults may be assumed) Not exclusive; multiple control modes may be specified

Control Modes Choice Choice Exit Flow Forward Only Use Current Attempt Objective Information Use Current Attempt Progress Information

Sequencing Rule Specifies details of rule-based behaviors for an activity Sequencing process may reference any rule(s) in the activity tree Any activity may have multiple rules (or none) or multiple conditions with Boolean logic applied Each condition references one objective in the Tracking model for the activity One action results when the rule conditions evaluate to true

Rule Attributes Condition Combination Rule Conditions Rule Action How rule conditions are combined (any, all) Rule Conditions One or more Rule Action Desired sequencing behavior if condition(s) met Precondition actions Post condition actions Exit actions

Rule Conditions Satisfied Objective Status Known Objective Measure Known Objective Measure Greater Than Objective Measure Less Than Completed Activity Progress Known Attempted Attempt Limit Exceeded Time Limit Exceeded Outside Available Time Range Always

Additional Attributes Rule Condition Referenced Objective Rule Condition Measure Threshold Rule Condition Operator

Precondition Actions Skip Disabled Hidden from Choice Stop Forward Traversal Ignore

Post Condition Actions Exit Parent Exit All Retry Retry All Continue Previous Ignore

Exit Actions Exit Ignore

Limit Conditions Define the constraints on access to an activity Can be assigned to any (or none) of the activities in the tree

Limit Conditions Attempt Control Attempt Limit Attempt Absolute Duration Control Attempt Absolute Duration Control Limit Attempt Experienced Duration Control Attempt Experienced Duration Control Limit Activity Absolute Duration Control Activity Absolute Duration Control Limit Activity Experienced Duration Control Activity Experienced Duration Control Limit Begin Time Limit Control Begin Time Limit End Time Limit Control End Time Limit

Auxiliary Resource Defines auxiliary resource associated with an activity When activity is available auxiliary resource(s) are available Sequencing process many reference any (or no) auxiliary resources in the activity tree

Auxiliary Resource Attributes Resource ID Purpose (open vocabulary)

Rollup Rule Define how child activities influence Objective and Activity/Attempt Progress information in the Tracking model Sequencing process many reference any (or no) rollup rules in the activity tree Activities may have multiple (or no) rollup rules and/or conditions with Boolean logic Each condition references an item in the Tracking model There is one action that may result when the conditions evaluate to True May set Attempt Completion Status or Objective Satisfied Status

Rollup Rule Attributes Rollup Child Activity Set All, Any, None, At Least Count (Rollup Minimum Count), At Least Percent (Rollup Minimum Percent) Condition Combination (all, any) Conditions/Condition Operator Rollup Action

Rollup Conditions Satisfied Objective Status Known Objective Measure Known Completed Activity Progress Known Attempted Attempt Limit Exceeded Time Limit Exceeded Outside Available Time Range Never

Rollup Action Satisfied – Objective Progress Status set to True and Objective Satisfied Status set to True Not Satisfied – Objective Progress Status set to True and Objective Satisfied Status set to False Completed – Attempt Progress Status set to True and Attempt Completion Status set to True Incomplete – Attempt Progress Status set to True and Attempt Completion Status set to False

Objectives Defines the learning objectives associated with an activity Activities may have an unlimited number of objectives Tracking model defines the set of data that records satisfaction status and measures for each objective for each attempt on the activity Sequencing process may reference any local objective for an activity Objective Map allows process to reference global objectives Activity must have at least one objective Activity may have only one objective that contributes to rollup

Objective Attributes Objective ID Objective Satisfied by Measure Objective Minimum Satisfied Normalized Measure (-1 to 1) Objective Contributes to Rollup

Objective Map Defines mapping of local objective to and from shared global objective Activities can have unlimited number of objectives maps Objective map is evaluated whenever local objectives are evaluated as determined in the Tracking model Read map (local) and write map (global) tied to one objective

Objective Map Attributes Activity Objective ID Target Objective ID Read Objective Satisfied Status Write Objective Satisfied Status Read Objective Normalized Measure Write Objective Normalized Measure

Rollup Controls The definition of rollup behavior when Objective Contributes to Rollup is True Rollup Objective Satisfied Rollup Objective Measure Weight Rollup Progress Completion

Selection Controls Description of how Child activities should be selected in the sequencing process Selection Timing – Never, Once, On Each New Attempt Selection Count Status (True/False) Selection Count – how many must be selected

Randomization Controls Determines how Child activities are ordered during the sequencing process Randomization Timing – Never, Once, On Each New Attempt Randomization Children (True/False)

Delivery Controls Describe actions and controls used when an activity is delivered Objective, Activity, and Attempt Progress Data are recorded on delivery Tracked (True/False) Completion Set by Content (True/False) Objective Set by Content (True/False)

Tracking Model Describes the results of learner interaction with activities Information Model Objective Progress Information Activity/Attempt

Objective Progress Information The results of learner interactions relative to an objective Objective Progress Status Objective Satisfied Status Objective Measure Status Objective Normalized Measure

Activity Progress Information Activity Progress Status Activity Absolute Duration Activity Experienced Duration Activity Attempt Count

Activity Duration Tracking TIME Begin Resume Resume Attempt 1 Attempt 2 Attempt 3 Terminate w/ Suspend Terminate w/ Suspend Terminate Activity + + Activity Experienced Duration Activity Absolute Duration

Attempt Progress Information Attempt Progress Status Attempt Completion Amount (0…1) Attempt Completion Status Attempt Absolute Duration Attempt Experienced Duration

Activity State Model Describe the state of learner interaction with activities Do not reference any specific sequencing definition or rule Control the overall sequencing process Information Model Activity State Information Global State Information

Activity State Information Describes a learner’s state or status in an activity Activity is Active Activity is Suspended Available Children

Global State Information Describes the learner’s state or status within the overall sequenced learning experience Current Activity Suspended Activity

Overall Process Combines and relates other models to produce a complete sequenced learning experience Navigation Behavior Model/Process Termination Behavior Model/Process Selection and Randomization Behavior Model/Process Sequencing Behavior Model/Process Delivery Behavior Model/Process

Navigation Event Source Overall Process Flow Navigation Event Source Overall Process Navigation Behavior Termination Behavior Rollup Behavior Sequencing Behavior Delivery Behavior Navigation Request Navigation event is translated into navigation request Possible Termination Request and/or Sequencing Request Termination Request Invoke Rollup Possible Sequencing Request Sequencing Request Possible Delivery Request Delivery Request Content Delivery Possible Identification of Learning Resources

Navigation Behavior Model Learner interactions and choices are navigation events that generate navigation requests Navigation requests map to termination requests and to sequencing requests Navigation process uses data from the Sequencing Definition model and Activity State model but not from the Tracking model

Navigation Requests Start Resume All Continue Previous Forward Backward Choice Exit Exit All Suspend All Abandon Abandon All

Termination Behavior Model Process of evaluating exit actions and post condition sequencing rules, recording information about the state of an activity, and terminating other activities based on sequencing behaviors Uses sequencing rule definitions, tracking information (objective/progress), and activity state information Triggers Rollup process

Termination Requests Exit Exit All Suspend All Abandon Abandon All

Rollup Behavior Model Process of determining the result data for an activity from the result data of child activities Applied to the Tracking model Controlled by parts of the Sequencing Definition model Rollup Controls Rollup Rule Definitions Objective Description Delivery Controls

Measure Rollup Process Determines and computes the normalized measure for the objective that is tied to the activity (children) Controlled by Rollup Objective Measure Weight and Delivery Control value Tracked

Objective Rollup Process Determines the status of the objective associated with an activity from the values of objective information associated with the children of the activity Controlled by Rollup control Rollup Objective Satisfied Status and the Rollup rules Applies, in order, Measure-based computation, Rule-based computation, and Default Rule-based computation

Activity Progress Rollup Process Determines the completion status of the current attempt on an activity from the completion status of the children of the activity Defined by a Rule-based computation or Default Rule-based computation

Selection and Randomization Behavior Model Determines how elements of the activity tree are ordered and selected during the sequencing process Process operates on activities at any level that have children Selection and Randomization persist as long as activity (or children) are active (even if suspended) Process controlled by Selection controls and Randomization controls from the Sequencing Definition Model and Activity State information Child activities are selected and/or randomized prior to selecting the activity to be delivered

Sequencing Behavior Model Determines the content object to deliver (or error) upon receiving a sequencing request Controlled by Sequencing Control Modes, Sequencing Rule Definitions, Limit Conditions, Objective Description Uses information from the Tracking and Activity State models

Sequencing Processes Rule Check Process Check Activity Process Flow Subprocesses Choice Start Resume Continue Previous Retry Exit

Delivery Behavior Model Determines what content and/or auxiliary resources should be delivered to the user Determines whether the activity may be delivered Initiates the content delivery Updates appropriate components of the Tracking and Activity State models

Utility Processes Limit Conditions Check Process Sequencing Rules Check Process Terminate Descendant Attempts Process End Attempt Process

Boeing Fuel Valve Removal Use Case Part of maintenance tech curriculum Removal of fuel valve for service Removal of appropriate door and the fuel quantity transmitter to access valve Introduction block, lesson block, access to Interactive Electronic Technical Manual (IETM), Test block

Course Structure Fuel Valve Introduction Fuel Valve Lessons Tests IETM Each block must be completed before the next block is available Upon completion of first block only first two items of second block are enabled. Student can taken them in any order Must complete first two before proceeding to third lesson Must take third lesson in order. IETM is available at any time Tests enabled only after completion of lessons If test is failed remediate back to that lesson then take test a second time If test is passed move to second part of test If test is failed again student is remediated again and fails course On completion of first test student moves to simulation test Student must perform correct steps in order within time limit IETM available during performance test Fuel Valve Lesson Intro Fuel Valve Theory Of Operation Fuel Valve Lessons Fuel Valve and Quantity Transmitter Components Fuel System Hazards Fuel Valve Removal Procedure Preparation Remove Door Remove Transmitter Remove Valve Tests Knowledge Test Fuel System Components Fuel System Hazards Performance Test (simulation) IETM Removal Simulation Indicates is visible on menu

Fuel Valve Introduction Fuel Valve Lessons Tests Choice Fuel Valve Introduction Each block must be completed before the next block is available Flow Fuel Valve Lesson Intro Flow Fuel Valve Theory Of Operation Flow Fuel Valve Lessons Fuel Valve and Quantity Transmitter Components Fuel System Hazards Fuel Valve Removal Procedure Preparation Remove Door Remove Transmitter Remove Valve Flow Tests Knowledge Test Fuel System Components Fuel System Hazards Performance Test (simulation) IETM Removal Simulation Indicates is visible on menu

Fuel Valve Introduction Fuel Valve Lessons Tests Satisfied Fuel Valve Introduction Each block must be completed before the next block is available Upon completion of first block only first two items of second block are enabled. Student can taken them in any order Must complete first two before proceeding to third lesson Fuel Valve Lesson Intro Fuel Valve Theory Of Operation Fuel Valve Lessons Choice Fuel Valve and Quantity Transmitter Components Choice Fuel System Hazards Flow Fuel Valve Removal Procedure Preparation Remove Door Remove Transmitter Remove Valve Tests Knowledge Test Fuel System Components Fuel System Hazards Performance Test (simulation) IETM Removal Simulation Indicates is visible on menu

Fuel Valve Introduction Fuel Valve Lessons Tests Each block must be completed before the next block is available Upon completion of first block only first two items of second block are enabled. Student can taken them in any order Must complete first two before proceeding to third lesson Must take third lesson in order. IETM is available at any time Fuel Valve Lesson Intro Fuel Valve Theory Of Operation Fuel Valve Lessons Satisfied Fuel Valve and Quantity Transmitter Components Satisfied Fuel System Hazards Enabled Fuel Valve Removal Procedure Flow Preparation Flow Remove Door Flow Remove Transmitter Flow Remove Valve Tests Knowledge Test Fuel System Components Fuel System Hazards Performance Test (simulation) IETM Auxiliary ID Enabled Removal Simulation Indicates is visible on menu

Fuel Valve Introduction Fuel Valve Lessons Tests Each block must be completed before the next block is available Upon completion of first block only first two items of second block are enabled. Student can taken them in any order Must complete first two before proceeding to third lesson Must take third lesson in order. IETM is available at any time Tests enabled only after completion of lessons Fuel Valve Lesson Intro Fuel Valve Theory Of Operation Fuel Valve Lessons Satisfied Fuel Valve and Quantity Transmitter Components Satisfied Fuel System Hazards Satisfied Fuel Valve Removal Procedure Preparation Remove Door Remove Transmitter Remove Valve Enabled Tests Flow Knowledge Test Flow Fuel System Components Flow Fuel System Hazards Flow Performance Test (simulation) IETM Flow Removal Simulation Indicates is visible on menu

Fuel Valve Introduction Fuel Valve Lessons Tests Each block must be completed before the next block is available Upon completion of first block only first two items of second block are enabled. Student can taken them in any order Must complete first two before proceeding to third lesson Must take third lesson in order. IETM is available at any time Tests enabled only after completion of lessons If test is failed remediate back to that lesson then take test a second time If test is passed move to second part of test If test is failed again student is remediated again and fails course On completion of first test student moves to simulation test Student must perform correct steps in order within time limit IETM available during performance test Fuel Valve Lesson Intro Fuel Valve Theory Of Operation Fuel Valve Lessons Fuel Valve and Quantity Transmitter Components Fuel System Hazards Fuel Valve Removal Procedure Preparation Remove Door Remove Transmitter Remove Valve Tests Knowledge Test Normalized Measure Rollup Fuel System Components Normalized Measure Fuel System Hazards Rollup Performance Test (simulation) IETM Removal Simulation Indicates is visible on menu

Fuel Valve Introduction Fuel Valve Lessons Tests Each block must be completed before the next block is available Upon completion of first block only first two items of second block are enabled. Student can taken them in any order Must complete first two before proceeding to third lesson Must take third lesson in order. IETM is available at any time Tests enabled only after completion of lessons If test is failed remediate back to that lesson then take test a second time If test is passed move to second part of test If test is failed again student is remediated again and fails course On completion of first test student moves to simulation test Student must perform correct steps in order within time limit IETM available during performance test Fuel Valve Lesson Intro Fuel Valve Theory Of Operation Fuel Valve Lessons Fuel Valve and Quantity Transmitter Components Fuel System Hazards Fuel Valve Removal Procedure Preparation Remove Door Remove Transmitter Remove Valve Tests Passed Knowledge Test Fuel System Components Fuel System Hazards Enabled Performance Test (simulation) IETM Enabled Removal Simulation Limit-Time Indicates is visible on menu

Fuel Valve Introduction Fuel Valve Lessons Tests Each block must be completed before the next block is available Upon completion of first block only first two items of second block are enabled. Student can taken them in any order Must complete first two before proceeding to third lesson Must take third lesson in order. IETM is available at any time Tests enabled only after completion of lessons If test is failed remediate back to that lesson then take test a second time If test is passed move to second part of test If test is failed again student is remediated again and fails course On completion of first test student moves to simulation test Student must perform correct steps in order within time limit IETM available during performance test Fuel Valve Lesson Intro Fuel Valve Theory Of Operation Fuel Valve Lessons Flow Fuel Valve and Quantity Transmitter Components Flow Fuel System Hazards Fuel Valve Removal Procedure Preparation Remove Door Remove Transmitter Remove Valve Flow Tests Failed Knowledge Test Fuel System Components Fuel System Hazards Performance Test (simulation) IETM Removal Simulation Indicates is visible on menu

ADL http://www.adlnet.org Resources ADL http://www.adlnet.org SCORM Sequencing and Navigation 1.3 (2004) IMS http://www.imsglobal.org/simplesequencing/index.cfm Simple Sequencing Information and Behavior Model Version 1.0 XML Binding Version 1.0 Best Practice and Implementation Guide Version 1.0 Examples, XML Bindings, and DTDs