An integrated training system based on the SAT Methodology Web Developer Module Addie SAT ISD VISION What is VISION? An integrated training system based on the SAT Methodology

Identify the instructional activities supported by the two main VISION modules

A D I E Instructional activities per module Developer Web Module Analysis D Design Development I Implementation E Evaluation Developer Module Web

A E I D Developer Module Job Analysis Select Tasks for Training Design Development I Implementation E Evaluation Job Analysis Select Tasks for Training Task Analysis

A D I E Developer Module Develop Objectives Develop Test Items Analysis D Design Development I Implementation E Evaluation Develop Objectives Develop Test Items Organize Program

A D I E Developer Module Develop Course Material Analysis D Design Development I Implementation E Evaluation Develop Course Material Generate Lessons and Exams Generate Qualifications (OJE/JPM)

A D I E Web Deploy Online Training Online Exams Manage Student Records Analysis D Design Development I Implementation E Evaluation Deploy Online Training Online Exams Manage Student Records

E A I D Web Course Evaluations Automatic Item Analysis Design Development I Implementation E Evaluation Course Evaluations Automatic Item Analysis Identify areas of improvement

The Developer Module is mostly A-D-D phases of ADDIE …but supports some evaluation activities (manual or ScanTron entry of test results) Developer Module Web A Analysis D Design Development I Implementation E Evaluation Job analysis Task analysis Select tasks for training Develop objectives Develop test items Organize programs Develop courses Generate lessons Generate qualifications (OJE/JPM) Test item stats Other feedback Select tasks for training/DIF surveys Deploy online training Online exams Student records Course evaluations Test item analysis Identify areas of improvement

Select tasks for training/DIF surveys Note that it “feeds” Developer with test item feedback and stats Learning Station is mostly Implementation and Evaluation Learning Station can also automate DIF surveys and process survey results Developer Module Web A Analysis D Design Development I Implementation E Evaluation Job analysis Task analysis Select tasks for training Develop objectives Develop test items Organize programs Develop courses Generate lessons Generate qualifications (OJE/JPM) Test item stats Other feedback Select tasks for training/DIF surveys Deploy online training Online exams Student records Course evaluations Test item analysis Identify areas of improvement

Match each feature/function with the appropriate module: Developer Web Facilitate job and task analysis Deploy on-line exams Facilitate writing exam questions Deploy on-line course materials Generate print-based lesson plans Track student records (training and qualification status) Support on-line DIF surveys Facilitate writing of content for on-line course materials Generate print-based exams

How the VISION Database is organized Projects Work Areas Data Sharing How the VISION Database is organized

Identify the characteristics of a VISION database in terms of projects and work areas

Work Areas An illustration of the VISION Database VISION Database Project VISION Database Analysis (A) Objectives (O) Program (P) Work Areas Project Project P A O P A P O A

How projects and work areas interact in a VISION Database Analysis Objectives/Questions Program

Which is then used to develop objectives and questions And then grouped into a Program (Lesson) Next, let’s define Project 2 as Lab Tech Some tasks are the same between these two jobs so they are shared Lastly, let’s define Project 3 as Operator You start in the Analysis Hierarchy In this case, there are no shared tasks Let’s define Project 1 as Field Tech Operator Project 3 Lab Tech Project 2 Project 1 Field Tech Analysis Objectives/Questions Program

The VISION Developer Module Analysis Design Develop ment Systematic Approach to Training (SAT) data structure

Identify the data structure and connections in VISION that facilitate the SAT process and outcomes

The SAT Process is supported by three work areas Analysis components are linked to objectives and objectives are linked to the program The SAT Process is supported by three work areas In these work areas, Information is displayed as a hierarchy The SAT Process starts left to right Analysis -> Objective -> Program Analysis Hierarchy Objective Hierarchy Program Hierarchy

Lastly, connect the Objectives to the Lesson Start the SAT Process by building an Analysis Hierarchy Establish a Program structure in the Program Hierarchy Drag the Analysis (JTA) items to the Objectives area to form a Hierarchy Analysis Hierarchy Objective Hierarchy Program Hierarchy S/K Element Job Position Function Phase Task Subtask Cognitive Enabler Performance Enabler Performance Terminal Objective Performance Terminal Objective Organization Organizer Lesson Module Program Course

You also write content at the Objective level This content becomes a reusable learning object that can be assigned to multiple lessons You also write content at the Objective level You write questions at the Objective level Analysis Hierarchy Objective Hierarchy Program Hierarchy S/K Element Job Position Function Phase Task Subtask Cognitive Enabler Performance Enabler Organization Organizer Performance Terminal Objective Performance Terminal Objective Lesson Module Program Course Questions Content

You can also link Cross-Reference Items to any hierarchy component Analysis Hierarchy Objective Hierarchy Program Hierarchy S/K Element Job Position Function Phase Task Subtask Cognitive Enabler Performance Enabler Organization Organizer Performance Terminal Objective Performance Terminal Objective Questions Content Lesson Module Program Course References Safety Issues Tools and Equipment

Let’s review the connections from a task to a Lesson We’ll start by representing the task as a terminal objective Then we’ll consolidate several elements into the same objective Then we’ll sequence the objective into a lesson From the lesson we can view which objectives and tasks are linked to it Analysis Hierarchy Objective Hierarchy Program Hierarchy S/K Element Job Position Function Phase Task Subtask Performance Terminal Objective Cognitive Enabler Performance Enabler Performance Terminal Objective Organization Organizer Lesson Module Program Course

If you change the content for 9 O what lessons would be changed? Analysis Hierarchy Objective Hierarchy Program Hierarchy 9 A 10 A 14 A 15 A 8 A 1 A 2 A 3 A 6 A 7 A 11 A 4 A 5 A 12 A 13 A 5 O 11 O 12 O 6 O 7 O 4 O 8 O 9 O 10 O 1 O 2 O 3 O 4 P 5 P 3 P 6 P 8 P 1 P 2 P 7 P

What Objectives are related to 3 P? Analysis Hierarchy Objective Hierarchy Program Hierarchy 9 A 10 A 14 A 15 A 8 A 1 A 2 A 3 A 6 A 7 A 11 A 4 A 5 A 12 A 13 A 8 O 11 O 12 O 7 O 3 O 9 O 10 O 1 O 2 O 5 O 6 O 4 O 4 P 5 P 3 P 6 P 8 P 1 P 2 P 7 P

The VISION Modules VISION Connect How the VISION modules and an enterprise LMS work together to support a SAT based training system

Describe how VISION modules work together in a training enterprise setting to support a SAT-based training system

VISION Web Administration Module How the modules work together Enterprise LMS VISION LMS Database OR VISION Connect VISION Web Administration Module Database Analysis Qual Cards Objectives Content Questions Programs Lessons Developer

VISION Web Administration Module VISION Developer facilitates all the SAT related data, which is stored in the database. The SAT data can be accessed online through the enterprise LMS or VISION LMS It also delivers online courses, exams and evaluations Connect delivers online courses, exams and evaluations to the enterprise LMS If you have a LMS, VISION Connect links the enterprise LMS to VISION If you don’t have an LMS, VISION Web is a fully functional LMS Enterprise LMS VISION LMS Database VISION Connect VISION Web Administration Module Database Analysis Qual Cards Objectives Content Questions Programs Lessons Developer

How the SAT data can be used by the enterprise LMS The exam is delivered to the student on the LMS via the Administration module At completion, the score is stored in both the enterprise and VISION database How the SAT data can be used by the enterprise LMS VISION Connect carries the request to the Administration module, which generates the exam from the SAT/VISION database Learner requests an online exam from the enterprise LMS ? Enterprise LMS VISION LMS Database VISION Connect Database Analysis Qual Cards Objectives Content Questions Programs Lessons Developer

Which module would be the most appropriate if: You have an enterprise LMS You want it to remain the system of record Want the LMS to launch an exam from the VISION SAT database VISION LMS VISION Connect

Components of the VISION Display The Main Menu, Workbench Menu, Workbench, Project Work Areas, and Links Windows

Identify each of the components of the main VISION display

Workbench Menu Main Menu

Workbench

Project Work Areas (Hierarchies)

Links Windows

Access almost everything from Main Menu Workbench Menu: Modifies workbench Only visible when workbench is open Main Menu: Access almost everything from Main Menu Main Menu: On top of every VISION screen. Menu bar will change with the type of window that is active Workbench Menu: located on the top of the VISION Workbench. only visible when the workbench is displayed (click to make info disapear()

Contains one or more hierarchies Project Work Areas (Hierarchies): Three types of work areas: Analysis, Objective, Program One or more work areas at a time Workbench: Contains one or more hierarchies Perform all instructional activities here Analysis Objective Program Workbench: The VISION Workbench is designed to help you carry out instructional analysis and design activities from a hierarchy perspective. Contain one or more hierarchies. A Workbench - two areas: the Hierarchy area, and the Links window You can resize either region up or down. You can also ‘undock,’ the links windows Hierarchy: three types of hierarchies – Analysis, Objective, and Program terms ‘work area’ and ‘hierarchy’ are often used interchangeably Explain different hierarchies?

The Links Windows show the relationships between nodes in the hierarchies

Identify the highlighted VISION display component: Work Areas (hierarchies) Main Menu Workbench Workbench Menu Links Windows

VISION’s Main Menu Bar

Locate the appropriate Main Menu button for a given operation

The Main Menu buttons contain the following features: Various Preference functions Open/Close, Print, Settings Manage Action Tracking Open and generate tests Open various features Open/Close workbenches Reports and Documents Jump to date Search database Cross reference functions Help Programs Extras Open and arrange windows Security, Import/ Export Project and work area settings Single node Functions File Open, close, print and personal settings Setup Change password and preferences Project Work areas, Qual Cards, Recycle Bin, Change Project View Reveal items, change colors and open various features Node Insert, delete and expand hierarchies Outcomes Reports and documents Search Various ways to search the VISION database Cross Reference Open/close, show/hide cross reference items Workbench Open/customize specific workbenches Test Open, delete and generate tests Action Items Manage action items and question feedback Versioning Jump to Date Other Features Security, Tables, Import/Export Window Open/arrange windows Help VISION Help, User Guide, What’s New, Advisor

The Main Menu buttons contain the following features: Open a Text Document Print Options Workbench Reports and Documents Search Qual Cards Cross Reference Tables Question Feedback Test Help Options Logged Project Owning Project

Generate a New document, or Open or Close an existing one Print settings for an open report or document Open recent reports and documents Exit VISION

Change your VISION Password, or the language of VISION Set your preferences or open the Color Attribute feature Save the workspace that is Currently open

Open a Work Area or create a new one Open or create Qualification Cards Open a Recycle Bin Open a different VISION project View your security settings

Select toolbars to view Show or hide VISION’s status bar Select hierarchy columns to show or hide Open the Links Windows

Various hierarchy functions Review questions Manipulate hierarchy

Generate reports and documents

Different ways to search VISION projects and work areas

Open, insert, and delete table items Search table items Various cross reference table functions

Opens work areas Open groups of work areas Help with activities Customize work areas

Opens tests and create new tests View, delete, or copy an open test Generate printable test sheets, answer keys, etc.

Opens Action Tracking feature Opens Question Feedback feature

View the hierarchy at a past date or create a date tag

View your security profile Manipulate VISION tables for projects Open the Import/Export utility

Open a new window like the current one Arrange the open windows The window(s) that is or are currently open

Offers additional information about VISION Opens various help programs

With which menu can you get a report or document? With which menu can you open and close a cross reference table? With which menu can you open an Objectives Hierarchy? With which menu can you find an item by keyword? With which menu can you manipulate the hierarchy branch? Which menu contains open, close, and print settings?

VISION’s Workbench Menu

Locate the appropriate Workbench Menu button for a given operation

Insert hierarchy nodes as children or siblings Opens the hierarchies Remove hierarchy components Format hierarchies colors or font Show the Flowchart Help and Advisor

Insert a node as “sibling above” of the selected node Opens the Instructional Advisor which has information on how to use the SAT method in VISION Insert a node as “sibling above” of the selected node Insert a node as “last child” of the selected node Open the Program work area Open the Analysis work area Open the Objective work area Insert a node as “sibling below” of the selected node Unlink the selected hierarchy branch Open the Flowchart, which shows different visual orientations of the hierarchies Delete the selected hierarchy branch Change font style for the selected hierarchy Open Color Attributes for the selected hierarchy Show steps for performing different procedures

On your computer, locate the button to: Open Analysis Work Area Change Color Attributes Show Flowchart Insert Sibling Above Unlink Branch Delete Branch Open Program Work Area Insert Last Child Open Objective Work Area Change Workbench Font Insert Sibling Below Show Instructional Advisor

Launch a Report or Document Use the Main Menu to launch reports and documents

Launch a report or document

Reports and Documents are launched from “Outcomes” on the Main Menu.

Reports are separated by subject on different tabs. Highlight the report and click the Run button. Report Description Selected Node

Documents are separated by subject on different tabs. Highlight the document and click the Run button. Report Description Selected Node

Click Outcomes on the Main Menu Run an Analysis Report Click VISION Reports Click on the Analysis tab Click the node for the report Select the report Click the Run button

Click Outcomes on the Main Menu Run a Training Document Click VISION Documents Click on the Training tab Click the Run button Select the document Click the node for the document

Use the Main Menu to launch SAT activities on the workbench Launch a SAT Activity Use the Main Menu to launch SAT activities on the workbench

Launch a SAT activity

SAT activities are launched from “Workbench” on the Main Menu.

SAT activities are separated by Analysis, Design, and Development. Highlight the type and click the Activity.

Open the workbench for a design activity Click Workbench on the Main Menu Highlight “Design Activity” Select an activity to open The workbench for the activity opens

Open the workbench for a development activity Click Workbench on the Main Menu Highlight “Development Activity” Select the activity The workbench for the activity opens

Help Features of VISION ? Introduction to the various help features

Describe the functions of the various VISION help and advisor features

VISION Help Features VISION Help How they Function VISION Help How to operate the system Context Help Help that is specific to your active window What’s This? Information on a selected item Tip of the Day Hint provided at start up Cue Card Topics Step by step instructions for Activities Instructional Advisor Instructional Design reference guide

Context sensitive help and advice is offered throughout the system. Advisor offers instructional design advice relevant to what you are doing Help offers instructions on how to operate the features

Cue Cards: Show steps for common procedures. Advisor: An Instructional Design reference guide. Tip of the Day: Shows tips on start up. What’s This: Tells you how to use most VISION controls Context Help: Open help from the current window. VISION Help: Overview; Activities; What’s new.

Double click the desired objective. Click on the Questions item. Use the Advisor to help create multiple choice questions for an objective. Double click the desired objective. Click on the Questions item. Now open the Advisor. Click the New button and Multiple Choice Finished!

Now select the Question text to receive more information. The cursor will change into the What’s This icon. Access the What’s This button by clicking on the ? Icon. Use the What’s This tool to get more information about making multiple choice questions. From the Multiple Choice window, select the Question page. Finished!

Match the help feature to its function: VISION Help Help that is specific to your active window Context Help Step by step instructions for Activities What’s This? Instructional Design reference guide Tip of the Day Hint provided at start up Cue Card Topics Information on a selected item Instructional Advisor How to operate the system

Hierarchy Grid Controls How to use hierarchy grid controls to customize a display

Use the hierarchy grid controls to customize a display

How to add, remove, and rearrange columns using grid controls. Columns can be rearranged by dragging the column title to the desired location. Columns can be added or removed by right-clicking on the column title and choosing the desired columns. How to add, remove, and rearrange columns using grid controls.

You can also select Show all or Hide all. Select which columns to show or hide. Right click on any of the column titles to turn them on or off.

You can drag and drop the columns to rearrange their order.

Now only the DIF Data columns are displayed. Check the DIF boxes and close the menu. Find the DIF column options. Hide the unnecessary columns. Right-click on grid titles to reveal the column options.

Use the grid to show if data is trained, recurring, and how often. Now you can see which analysis items are trained, recurring, and how often. Finished!

Links Windows & Hierarchies Which hierarchies the different links windows are associated with

Identify the links windows that are associated with each of the three hierarchies on a VISION Workscreen

Certain Links Windows only apply to specific workbench hierarchies. The Program hierarchy works with the Analysis, Questions, Objective, Cross Ref, and Prerequisite links windows. The Analysis hierarchy works with the Questions, Objectives, Programs, and Cross Ref links windows. The Objective hierarchy works with the Analysis, Questions, Programs, and Cross Ref links windows.

Objectives show linked questions, linked cross reference items, linked or consolidate analysis items, and the Programs that they are linked into. Programs show analysis items and questions from linked objectives, linked objectives, linked cross reference items, and linked program prerequisites. Analysis items show linked questions, linked cross reference items, and the objectives that they are linked or consolidated into.

Which links windows work with the Objective hierarchy? Which links windows work with the Analysis hierarchy?

VISION Workbench Links Windows How to open/close and show/hide columns, and rearrange the Links Windows

Rearrange a workbench display by manipulating the links windows

By right-clicking on the Links Windows Title Bar, you can open and close the links windows as well as the columns within them.

Alternatively, you can open and close links windows by using the View menu in the Main Menu.

By dragging on the Links Window Title bar, you can rearrange the windows.

When you open and close a Links Window, you can choose to Hide All, Show All & Reset or select the windows individually.

When you show or hide the columns within the Links Window, you can choose to Hide All, Show All & Reset or select the columns individually.

The shaded box denotes the current location and the arrows show where it can be placed. To rearrange, click on the links Window and drag it to the desired location.

Hide all the links windows then reset with Show All.

How to move a Links Window to a new location: Select the Link window and drag it towards desired location. Arrows will appear, drag the box over an arrow to show placement. Drop the box to have it appear in the shaded region.

You can reset the links windows by right clicking on the title bar and selecting Show All & Reset. Finished!

Hierarchy terminology The VISION Hierarchy Hierarchy terminology

Identify parts of a VISION hierarchy including: node, parent, sibling, child, orphan and branch

The VISION hierarchy includes the following parts: Branch Node Parent Orphan Node Child Node Child Siblings

An orphan has no parents but might have children. A branch is a node and all of its descendants. Hierarchy Branch Parent Orphan Child Child Siblings

Identify the relationship Answer: Parent and Child Answer: Siblings

Basic Hierarchy Operations How to do various hierarchy operations, such as expanding, collapsing, inserting and removing nodes.

Perform basic hierarchy operations using the right-click menu

You can perform many hierarchy manipulations by using the right-click menu from a selected node. Insert Unlink Branch Delete Branch Expand One Level Expand Branch Expand To Top Make Top Node

After choosing the level name there will be a Properties Window. Type the text for the node here. This window also changes between the hierarchies. Next, there might be a prompt to pick the level name. The prompt changes between the Analysis, Objective and Program hierarchies. When you select Insert you will be prompted to enter the location of the new node in relation to the selected node. Analysis Objective Program Analysis Objective Program

Delete Branch and Unlink Branch will remove the selected node. Unlink will send the node to the recycle bin to be recovered later. Delete is permanent. Node Node

Expand Branch will expand the selected node, as well as any node under it. Expand One Level will expand to reveal only the Immediate children of the selected node.

Make Top Node to hide all other nodes in the hierarchy except for any children of the selected node. Uncollapse the node to see its children

Expand To Top resets the hierarchy after using Make Top Node.

Right Click on Install Robotics and Insert As Child. Select a node with children and make it Top Node. Reset the hierarchy afterwards. Recycle a Node: Delete a Node: Add New Nodes: In the Analysis Hierarchy, right click on Lightwave Field Service. Select Expand Branch. Right-click the Administrative responsibility area. In the menu select Make Top Node. Expand the Administrative node to see its children. Right-click on one of the functions and select Expand To Top. Select the Phase Test and Complete. Right Click and Insert As Child. Select Task and click OK. In the box labeled Text, type Test Parameter Software. Repeat the same process and enter three new tasks: Test AI Control Device Test wires Mount resistors to the LEDS Under the Phase Test and Complete, select the task Test AI Control Device. Right Click and select Delete Branch. On the Confirm delete dialogue box, Click Yes. Under the Phase Test and Complete, select the task: Test Wires. Right Click and select Unlink Branch. On the Confirm Unlink dialogue box, Click Yes. In the Analysis Hierarchy, expand nodes until you reach Install Robotics under the function New Installation. Right Click on Install Robotics and Insert As Child. Select Phase and click OK. In the box labeled Text, type Set Up. Repeat the same process and enter two new phases: Install Test and Complete

Results should be similar. Finished! Results should be similar.

Adding and Removing Nodes Work Area Node ID 1 Node ID 3 How to Use VISION to add and remove nodes from the SAT hierarchy Node ID 4 Node ID 2

Add or remove nodes from a hierarchy by using: Insert, Delete, or Unlink.

Select a node, and then Insert, Delete, or Unlink using one of the following: Workbench Menu Right Click Menu

From the hierarchy window right-click the appropriate node Then select either insert, unlink or delete To insert, delete or unlink a node

For insert, follow the prompts to pick relationship, level name and Title.

The new node will appear in the hierarchy. Enter the new node’s title and then click OK. Select the “Lesson” level and click OK. Right-click on a node and select Insert, then select “As Child”. Follow these steps to Insert a new Program node:

Delete a node. Results should be similar:

The difference between move, copy, and share Move, Copy, Share The difference between move, copy, and share

Distinguish between move, copy, and share

There are three different ways to move node, each way has a different consequence. Hierarchy Action Rule This action moves a node and its children from one parent to another Move Copy Make two separate versions of a node Assigns the same node to more than one parent Share

Once you’ve shared a node, changes in one instance of the node will appear in all instances. A copied node will retain its original location. Changes to one node won’t affect its copies. Moving a node from one location to another changes the parent-child relationship. The children of the node will be moved as well. Work Area Node ID 1 Node ID 4 Node ID 2 Note the same ID Node 3’s old location Node ID 3 Node ID 3 Node ID 3 Node ID 3 Node ID 3 Note the same ID Note the new ID Node 3’s new location Node ID 5

Nodes can be moved, copied, and shared across different work areas and projects. Node ID 1 Node ID 3 Node ID 4 Work Area 1 Node ID 2 Project 3 Node ID 6 Node ID 8 Node ID 9 Work Area 2 Node ID 7 Node ID 5 is shared Node ID 5 Node ID 5

If you move, copy or share a hierarchy node, all of its "children" are treated likewise. Match the word to its correct characteristic: Results in multiple nodes with two different ID numbers ID number doesn’t change Results in multiple nodes with the same ID number A. ___ 1. Copy ___ 2. Share ___ 3. Move TRUE or FALSE C. B.

Move, Copy, and Share Hierarchy Nodes How to move, copy, and share Hierarchy Nodes

Move, copy, and share hierarchy nodes

Choose the action, placement, and copy option. Here’s how you move, copy, and/or share a hierarchy node Select node and drag to its new location…

When you drag a node to a new location you select the action and… …you also select the position Last Child Move Branch Copy Branch Sibling Above Sibling Below Share Branch

When you copy an Analysis or Objective node, VISION gives you the options to copy questions: No questions Share questions Copy questions

When you copy a Program node, VISION gives you the options to copy objectives: No objectives Share objectives Copy objectives

Move a task to a different parent as Last Child Move a task to a different parent as Last Child. Click on task and drag it to the new parent:

Click on task and drag it to the new parent Select the action and where to locate the node Share a task to a different parent as Sibling Below:

Select the action and where to locate the node Click on task and drag it to the new parent Copy a task to a different parent as Sibling Above

Move and share a node as Last Child in the Analysis Hierarchy. Under the phase “Test and Complete,” select the task Complete Administrative Paperwork. Drag the task to the function Install mechanical systems under the New Installations responsibility area. In the Confirm Drop dialogue box, select Share branch and Last child. Click OK. Click Yes. Move a Node In the Analysis Hierarchy, expand until you reach the phase Test and Complete under the function Install Robotics. Select the task Mount resistors to the LEDS. Drag the task and drop it onto the Install phase. In the Confirm Drop dialogue box, select Move branch and Last child. Click OK. Click Yes. Copy a Node In the Analysis Hierarchy, expand till you reach the phase Test and Complete under the function Install Robotics. Select the phase Test and Complete. Drag the phase and drop it onto Install Lithographic systems. In the Confirm Drop dialogue box, select Copy branch and Last child. Click OK. Click Yes.

Cross Reference Tables One of the most powerful features in VISION

Explain the concept and use of cross reference tables

Cross Reference tables are custom lists Here are the rules that govern how to use cross reference tables: Cross Reference tables are custom lists Any items on a list can be linked to any SAT component Can link the same item to many components Can also link many items to a single component Can do detailed searches by items or components Can be used to generate special reports and documents

Can do detailed searches by items or components Cross Reference tables are custom lists Can also link many items to a single component Can be used to generate special reports and documents Can link the same item to many components Any items on a list can be linked to any SAT component Use the Cross Reference menu on the Main Menu to access search options. Find Cross Reference reports on the Reports window or create custom reports using the cross reference table feature. Any SAT component can have as many cross reference links as you need. SAT Components link to cross reference items on the “Cross Reference” page of the component’s properties menu. Create new cross reference tables with the “New” button. Any cross reference table item can be linked to as many different SAT components as you need to.

First, create a table for question difficulty. How to use cross reference tables to be able to find questions according to a specific difficulty level. Link all the appropriate questions to the various difficulty levels. Now we can search for a specific level. Objective Question (difficulty 2) Question (difficulty 3) Question (difficulty 4) Question (difficulty 5) DIFFICULTY LEVEL Difficulty 1 Difficulty 2 Difficulty 3 Difficulty 4 Difficulty 5

How to find all tasks that use a specific piece of equipment. First, create an equipment list table. Link all the appropriate pieces of equipment to their tasks. Perform a search for the specific equipment by selecting it in the table. Phase Task 1 Task 2 Task 3 TOOLS/EQUIPMENT Portable Diagnostic System (PDS) Robot electronic module cart Serial Data Cable Standard Tool Kit Teach Pendant

First, create a table of authors. How would you use cross reference tables to find lessons that were created by a specific author? First, create a table of authors. Link all the lessons to the appropriate authors. Perform a search on the specific author. Introduction to Lightwave Product Orientation The XR175 Line The XR200 Line: Upgrade Features The LightWave Xcellerator The Lightwave II AUTHORS J. Devons Marie Williams Grace Hill E.D. Gray

First, create a table for Media. What steps would you take to find out which lessons were taught by video media? Link all the appropriate media types to their lessons. Perform a search starting from video media. Introduction to Lightwave Product Orientation The XR175 Line The XR200 Line: Upgrade Features The LightWave Xcellerator The Lightwave II MEDIA Video Animation Powerpoint Online

Job Analysis Hierarchy Structure The hierarchy levels that VISION supports

Identify the levels of a job analysis hierarchy structure supported in VISION

These are the job analysis hierarchy levels supported in VISION: Hierarchy Terms Definition Job The title of a position Responsibility Area A broad aspect of a job that usually takes up the majority of work time A set of activities within a job responsibility. Also referred to as a Duty Area Function Occupies exclusive time slices of a function and are interdependent Phase The measurable activities that comprise the job; usually grouped by phases or functions Task Used to divide complex tasks or when the task can be done in more than one way Sub Task

Job: A position with a title. Sub Task: A subtask is used if either of these two conditions apply: The task can be performed in more than one way based on conditions, equipment or circumstances. The task is so complex that each step or element is actually a task itself. Job: A position with a title. Involves an ongoing collection of work functions. Comprises the worker’s entire set of responsibilities. Phase: Some functions can be separated into phases. They occupy exclusive time slices of a function. They are interdependent: the outcome of most phases is input to the next. Each usually contains more than one major task. Task: Results in a product, completion of a service or decision. Has a definite beginning and end. Generally contains two or more steps. Normally performed within one specific period of time. Can usually be observed and measured. Function: A set of activities within a responsibility area. (Duty Area) May comprise a process with a definitive beginning and end. Directed toward a whole outcome, product or result. Responsibility Area: The first step in breaking a job into hierarchy components. General areas of a job, rather than specific duties. Results in more than one specific outcome. The job holder operates within one responsibility at a time. Job Responsibility Area Function Not all functions contain phases! Phase Task Sub Task

Fill in the hierarchy with the appropriate term: Job Responsibility Area Responsibility Area Function Function Phase Phase Phase Task Task Task Sub Task Sub Task

Analysis Hierarchy Rules Task Sub-Task Element S/K

State the rules that govern the allowable relationships among the types of levels of an Analysis Hierarchy

Elements and S/Ks can only have S/Ks as children. Organizations, Job Positions, Responsibility Areas, Functions, and Phases are “Organizers” and can be changed as desired. Elements and S/Ks can only have S/Ks as children. Sub-Tasks can have Tasks, Elements, or S/Ks as children. Organizers can have Tasks or S/Ks as children. Tasks can have Tasks, Sub-Tasks, Elements, or S/Ks as children. Organizer Task Task Element S/K Sub-Task S/K S/K S/K Task Element

Tasks, Sub-Tasks, Elements, and Skill/Knowledge items have rules about how they interact together, so they cannot necessarily be changed or moved. Organizations, Job Positions, Responsibility Areas, Functions, and Phases do not have a functional difference, so they can be changed or moved around without consequence. If you try to change an analysis node’s level, VISION will only allow you to select from levels that fit within these rules. If a Task has Sub-Task children, it can only have Sub-Tasks as children. Tasks can only be in a relationship two deep. In other words, a Task can have a child Task, but cannot have a “grandchild” Task. Task Task Task Sub-Task Task Element Task S/K

Select the possible child or children for the parent node: Organizer Element Task Task Element Sub-Task S/K

The difference between conditional and component sub tasks in VISION Two Types of Sub Tasks The difference between conditional and component sub tasks in VISION

Differentiate between the two types of sub tasks available in VISION Developer

Conditional Sub Tasks: The two types of subtasks in VISION are Conditional Sub Tasks and Component Sub Tasks. Conditional Sub Tasks: A task that is performed differently under different conditions. Component Sub Tasks: A task that has been broken up into smaller tasks.

Conditional Sub Task (ST) Component Sub Task (T) Different versions of the task, with different steps and considerations. The parent task is an organizer and each sub task must be mastered individually. Components of the same task, such as very large steps. These sub tasks can be qualified just like any other task. T: Plan and organize a convoy ST: Plan and organize a convoy under civilian, peacetime conditions ST: Plan and organize a convoy under combat conditions T: Build a shed T: Lay a concreate (slab) foundation T: Build a frame T: Add exterior panels

Component sub tasks are parts of a larger task that has been broken up. Conditional sub tasks distinguish between a task done under one condition and the same task done under a different condition.

Conditional Sub Task (ST) Which type of sub task should be used for the following: T: Fix a tire __: Remove the tire __: Inspect the tire __: Replace the tire T: Fix a tire __: Fix a tire on the roadside with emergency equipment __: Fix a tire in a garage with normal equipment ST T Component Sub Task (T) Conditional Sub Task (ST)

Using Sub Tasks

Identify the implications of using each type of Sub Task on qualifications and reports

Conditional Sub Tasks: The implications of using sub-tasks on qualifications and reports depends on the type of sub-task you use: Conditional Sub Tasks: The parent task is an organizer and doesn’t need to be qualified. Each sub-task must be qualified individually. Component Sub Tasks: A part of a larger task. Qualified like any other task.

Conditional sub tasks represent the task in different conditions Conditional sub tasks represent the task in different conditions. In this case, the parent task is an organizer that can only have sub tasks as children. All elements and SK items must be children of the sub tasks. Component sub tasks are tasks just like any other, and are qualified as such. How they are used will depend on the organization using them.

Analysis Hierarchy Assistant How to use the Assistant to insert nodes quickly

Use the Hierarchy Assistant to insert multiple nodes quickly

This is how you use the Assistant… Right click to access the Assistant. 3. Select Level. 2. Enter Title. 4. Add Last Child. 1 Insert Robot Arm 2 4 3 c

You can change the level here The advisor will offer you instructional design advice about the selected level. When you click Add Last Child as VISION will add the new node as the last child of the highlighted node. The hierarchy assistant recommends a level for the node being added. The Zoom button will open a full function text edit box. Help will offer more information about the hierarchy assistant. c You can change the level here

Start by right clicking on an Analysis Hierarchy Node and selecting Insert with Assistant.

The Assistant will select the hierarchy level based off of the node level; you can change this as needed. Enter the name of the new node in the text field. Select Add Last Child as.

The Node will be added and the assistant will stay active to insert more.

Use the Hierarchy Assistant to insert four Phase level nodes into the Analysis Hierarchy. Go to the Analysis Hierarchy. Expand branches until you reach the Administrative Responsibility Area. Under Administrative select Conduct Business Development. Using the Assistant, add these four phases: Presale Proposal Negotiate Closure

The Levels of the Analysis Hierarchy Different workscreens related to each level

Identify features and organization of the workscreen for each analysis hierarchy level

The Analysis Hierarchy workscreens are organized by pages. All levels have a General, Cross-Reference, Document Links, and Past Versions page. Other levels will have special pages for extra information.

Cross References: All levels contain this page. Provides a place to link cross reference items to the node. General: All levels contain this page. Contains the title, ID, and other information that all nodes must have. Document Links: All levels contain this page. Provides a place to link documents to the node. Past Version: All levels contain this page. Provides a place to record changes and access previous versions. Organizations, Job position, Responsibility Area, Function and Phase all have the same four page options: General, Cross Reference, Document Links and Past Versions.

The Task Properties window has the Selection, Conditions, Standards, Procedure, OJT Notes, Analysis, Qualification, and Version Comments pages in addition to the standard pages mentioned before. Qualification: Unique to the Task level. Displays qualification information and qualifications that contain this task. Version Comments: Unique to the Task level. Enter information about new revisions to the node. Analysis: Unique to the Task level. Shows a Task and its subordinates in the Analysis hierarchy. OJT Notes: Unique to the Task level. Provides a place to record instructions to trainers. Procedure: Unique to the Task and Element levels. Add step-by-step instructions on how to do a procedure. Selection: Unique to the Task level. Provides training selection information for Task nodes. Conditions: Unique to the Task and Element levels. Lists conditions. Standards: Unique to the Task and Element levels. Displays a list of standards.

Task, Element, and Skill/Knowledge have extra page options. Procedure: Unique to the Element level. Add step-by-step instructions on how to do a procedure. Task, Element, and Skill/Knowledge have extra page options. Questions: Unique to the Skill/Knowledge level. Displays a list of test questions that are currently associated with the selected objective. Used in very limited circumstances The Element Properties Window has the Conditions, Standards, Procedure, and OJT Notes pages in addition to the standard pages.

Which three pages are used in all the analysis hierarchy levels? Questions page Conditions page Procedure page Standards page General page Cross Reference page Selection page Analysis page OJT Notes page Document Links page

Which three analysis hierarchy levels have extra page options? Organizer Phase Job Position Task Responsibility Area Element Function Skill/Knowledge

Build a Job Analysis Hierarchy EXERCISE Build a job analysis hierarchy in VISION Developer

The Process of Selecting Tasks for Training VISION Process Training Selection How VISION supports the process of selecting tasks for training

Demonstrate an understanding of the VISION process for selecting tasks for training

Main Idea 2. Finished! 1. Task DIF Survey 2. Calculate Averages 3. Enter DIF Data 2. Average DIF Data Frequency Difficulty Importance 6. Enter Task Disposition 5. Review and Decide 4. Generate Recommendations

If using VDM, The Task DIF Survey is a printed, manual survey. VLS generates an online form. If using “table-top” it’s done by verbal consensus. Master Task List shows the disposition of each task. The DIF Data and the training recurrence is entered into the Task Selection workscreen. DIF data is entered on the bottom of the Selection page. Training is entered on the top of the selection page. The Difficulty, Importance and Frequency scores are averaged out to create the DIF data numbers. DIF data is gathered by survey, it can either be gathered through the Task DIF Survey or “Table Top” methods. If using a manual survey, then average the numbers by hand. With VWeb, calculation is automatic. If using “table top,” data is already averaged by consensus. Average DIF Data Frequency Difficulty Importance

Name the steps of the Task Selection process using VISION, assuming a manual approach (no VLS installed).

Practice 1. 2. 3. 6. 5. 4. 1. Task DIF Survey 2. Calculate Averages 3. Enter DIF Data 1. 2. Average DIF Data Frequency Difficulty Importance 3. 6. 5. 4. 6. Enter Task Disposition 5. Review and Decide 4. Generate Recommendations

DIF Data Algorithm The VISION task selection algorithm that creates the training frequency recommendation

Apply the DIF scores to the VISION task selection algorithm to find the training recommendation

The VISION task selection algorithm: Difficulty Importance Frequency Recommendation No train Train Retrain

Main Idea Frequency Importance Difficulty Recommendation Train (c) (c) = Critical Train (c) Overtrain (c) No Train Train Job Aid Only Frequency Often Moderate Seldom Importance Not Very Very Difficulty Hard Moderate Easy Start Briefly Explain: There are four parts to the algorithm The difficulty section The importance section The Frequency section And the recommended outcome section (more thorough explanation in next slide)

Explanation Importance Difficulty Very Hard 0-6 1-5 Moderate Easy Not Very Very Importance Hard Moderate Easy Difficulty Start DIF DATA Value scales are between: I > 3 Values higher than three are very important D > 4 2 ≤ D ≤ 4 D < 2 I ≤ 3 0-6 Or 1-5 Values three and below are not very Important Difficulty: There are several value scales Vision can use. The INPO scale is 1-5 and the VISION scale is 0-6. however, both are acceptable, no difference. Hard is greater than 4 Moderate is 2,3,4 Easy is below 1 Importance: two categories: Very important and not very important Greater than three is Very important Less than three is not very important (Lots of animations on this page, only three clicks necessary to progress the animation. 1st – to clear teal hexagons, 2nd to clear other set of hexagons, 3rd after the purple lines hit the side of screen, indicating slide change) Difficulty increases by number

Explanation Recommendation Frequency (c) = Critical (c) = critical Often is for values four and above Train/Retrain is equivalent to Overtrain Often Moderate Seldom I ≥ 4 Train (c) Train/Retrain (c) No Train Train Job Aid Only I = 3 I ≤ 2 Moderate is for value three only (c) = critical Briefly Explain: Next section is frequency: Sorts into how often the tasks should be trained Three categories: Often – 4 and above Moderate - 3 only Seldom – 2 and below Recommendation: The process of inputting the DIF data leads to recommendation of either Train, Retrain , no train or Job aid Overtrain is the same as train/retrain *Critical is apart of Vision 8.4 and higher and is a flag that can be added for personal use in order to indicate the importance of training the task. It has no effect on the software. Commonly used for on the job evaluation forms (OJE’s JPMs, TPEs, etc)  Job aid means a procedure or other set of instructions rather than formal training. Seldom is for values two and below Job Aids are non-formal training

Example Importance Frequency Difficulty Recommendation Seldom 3.5 Importance 6 Frequency 1.5 Example Recommendation (c) = Critical Importance Frequency Often Moderate Seldom Train (c) Overtrain (c) Difficulty Not Very Very Hard Seldom Often Moderate No Train Train Train (c) Overtrain (c) Often Moderate Very Overtrain (c) Seldom Moderate Start Not Very Moderate Seldom Often Train No Train DIf DATA on top 3.5, 6 and 1.5 3 mouse clicks to progress animation. 1st –difficulty, 2nd Importance and 3rd Frequency (Explain greater than or less than if needed) Often Moderate Seldom No Train Job Aid Only Very Not Very Easy Often Moderate Seldom No Train

Practice Importance Frequency Difficulty Recommendation Train (c) Very 1 Importance 3.5 Frequency 1.2 Practice Recommendation (c) = Critical Importance Frequency Often Moderate Seldom Train (c) Overtrain (c) No Train Train Job Aid Only Very Not Very Difficulty Hard Moderate Easy Start Practice new DIF DATA as a class Click mouse to have pointer pop up and one more time to reveal answer

The Task Selection Page Use the Selection page to set the task DIF data and training intervals

Identify the properties on the Task Selection page

The properties of the Task Selection page are: No DIF Data Task Selection: Yes Explain that there are separate sections to the work screen that we will cover in more depth later. DIF DATA Task Selection: Yes Task Selection: NO

DIF Data consists of the Difficulty of the task, the Importance of the task, and the Frequency that the task is done. Point out the buttons to input DIF Data as they show up on the screen. Clarify as needed

If this task needs to be trained, then click the “Yes” button. Is this task should be trained on a recurring basis, check the box. Select how frequently the task should be trained. This list is editable if you have the necessary security permissions. Explain: Will the task be selected for training? The Task Recommendation report will help you make this decision… for instance if the task is difficult, very important and only infrequently performed, it will have to be trained and even retrained, possibly on a yearly basis. Use the radio buttons to select either Yes, or No. IF yes, select radio button. Is the task important enough for periodic retraining.? If it is, select the checkbox “Is it trained on a recurring basis?” How often does it need to be retrained? The dropdown contains a number of different time periods, ranging from weekly to 4 years. Most retrained tasks will occur on a yearly basis, or once every two years. You can add a new training interval if you have the security permissions to edit lists Can edit lists” permission has to be granted to your VISION account in the Security module. Once added to the list of intervals, a new interval will be available for all tasks, not just the one you are editing.

This list is editable if you have the necessary security permissions. If this task doesn’t need to be trained, then click the “No” button. Select a reason why the task should not be trained. Click Edit List to enter, edit or delete items. Will the task be selected for training? IF No, select radio button. There are a number of reasons for this…. The task could be trivial enough that training would be unnecessary. It could be that the task is performed by a contracted company, or that the task is obsolete and no longer in use. When you click the “No” radio, the dropdown list for “Why is the task not trained?” will activate. VISION does not supply any default reasons, as they’ll vary from one site to another. The list is editable, like the training interval list is. A reason for not training a task should ALWAYS be given.

Evaluate Tasks to Determine Training Priorities EXERCISE Select tasks for training and retraining

Using VISION for Task Analysis The three areas in VISION where the task analysis data is documented

Associate the information captured on traditional data collection forms to the most appropriate hierarchy positions, workscreen fields, tables and other locations in VISION

The three areas where the task analysis data is documented. Task Analysis Hierarchy Task Properties Workscreen Cross Reference Workscreen

Task Analysis Hierarchy The tasks are represented in the Task Analysis Hierarchy. Task Analysis Maintain Robotics SuperChip Field Service Technician RRCA-008 Remove and replace the recticle robot controller assembly Assembly is shut down Task Analysis Hierarchy In accordance with procedure Portable diagnostic System Wafer Handler Software Manual Lockout/Tagout Robotic Supervisor Shutting down robotic assembly Refer also to the vendor manual See Sam for additional SME details

Task Properties Workscreen Certain properties of the task are represented in the properties workscreens. Task Analysis RRCA-008 Remove and replace the recticle robot controller assembly Task Properties Workscreen Assembly is shut down In accordance with procedure Portable diagnostic System Wafer Handler Software Manual Lockout/Tagout Robotic Supervisor Refer also to the vendor manual See Sam for additional SME details Shutting down robotic assembly Refer also to the vendor manual See Sam for additional SME details

Cross Reference workscreen Other properties are documented through the use of cross reference tables (these are customized by the site). Task Analysis Cross Reference workscreen Portable diagnostic System Wafer Handler Software Manual Lockout/Tagout Robotic Supervisor Shutting down robotic assembly

Similarly, elements and S/K’s are represented in the hierarchy and properties workscreen. 1 Position the wafer handler robot to geometric Use the portable diagnostic system Locate the teach pendant connection Refer to calibration table N/A Robot arm is powered down 2 Power down the robot arm Locate circuit breaker N/A

Identify the correct area in VISION to place the Task Analysis Data. Task Analysis Hierarchy Identify the correct area in VISION to place the Task Analysis Data. Task Analysis 1. Duty Area: Manage in-house special events Job Position: 2. Master Chef 3. Task Number: 39258 Task Title: 4. Plan the menu items Task Properties Workscreen 5. Condition(s) of task: Given a definition of cost and profitability standards 6. Standard(s) of task: The menu items will not exceed cost and profitability criteria Special Tools/Equipment: 7. References: List of standard recipes Precautions/Safety Concerns: 8. Personnel Interfaces: Restaurant owner, front of house manager, sous chef Cross Reference Workscreen Task Prerequisites: Comments: 9. Check seasonal vegetable selections

Task Analysis Reports

Generate reports and documents associated with job and task analysis information

Reports and documents associated with the job and task analysis can be found on the Analysis tab of the VISION Report menu and throughout VISION Document menu.

Look at the Select… column to quickly identify analysis documents. Job Analysis Documents are found on the Qualification tab and other tabs of the Documents menu. Look at the Select… column to quickly identify analysis documents. Job Analysis reports are located on the Analysis tab. To open the Report or Document menus, click Outcomes on the Main Menu.

Enter Task Analysis Data in VISION EXERCISE Document a task analysis in VISION

The Cross Reference Process Hierarchy Component Properties Cross Reference Tables Script Outcomes How VISION combines information to produce custom documents

Explain how VISION combines information to produce qualification checklists, procedures, and other custom documents

The VISION process to produce custom documents: Hierarchy Component(s) Custom Script Properties Outcome Cross Reference Table(s)

The report generator language can use nearly all of the information in VISION. Links are made with a specific report or document in mind, then the report generator makes it happen. A custom report can contain cross reference table items, as well as properties from hierarchy components, including test questions. You can apply boilerplate text and formatting to reports. You can create very elaborate documents using the report script.

Procedure and OJT Content

Identify the places to enter Procedure or OJT content and their locations on the VISION workscreen

Procedures and OJT content can be entered in the Task, Sub task, and Element levels of the Analysis hierarchy.

On the OJT Notes page, you can also enter content by typing in the window or clicking the “Z” button for a pop out word editor. Here you can also click the Advisor button for help. On the Procedure page, you can enter content by typing in the window or clicking the “Z” button for a pop out word editor.

In the Procedure Content area, type or paste your content. After you open the Element properties, click on the Procedure menu item. Here is an example of how a procedure would be added to an element:

Which of the following Analysis nodes will have an OJT page? In which window can you enter a procedure? Sub-task Skill/Knowledge Phase

Produce a Procedure and a Qualification Checklist EXERCISE Develop procedures and qualification standards from a task analysis

The different items in VISION that make up a Learning Object Parts of an Objective Objective (Learning Object) Analysis Items (Consolidated or Directly Linked) Questions Content The different items in VISION that make up a Learning Object

Identify all of the elements of a Learning Object (Objective)

VISION objectives, or Learning Objects, include: Objective (Learning Object) Analysis Items (Consolidated or Directly Linked) Questions Content

All of these parts should be ready for learners when the objective is approved. If the objective is moved, the questions, content, and analysis item links will all move with it. All of these items will be frozen with the objective when it is approved (regardless of their approval states), so anything that isn’t ready can’t be fixed in this version of the objective. Objective (Learning Object) Objective (Learning Object) Analysis Items (Consolidated or Directly Linked) Questions Content Analysis Items (Consolidated or Directly Linked) Questions Content

Which of the following items are included in an objective, or learning object: Prerequisites Questions Test Units Analysis Items Qualifications Content

The Objectives Hierarchy The purpose of the Objectives hierarchy

Explain the purpose and use of the objectives hierarchy in VISION

It is also a central location to help you find, edit, share, and re-use objectives (such as for continuing training). It is from the Objectives hierarchy that the objectives are distributed (sequenced) to the Program (lessons). The Objectives Hierarchy is the structure in which learning objectives are formulated (usually from the JTA) and preserved. Analysis (JTA) Objectives Program

Analysis Objectives Program The Objectives Hierarchy represents a transformation of the job analysis structure to a learning and qualification structure. The Objectives Hierarchy provides a visual “roadmap” for assigning objectives to lessons in the appropriate learning order. In order for any task or skill/knowledge to be trained it has to be associated with an objective first. Analysis Objectives Program 4 3 2 1

Analysis Objectives Program What is the process to train the skills/knowledge 3A? 1 O 2 O 3 O 1 A 2 A 3 A 1 P 2 P 3 P 4 P Analysis Objectives Program Directly associate it to an objective A. Copy and paste it from the S/K to a lesson B. Directly associate it to an objective and then sequence it into a lesson C. Link it directly to a lesson with a drag drop D.

Connecting Analysis and Objectives The allowable relationships between task analysis components and objectives

Identify the relationships that can be established between task analysis components and objectives in VISION

When establishing analysis hierarchy components into objectives there are several types of relationships… Objective Hierarchy Analysis Hierarchy Indirect 1 : 1 T O T O 1 : Many T T E SK Many : 1 O 1 : None T None : 1 O

Objective Hierarchy Level Terminology Understanding the difference between objective levels

Distinguish between the different types of Objectives in VISION

The types of objectives in VISION are: Performance Cognitive Terminal Enabler

The levels of the Objective hierarchy consist of: Organizer, Cognitive Terminal, Cognitive Enabler, Performance Terminal and Performance Enabler. Terms Organizer Not an objective but contains nodes as structured subordinates. Terminal (Cognitive, Performance) The highest measurable level of completion for a given task or training goal. Can be either cognitive or performance. Enabler Helps the learner to achieve the terminal objective. Primarily lower-level knowledge and skills. Cognitive A knowledge-based objective and assessed in an academic format. Performance An action-based objective assessed in a hands on format.

Match the lettered icon to its numbered square: Performance Cognitive Terminal Enabler A. 1. 2. B. C. 3. 4. D.

Establish a Hierarchy of (draft) Training Objectives EXERCISE Develop a hierarchy of objectives from task analysis data

Objectives Workscreen How properties of an objective are documented in VISION

Identify the properties of the objective workscreen

The properties of the Objective workscreen are available in the following pages: Document Links Version Comments Past Versions Cross Reference Consolidation General Training Content Questions

Content: Provides a place to enter content that will be kept with the objective. Training: Contains training information about the objective. General: Contains the objective title (behavior), ID, conditions, standards, and other information that nodes must contain. Consolidation: Displays analysis items that are consolidated into the selected objective. Questions: Displays a list of test questions that are currently associated with the selected objective. Version Comments: Provides a place to record information on each revision that you make to this node. Document Links: This page is common to all hierarchy nodes and provides a place to link documents to the objective. Cross Reference: This page is common to all hierarchy nodes and provides a place to link cross reference items to the objective. Past Versions: Provides a record of changes to the node and a way to view previous versions of it.

Editing Objectives to write Formal Objective Statements EXERCISE Write formal objective statements and properties, including objective classifications

The Question Workscreen The features of the Question workscreen

Identify the features and organization of the Question workscreen

The unique properties of the Question workscreen are: Note that every question page is different depending on the type of question selected. Stats General Info Question

The Scenario Question Page: These are the options for all scenario questions. Unlike the other question types, you enter the “Scenario” and then create subquestions within the scenario with the “New” button. The scenario itself doesn’t have an answer or point value. The True/False Question Page: These are the options for all true/false questions. The question is entered in the “Statement” box, and the answer is entered in the “True” or “False” buttons. There is also space for an “Explanation” and a box for the point value of the question. The Short Answer Question Page: These are the options for all short answer questions. The question is entered in the “Question” box, and the answer is entered in the “Answer” box underneath. There is also a box for the point value of the question. The Matching Question Page: These are the options for all matching questions. These are made up of “Instructions”, “Items” and “Choices” that are entered individually. Choices are then matched to items with their checkboxes. Enter the point value of the entire question. The Fill-In-the-Blank Question Page: These are the options for all fill-in questions. The question is entered in the “Statement” box. Click the “New” button to enter each answer. You can enter more than one answer for the question. There is also a box for the point value of the question. The Multiple Choice Question Page: These are the options for all multiple choice questions. Choices are entered into the “Choice” box, and then the correct answer is marked above. There is also a box for the point value of the question and an explanation of the answer. The Stats Page shows statistics on how the question does on exams. Included here is the number of times the question has appeared on exams, as well as the number of times each answer or distractor has been selected. The Essay Question Page: These are the options for all essay questions. The question is entered in the “Question” box. Click the “New” button to enter each answer. You can enter more than one answer for the question. There is also a box for the point value of the question. The General page contains the Topic, Status, User-Defined ID, and other information that questions contain.

Write Test Questions to Match Objectives EXERCISE Develop test questions for objectives

Program Titles and Training Units Understanding the Program Hierarchy structure

Distinguish between a program title and a training unit

Program titles organize training units. Training units organize objectives, but don’t have any children in the Program hierarchy. Program Hierarchy Program Titles Training Units

A training unit fits three qualifications: It’s a lesson where the objectives appear. Is the lowest level in the program hierarchy, no children. It has to be designated as a training unit. CHILDREN

Identify if the selection is a program title or a training unit.

Understanding how to navigate through the Program workscreen

Identify the properties of the workscreen pages associated with Program titles

The unique properties of the Program workscreen are available in the following pages: Introduction Design Tests General

The Tests page is only available on a training unit, and is used to create and organize tests. The Design page is used for organizing objectives and content contained within the training unit’s objectives. The Introduction page provides an area to enter an introduction that will be included with the training unit. It also has publishing settings for the VISION Web. The General page contains identifying information, as well as the controls to make the node a training unit, and the development status.

Which page lets you select the program type? Which page let’s you organize objectives and test questions contained within the training unit? Which page let’s you select the publish settings?

Organize a Training Program Structure EXERCISE Create a training program structure

Test Properties Workscreen Features that give VISION’s Test Generator maximum power and flexibility

Identify the features on the test properties workscreen

The Test Properties window consists of five unique pages: Test Units, Selection, Summary, Print Options, and Security.

The Print Options page allows you to customize the way tests are generated. The Test Units page lists the title for the test and units that make up the test. Add test units by dragging and dropping them from the hierarchy. Note that all test units must be of the same type of node. The Selection page is where you populate the question pool and select questions to appear on the test. You can also organize the questions in a variety of ways. Right-click in the Question Pool area to see more options. The Security page allows you to take ownership of a test and restrict access to it. The Summary page shows the summary of the questions that are selected on the Selection page.

Exam Security Features An overview of the new security features in VISON’s exams

Identify exam security features associated with versioning

VISION now has the following exam security features: Questions can be disqualified and removed from tests Test units must be approved in order to approve the test Tests must be approved in order to be given to learners Version warning icons alert you when items have been changed

If an item has been changed or updated since a test was approved, the changed version will not automatically appear on the test. Instead, you will see an approval warning icon next to the item, and you can choose whether to update the test or choose not. If a test unit is not approved, the test cannot be approved. If a test is not approved it cannot be given to learners over VISION Web, and a printed version will have a watermark on it reading “Not Approved”. Questions must be “approved” to be included in a test. If a question is edited there will be an option to disqualify it, removing it from dynamic tests and disqualifying static tests that contain it.

Which is a new exam security feature? What would result in a version warning icon appearing? Questions can now be included from multiple objectives A test unit is not approved Test units no longer need to be approved in order to approve the test An unapproved test has been given to learners Tests must be approved in order to be given to learners A question needs to be disqualified Program hierarchy icons differ depending on the type of training unit Changes made to an approved node

Generate a Test for the Selected Lesson EXERCISE Generate exams and statistics “on-demand”

An introduction to VISION’s Versioning feature What is Versioning? An introduction to VISION’s Versioning feature

Define Versioning

Versioning stores changes to the data in your VISION database so that past versions of records can be reviewed in the future.

Versioning does this for all of the data stored in VISION. The task node will be saved as it was before you made the changes. Suppose you make changes to a task in your analysis hierarchy… If you make more changes, those versions will also be saved. Analysis Hierarchy Program Hierarchy Objective Hierarchy V V V V Main Menu: On top of every VISION screen. Menu bar will change with the type of window that is active Workbench Menu: located on the top of the VISION Workbench. only visible when the workbench is displayed (click to make info disapear()

This Ensures that every learner who takes this course will get the same information. Opening and “editing” the training unit will make a new, editable version of it. Training Units, for example, are containers that are filled with objectives. When the training unit is approved, the objectives and content in it are “frozen”. In some cases the object being versioned is not a node, but a “container” Objective Hierarchy Program Hierarchy Training Unit Approved Objectives Training Unit

Which of the following are a part of versioning? Yes No Stores the old version of a record whenever changes are made to it. Over-writes old records and replaces them with new ones. Keeps old records so that they can be viewed any time.

How to use the Versioning feature in VISION Versioning Controls How to use the Versioning feature in VISION

Identify the components of Versioning

The components of versioning are the Versioning menu, Versioning node pages, and Welcome page.

In the Date Tag Properties box you can view and edit information about the selected tagged date. The Date Tags list shows specific dates and times that have been saved as important events that might need to be revisited. Select one and then click the “Jump to Tagged Date” button to open a version of the database at that time. The Quick Jump menu will open a version of the database as it was on the date and time you enter. This menu will open the hierarchy as it appeared at the date and time you select. The Versioning menu, Jump to Date, and Welcome Page will bring up the Jump to Date menu.

Versioning options on an individual node only apply to that node. Use the Jump to Date button to open the whole VISION database as it was at the time of this version. Past Versions displays a list of past versions of the node and options to view it on that date. Select a version and click the “Jump to Date” button to view it. Version Comments gives you a place to enter a revision number and enter comments regarding the version.

Match the function to the screen shot: Enter revision information for a node View the VISION database as it was on a date View a node as it was on a date

View a Version History of an Object EXERCISE View version history of any type of VISION object: task, objective, test question, program node

View a Version of a Project EXERCISE View version of an entire project (database) for a specific point in time

Create and use a version tag Create a Version Tag EXERCISE Create and use a version tag

Some items require approval and some do not What can be “Approved” Item or Node Type Task Objective Question Program Node Test Qualification Card Some items require approval and some do not

Identify the items that are associated with an "Approval" state and the outcomes that are affected by it.

Here is a list of items that have an “approval” state, along with the associated outcomes for each: Item or Node Type Approval Term (on the workscreen) Outcome Associated with the Item or Node Task Completed Qualification Card/OJT Objective Approved Lesson Content Question Active Test Program Node (Course or Training Unit) Completed-Active Lesson Qualification Card Qualification

See the approval of each type of node: Item or Node Type Task Objective Question Program Node Test Qualification Card

If the items are in the approved state, that is also the state of the outcomes that will be seen (on-line or printed). Item Approval Outcome Task Completed Qualification Card/OJT Objective Approved Lesson Content Question Active Test Program Node (Course or Training Unit) Completed-Active Lesson Qualification Card Qualification

Fill in the chart: Item or Node Type Approval Term (on the workscreen) Outcome Associated with the Item or Node Task Completed Qualification Card/OJT Objective Approved Lesson Content Question Active Test Program Node (Course or Training Unit) Completed-Active Lesson Qualification Card Qualification ? ? ? ? ? ?

“Item” and “Container” Approvals Objective Analysis Items Questions Content How approvals interact with nodes that contain other nodes

Apply the idea of approvals at the Objective level to approvals of larger units, such as lessons and courses

Questions Objectives Training Units Courses Just as objectives contain questions, content, and analysis links, courses and tests also contain other items that need to be approved before the course or test is approved. Objective Analysis Items Questions Content Tests Test Units Questions Objectives Training Units Courses Course Training Units Objectives

Objective Objective Tests Tests Course Course You’ve already learned that analysis items, questions, and content should be approved before the objective is approved. The Tests Units that make up an exam must also be approved in order for the test to be approved. And the objectives linked to training units and the training units in courses must also be approved before the training unit or course can be approved. Objective Analysis Items Questions Content Objective Analysis Items Questions Content Tests Test Units Questions Objectives Training Units Courses Tests Test Units Questions Objectives Training Units Courses Course Training Units Objectives Course Training Units Objectives

Questions Objectives Training Units Courses Fill in the diagram: Objective Analysis Items Questions Content Tests Test Units Questions Objectives Training Units Courses ? ? Course Training Units Objectives ? ? ? ?

The “Approval Warning” ! What the approval warning is and when it appears

Identify the meaning and implications of the “Approval warning"

The “approval warning” means that a node linked to an approved item has been updated since the item was approved.

When an item is approved, it is “frozen” in it’s current state When an item is approved, it is “frozen” in it’s current state. When a child or linked item is updated, the approved item is not updated, but you will see an approval warning to indicate that something has changed. For example, we have a task with elements. This task has been approved. So remember, the Approval warning indicates that the item changed since the last time the associated “node” (component) was approved. The change will NOT be reflected until it is re-approved. So when one of those elements is changed… An approval warning appears.

So, what does this mean? The Qual Card would be delivered in the state when last approved. It would NOT reflect the change indicated by the warning until you reapprove the Task. With an Objective, any Lesson in which the Objective appears would be delivered in the state when last approved. It would NOT reflect the change indicated by the warning until you reapprove the Objective. Item Outcome Associated with the Item Task Qualification Card/OJT Objective Lesson Content Question Test Program Node (Course or Training Unit) Lesson Qualification Card Qualification

When you see an approval warning as in the example below, what does it indicate? The node needs to be updated. The node has been updated since it was last approved. The node needs to be approved.

Some items require approval and some do not What can be “Approved” Item or Node Type Task Objective Question Program Node Test Qualification Card Some items require approval and some do not

Identify the items that are associated with an "Approval" state and the outcomes that are affected by it.

Here is a list of items that have an “approval” state, along with the associated outcomes for each: Item or Node Type Approval Term (on the workscreen) Outcome Associated with the Item or Node Task Completed Qualification Card/OJT Objective Approved Lesson Content Question Active Test Program Node (Course or Training Unit) Completed-Active Lesson Qualification Card Qualification

See the approval of each type of node: Item or Node Type Task Objective Question Program Node Test Qualification Card

If the items are in the approved state, that is also the state of the outcomes that will be seen (on-line or printed). Item Approval Outcome Task Completed Qualification Card/OJT Objective Approved Lesson Content Question Active Test Program Node (Course or Training Unit) Completed-Active Lesson Qualification Card Qualification

Fill in the chart: Item or Node Type Approval Term (on the workscreen) Outcome Associated with the Item or Node Task Completed Qualification Card/OJT Objective Approved Lesson Content Question Active Test Program Node (Course or Training Unit) Completed-Active Lesson Qualification Card Qualification ? ? ? ? ? ?

Resolve Approval Warnings EXERCISE Resolve approval warnings on items associated with an objective and with larger units containing objectives, such as lessons and courses

The Four Items That make up Tests Courses Training Units Objectives Questions The different types of nodes that can be used on tests

Identify the four items contained in the test/exam “box”

These are the four items that can be test units (used in a test): Questions Objectives Training Units Courses

Questions are the simplest. Select any question and add it to the test. Training units contain objectives, which contain questions. Using these will give you access to all of the questions in the objectives contained in the training units for the test. Using a course is like using a training unit except that a course can contain more than one training unit. You would therefore get access to all of the questions in each training unit for the test. Use objectives, and all of the questions in those objectives will be available for the test. Questions Objectives Questions Training Units Objectives Questions Courses Training Units Objectives Questions

Which of these items can be used as test units? Courses Questions Organizers Training Units Tasks

Manage Disqualified Exams EXERCISE Manage a “disqualified” exam

Searching the Database EXERCISE Use Search, Find, or Jump