CRESST ONR/NETC Meetings, July 2003, v1 17 July, 2003 ONR Advanced Distributed Learning Bill BewleyAllen Munro Greg ChungJosh Walker Girlie Delacruz USC/BTL UCLA/CRESST The USMC Marksmanship Application  2003 Regents of the University of California

CRESST ONR/NETC Meetings, July 2003, v1 1 The Problem –Assessment models and tools are needed to help Navy, Marine, and contractor personnel evaluate, design and use Distributed Learning Project Goals –Develop and test models and tools on real applications Content knowledge: USMC marksmanship (02-03) Problem solving: USN EDO (Engineering Duty Officer) training and one other domain (03) The KMT Project

CRESST ONR/NETC Meetings, July 2003, v1 2 The First Application: HUEY HUEY: “UNQ to Expert” –In 2002, about 45% of Marines are shooting lower than Expert –About 2% of Marines are unqualified –About half need two tries to qualify The goal: Move all Marines to Expert classification UnqualifiedSharpshooterMarksmanExpert

CRESST ONR/NETC Meetings, July 2003, v1 3 The KMT Plan Assess and remediate potential unqualified Marines before they reach the firing line—on-line—using USMC and ONR training approaches Research Questions –What are the critical types of knowledge that affect shooting performance? –To what extent can cognitively-based measures predict USMC rifle shooting performance?

CRESST ONR/NETC Meetings, July 2003, v1 4 The Payoff Save time Save money Increase shooting scores

CRESST ONR/NETC Meetings, July 2003, v1 5 What’s Wrong With This Picture?

CRESST ONR/NETC Meetings, July 2003, v1 6 And What Would Cause This Shot Pattern?

CRESST ONR/NETC Meetings, July 2003, v1 7 Who Cares? The answers are important if you want to be a good marksman

CRESST ONR/NETC Meetings, July 2003, v1 8 Who Cares? And marksmanship is not easy –A shooter must routinely hit a 19- inch circular area at 500 yards in the prone position

CRESST ONR/NETC Meetings, July 2003, v1 9 Who Cares? A 1/16 inch muzzle deflection will cause a miss of over 2 feet at 500 yards 500 yards: 1.5 times the distance between the top row of opposite end zones of the LA Coliseum

CRESST ONR/NETC Meetings, July 2003, v1 10 What We Did Field research –Knowledge acquisition + staff expertise –Develop and pilot test draft assessments Delivery infrastructure –BTL’s iRides authoring system –BTL’s Battlesight Zero and Databook simulations integrated with the CRESST Knowledge Mapper

CRESST ONR/NETC Meetings, July 2003, v1 11 Variables: The Big Picture Steadiness Prior shooting experience* Device-fire performance Rifle Marksmanship Performance Perceptual- Motor CognitiveAffective Equip- ment Environ- ment Training effects* Aptitude* Knowledge of shooting* Confidence Anxiety* Attitudes* Ballistics Rifle character- istics Weather Distance * = attempted to measure in current studies

CRESST ONR/NETC Meetings, July 2003, v1 12 Marksmanship Inventory Knowledge Assessment Evaluates prior knowledge, knowledge transfer of fundamentals instruction Paper or online

CRESST ONR/NETC Meetings, July 2003, v1 13 Marksmanship Knowledge Mapper Trainees diagram key marksmanship concepts and relationships –Fundamentals –Shot-to-shot explanation –Data book procedure Score against a “doctrine” map produced by Quantico WTB staff

CRESST ONR/NETC Meetings, July 2003, v1 14 Mapper: Fundamentals

CRESST ONR/NETC Meetings, July 2003, v1 15 Mapper: Shot-to-Shot

CRESST ONR/NETC Meetings, July 2003, v1 16 Mapper: Data Book Procedure

CRESST ONR/NETC Meetings, July 2003, v1 17 Shot Group Depiction

CRESST ONR/NETC Meetings, July 2003, v1 18 Evaluation of Shooting Positions Assess and correct fundamental problems with shooter’s body position and the resulting impact on performance

CRESST ONR/NETC Meetings, July 2003, v1 19 Evaluation of Shooting Positions

CRESST ONR/NETC Meetings, July 2003, v1 20 Affective Measures Trait worry about qualification trial Trait anxiety about qualification trial State worry (pre- and post- qualification) about qualification trial State anxiety (pre- and post- qualification) about qualification trial

CRESST ONR/NETC Meetings, July 2003, v1 21 Sample Description SampleDatesPurpose SLR -- Stone Bay Dec , 2002 Test assessments of marksmanship knowledge and evaluate prediction of qualification score. SLR -- Quantico Mar , 2003 Replicate study on 2nd sample. ELR (2LT) -- Quantico May , 2003 Replicate study on 2nd LT undergoing entry- level training. SLR = Sustainment-Level Rifle Marksmanship ELR = Entry-Level Rifle Marksmanship

CRESST ONR/NETC Meetings, July 2003, v1 22 Sample Description Stone BayQuantico Phase I training Mixed - unit trained or classroom training at Stone Bay Uniform - all Marines get classroom training at Quantico CoachesFrequent rotation Professional coaches Combat status About 30% were from infantry units Nearly 100% from support units

CRESST ONR/NETC Meetings, July 2003, v1 23 Prediction of Qualification Score (Regression Model) VariableSLR-SBSLR-QELR-2LT Multiple R (R 2).56 (.31).52 (.27).80 (.63) Model variables (P-M) most recent score, whether a coach; (COG) time since last Phase I training, prior knowledge, shot- group knowledge, position identification, knowledge map, perceived value of knowledge to performance; (AFF) planning/worry (P-M) most recent score, frequency of shooting outside USMC duties, no. of years of shooting experience prior to USMC; (COG) prior knowledge; (AFF) trait worry, trait firing line experience (COG [post- instruction]) prior knowledge, proper position identification (firing hand), ASVAB GCT, perceived level of marksmanship knowledge, (AFF) state worry/anxiety during qualification

CRESST ONR/NETC Meetings, July 2003, v1 24 Prediction of Qualification Score (Perceptual-Motor vs. Cognitive/Affective) ModelSLR-SBSLR-QELR-2LT Overall (shooting experience, cognitive, affective), R (R 2 ).56 (.31).52 (.27).80 (.63) Shooting experience, R (R 2 ).43 (.18).37 (.13)-- Cognitive and affective, R (R 2 ).41 (.17).50 (.25)--

CRESST ONR/NETC Meetings, July 2003, v1 25 Prediction of Qualification Score (Knowledge) VariableSLR-SBSLR-QELR-2LT Perceived level of marksmanship knowledge --.26**.42** Prior knowledge.29**.16.46*** Knowledge mapping (p=.07) -.07 Shot group depiction.27** Evaluation of Shooting Positions.20** (p=.07)

CRESST ONR/NETC Meetings, July 2003, v1 26 Working Hypotheses VariableSLR-SBSLR-QELR-2LT Overall level of marksmanship experience LML Overall quality of classroom and live-fire training experience MHH Skill level placement (learner, practice, automatic) learner/ practice learner

CRESST ONR/NETC Meetings, July 2003, v1 27 Working Hypotheses Three stages of skill acquisition: –Learning, practice, automatic Cognitive measures should be most sensitive to Marines in the beginning to middle of the learning phase, and less sensitive to those past the mid-learning phase Psychomotor variables should be the most sensitive to Marines past the initial learning stage

CRESST ONR/NETC Meetings, July 2003, v1 28 Working Hypotheses VariableLearner vs. Practice Sensitivity of knowledge measuresL > P Correlations among knowledge measuresL > P Relationship between knowledge measure and shooting score Perceptual-motorL < P AptitudeL > P KnowledgeL > P AffectiveL > P

CRESST ONR/NETC Meetings, July 2003, v1 29