OPERATIONAL TEST & EVALUATION CHALLENGES Looking to the Future OPERATIONAL TEST & EVALUATION CHALLENGES 41st Annual NDIA Symposium on Targets, UAVs and Range Operations November 18, 2003 Tom Blann OSD/DOT&E/CS (703) 695-8941 tblann@dote.osd.mil 1

Changes in DoD Decision Support Systems Looking to the Future Changes in DoD Decision Support Systems Joint Capabilities Integration & Development System (JCIDS) CJCS 3170.01C 24 June 03 VCJCS/Service Chief Oversight MID 913 PPBS to PPBE 22 May 03 Defense Acquisition System Planning, Programming, Budgeting & Execution Process (PPBE) Milestone Decision Authority (MDA) Oversight DEPSECDEF Oversight DoD 5000 Series 12 May 03 Revision 2

OT&E Challenges Contributing to the Evolutionary Acquisition Process Looking to the Future OT&E Challenges Contributing to the Evolutionary Acquisition Process Network Centric Systems OT&E OT&E Resources Summary 3

Contributing to the Evolutionary Acquisition Process Looking to the Future Contributing to the Evolutionary Acquisition Process Requirements- or Capabilities-based? Realistic Development Schedule? Continuous OT&E? OT&E Focus: Mission Performance 4

Network Centric Systems OT&E Looking to the Future Network Centric Systems OT&E Realistic Representation of the Network Integrate OT&E with Training Role of M&S 5

OT&E Resources Ranges Threat Representation Unique capabilities Looking to the Future OT&E Resources Ranges Threat Representation Unique capabilities 6

Looking to the Future Summary Evolutionary Acquisition Process – OT&E has to be better embedded; may require “continuous” OT&E; keep focus on mission performance. Network Centric Systems OT&E – Still require the platforms; better integration of OT with training; M&S may augment, but can’t replace realistic OT. OT&E Resources – More investment is required: Targets, range expansion, networked ranges, special assets. 7

BACK-UP BU1

OPERATIONAL TESTING requires End-to-end testing (detection through kill), With system operated by typical users, Against threat-representative targets, In realistic environments. BU2

SO WHAT DO WE LOOK FOR WHEN SELECTING A RANGE? TESTING End-to-end: Enough surface and air space to simulate mission execution Infrastructure to support realistic threat representation Threat representation: Capability to represent the spectrum of threats Realistic environment: Distance from commercial corridors and shipping lanes Range clearance capability Flexibility to relocate operations rapidly EVALUATION Time Space Position Information Weapon system data collection Target system data collection BU3

Shorter OODA Loops? Looking to the Future Legacy Decision-Making OODA Loop OT&E Must Get Inside The Transformational Decision-Making OODA Loop Legacy OT OODA Loop OK Transformed Decision-Making OODA Loop NOT OK From “The Challenge of Transformation”, by Dr. Paul R. Muessig BU4