1. OPERATIONAL TEST & EVALUATION CHALLENGES
Looking to the Future
OPERATIONAL TEST & EVALUATION CHALLENGES
41st Annual NDIA Symposium on
Targets, UAVs and Range Operations
November 18, 2003
Tom Blann
OSD/DOT&E/CS
(703) 1

2. Changes in DoD Decision Support Systems
Looking to the Future
Changes in
DoD Decision Support Systems
Joint Capabilities
Integration &
Development
System (JCIDS)
CJCS C
24 June 03
VCJCS/Service
Chief Oversight
MID 913 PPBS to PPBE
22 May 03
Defense
Acquisition
System
Planning, Programming, Budgeting & Execution Process (PPBE)
Milestone Decision
Authority (MDA)
Oversight
DEPSECDEF
Oversight
DoD 5000 Series
12 May 03 Revision 2

3. OT&E Challenges Contributing to the Evolutionary Acquisition Process
Looking to the Future
OT&E Challenges
Contributing to the Evolutionary Acquisition Process
Network Centric Systems OT&E
OT&E Resources
Summary 3

4. Contributing to the Evolutionary Acquisition Process
Looking to the Future
Contributing to the Evolutionary Acquisition Process
Requirements- or Capabilities-based?
Realistic Development Schedule?
Continuous OT&E?
OT&E Focus: Mission Performance 4

5. Network Centric Systems OT&E
Looking to the Future
Network Centric Systems OT&E
Realistic Representation of the Network
Integrate OT&E with Training
Role of M&S 5

6. OT&E Resources Ranges Threat Representation Unique capabilities
Looking to the Future
OT&E Resources
Ranges
Threat Representation
Unique capabilities 6

7. Looking to the Future
Summary
Evolutionary Acquisition Process – OT&E has to be better embedded; may require “continuous” OT&E; keep focus on mission performance.
Network Centric Systems OT&E – Still require the platforms; better integration of OT with training; M&S may augment, but can’t replace realistic OT.
OT&E Resources – More investment is required: Targets, range expansion, networked ranges, special assets. 7

8. BACK-UP
BU1

9. OPERATIONAL TESTING requires
End-to-end testing (detection through kill),
With system operated by typical users,
Against threat-representative targets,
In realistic environments.
BU2

10. SO WHAT DO WE LOOK FOR WHEN SELECTING A RANGE?
TESTING
End-to-end:
Enough surface and air space to simulate mission execution
Infrastructure to support realistic threat representation
Threat representation:
Capability to represent the spectrum of threats
Realistic environment:
Distance from commercial corridors and shipping lanes
Range clearance capability
Flexibility to relocate operations rapidly
EVALUATION
Time Space Position Information
Weapon system data collection
Target system data collection
BU3

11. Shorter OODA Loops? Looking to the Future
Legacy Decision-Making OODA Loop
OT&E Must Get Inside The Transformational Decision-Making OODA Loop
Legacy OT OODA Loop OK
Transformed Decision-Making OODA Loop
NOT OK
From “The Challenge of Transformation”, by Dr. Paul R. Muessig
BU4