1. Focus on the Future: System of System (SoS) Testing – A Journey… Starts at the Beginning… Essential!!! RDML Jeffrey “Zoil” Penfield, Commander, Operational Test and Evaluation Force (COTF) 10 Oct 2012

2. FROM LEADERSHIP “...CAN THE SYSTEMS WE DEVELOP BE COMMONLY USED ACROSS ALL PLATFORMS? CAN THE COMMAND AND CONTROL SYSTEM USED IN ONE PLACE BE USED IN ANOTHER? ARE THE SYSTEMS WE DEVELOP INTEROPERABLE?” ADMIRAL GARY ROUGHEAD, FORMER CHIEF OF NAVAL OPERATIONS Global Mission vs Budget

3. Current Acquisition System 3 Warfighter’s Requirement Resources Provider Operational Test System vs SoS

4. A SoS Approach Is Possible The Right Investments Are Critical SoS System Engineering is Essential 4

5. But That’s Challenging 5

6. Pg 1 of 1200 Standards: complex and open to interpretation Different programs, contractors, and services creating stovepipes (minimum overlap) Independent Implementations x Coordinated Implementation Government Defined Implementation Coordinated Implementations 6

7. Where We Need To Head Effects Chain Functions CONFIDENCE ACCURACY RANGE TARGETING AT SAFE RANGE DIRECT DAMAGE INDICATIONS VOLUME COVERAGE FULL INTEGRATIO N TO SAFELY LAUNCH DETECT ID TRACK ASSESSSURVEILLANCE LAUNCH WEAPON CONTROL CUE ACCURACY AT SAFE RANGE KILL CRITERIA AT LAUNCH RANGE FULL INTEGRATIO N DATA LINK Requiring, Resourcing, Managing/Developing/SE, Testing, at Capability/SoS Level

8. P-3C F/A-18 C/D F/A-18EF 73 F/A-18EF 79 F/A-18 C/D F/A-18EF 73 F/A-18EF 79 P-3C E-2C EA-18G F/A-18 C/D F/A-18EF 73 F/A-18EF 79 SLAMER P-3C LSRS EP-3 MH-60R E-2C EA-18G F/A-18 C/D F/A-18EF 73 F/A-18EF 79 E-2C EA-18G F/A-18 C/D F/A-18EF 73 F/A-18EF 79 SurveilDetectTrack ID (Commit Engage ) LaunchControl Weapon (Kinematic s Lethality) Assess E-2C EA-18G E-2C EA-18G F/A-18CD F/A-18EF 73 F/A-18EF 79 P-3C LSRS EP-3 MH-60R P-3C LSRS P-3C LSRS EP-3 MH-60R P-3C LSRS EP-3 MH-60R SLAM-ER CG / DDG SSN MH-60R CG / DDG SSNCG / DDG SSN CG / DDG SSNCG / DDG SSN Effect/Kill Chains Seams Matter!

9. COTF Initiatives System Under Test (SUT) Test of OPNAV’s investment Blue Sheets Program Accountability System of System (SOS) Rest of the story… Tactical context = SOS Kill / Effect chain application – when feasible Gold sheets Broader Accountability Warfare Capability Baseline 9

10. Challenges Paradigm shift from system to System of system Acquisition Process System Engineering More dollars associated with one program/capability Management complexity Development complexity Test complexity Etc etc But… better product at the end!!! 10

11. Questions / Comments???!!! 11