UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 Developmental Test & Evaluation Presented to ITEA Symposium Edward Greer Director, Developmental Test & Evaluation September 14,

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 Minimizing Discovery in IOT&E DDT&E supports: Program Offices and DoD T&E community Test planning and data analysis Early discovery of deficiencies Identification and sharing of best practices Improve DT&E practice thru: DT Policy & Oversight Advancing DT&E Capability and Service Competencies Mission of the Director, Developmental Test & Evaluation (DDT&E) Improve acquisition outcomes by advancing “state of the practice” DWSS MRAP 2

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 DT&E Organization DD, Land and Expeditionary Warfare Steven Lopes DD, Air Warfare George Axiotis DD, Naval Warfare Patrick Clancy DD, Net Centric & Space Ray Shanahan Oversight of MDAP performance TES/TEMP approval MDAP performance - inputs to Congressional report T&E best practices Tech Maturity with RD & SE Assessment of Operational Test Readiness Reliability Growth Testing DT&E inputs to Program Support Reviews High priority test event observation OIPT/DAES support DD, Capability Development Darlene Mosser-Kerner Policy / Guidance Acquisition DT&E Workforce DAU Content TEMP DT&E Concept Briefs Measures and Metrics Joint T&E Integrated T&E DT&E in SEP Annual Report Director Edward Greer Principal Deputy Chris DiPetto 3 Appointee SES Legend:

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 Studies on T&E and Acquisition 4 “...beginning production before successfully demonstrating that the weapon system will work as intended increases the potential for discovering costly design changes…and usually requires substantial modification costs at a later time.” 2008 GAO Assessments of Selected Weapon Programs “Approximately 50% of programs completing IOT&E since 2000 have been assessed as not operationally effective and/or suitable.” 2008 DSB Report on Developmental Test and Evaluation

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 DT&E Influences Acquisition Pre-IOT&E: AOTR showed high risk to IOT&E Accurately predicted unfavorable results Added time/expense to retest failures LPD-17 5 P-8A Milestone C: ITT engaged early and continuously Risk of redesign carefully considered Stable design and predictable performance Low risk – Program entered LRIP on time SDB II Milestone B: Adequacy / affordability of the plan Design of Experiments analysis Risk at MS C (Knowledge points) drove agreement with PEO Level of DT&E Engagement C-5 RERP

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 DDT&E in DoD: What and When  Test Evaluation Strategy (TES)  Technology Development Strategy (TDS)  Identify emerging T&E capability requirements  Identify T&E resources  Develop T&E requirements in RFP  Support AoA technical analysis  Test and Evaluation Master Plan (TEMP)  Acquisition Strategy  Support T&E Program Execution  Provide T&E results for OIPT/DAB Reviews  CDD requirements for testability and ability to evaluate  Support TRL Evaluation  T&E requirements in RFP  Report of performance measures, metrics and evaluations  Update TEMP  Support T&E Program Execution  Provide T&E results for OIPT/DAB Reviews  Support PDR/CDR and all technical reviews  CPD requirements for testability and ability to evaluate  Support TRL Evaluation  T&E requirements in RFP  Discovery and deficiencies  Report of performance measures, metrics and evaluations  Update TEMP  Support T&E Program Execution  Characterize system capabilities and limitations  Provide T&E results for OIPT/DAB Reviews  AOTR / OTRR  Support training for IOT&E  Report of performance measures, metrics and evaluations  Update TEMP for Follow-on DT&E and OT&E  Verification of corrections for deficiencies  Develop T&E programs to support upgrades, modifications, and increments  Support T&E Program Execution  Report of performance measures, metrics and evaluations TEMP TES TEMP ICD CCD CPD 6 IOT&E $1 invested here

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 DDT&E in DoD: What and When TEMP TES TEMP ICD CCD CPD 7 IOT&E Saves $100 here $1 invested here A few DDT&E observations: Lack of DT&E expertise during program formulation DT&E program planning and resourcing not adequate System immaturity at MS C or at OTRR Inadequate reliability growth programs

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 Training MRTFB Utilization by PMs DAB T&E Workforce DAU T&E Curriculum RTOs DDT&E Environmental Scan Planning Execution Results Enhance TEMP Content T&E forTechnologies Emerging DT&E in Rapid Prototyping DAES DoE AOTR 8

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 T&E Associations across the Enterprise Warfighter Test Infrastructure Developmental Testing Operational Testing Materiel Solution Analysis Production & Deployment Operations & Support Technology Development Engineering and Manufacturing Development ABC Need to Maximize Synergies Across Associations 9

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 DT&E Challenges/Initiatives Efficient, effective and fully Integrated T&E (CODB) Reliability, Availability, and Maintainability Information Assurance Early and continuous engagement with PMs Workforce skill mix Increased use of M&S Emerging technologies Distributed testing SNJ-5 “Texan” Trainer

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S-3203 Back! T&E Community Advocate! DDT&E is

UNCLASSIFIED DISTRIBUTION STATEMENT A – Cleared for public release by OSR on Sep – SR case number 10-S Questions? The right information, to the right decision maker, at the right time, for better decisions OFFICE OF THE SECRETARY OF DEFENSE OFFICE OF THE UNDER SECRETARY OF DEFENSE FOR ACQUISITION, TECHNOLOGY, AND LOGISTICS DEVELOPMENTAL TEST & EVALUATION 3090 Defense Pentagon Room 3B941 Washington, DC