DASD(SE) Manufacturing Activities Robert A. Gold Director, Engineering Enterprise Office of the Deputy Assistant Secretary of Defense for Systems Engineering (DASD(SE)) Manufacturing Readiness Levels Workshop 2017 September 26, 2017

Agenda Current Activities 2017 Outreach Path Forward DASD(SE) Mission, Organization, Key Responsibilities M&Q Strategy Overview Body of Knowledge Development PQM Workforce Deep Dive 2017 Outreach DoD Initiatives Manufacturing Institutes Government/Industry Manufacturing & Quality Forum DMC Planning Path Forward

DASD, Systems Engineering Mission Systems Engineering focuses on engineering excellence − the creative application of scientific principles: To design, develop, construct and operate complex systems To forecast their behavior under specific operating conditions To deliver their intended function while addressing economic efficiency, environmental stewardship and safety of life and property DASD(SE) Mission: Develop and grow the Systems Engineering capability of the Department of Defense – through engineering policy, continuous engagement with component Systems Engineering organizations and through substantive technical engagement throughout the acquisition life cycle with major and selected acquisition programs. A Robust Systems Engineering Capability Across the Department Requires Attention to Policy, People and Practice US Department of Defense is the World’s Largest Engineering Organization Over 108,000 Uniformed and Civilian Engineers Over 39,000 in the Engineering (ENG) Acquisition Workforce

DASD, Systems Engineering Acting Deputy Assistant Secretary of Defense and Principal Deputy, Systems Engineering Kristen Baldwin Homeland Defense Capability Development Robin Hicks Major Program Support James Thompson Engineering Enterprise Robert Gold Supporting USD(AT&L) Decisions with Independent Engineering Expertise Engineering Assessment / Mentoring of Major Defense Programs Program Support Assessments Overarching Integrated Product Team and Defense Acquisition Board Support Systems Engineering Plans Systemic Root Cause Analysis Development Planning/Early SE Program Protection Leading Systems Engineering Practice in DoD and Industry Systems Engineering Policy and Guidance Technical Workforce Development Specialty Engineering (System Safety, Reliability and Maintainability, Quality, Manufacturing, Producibility, Human Systems Integration) Security, Anti-Tamper, Counterfeit Prevention Standardization Engineering Tools and Environments Providing technical support and systems engineering leadership and oversight to USD(AT&L) in support of planned and ongoing acquisition programs

DASD(SE) Key Responsibilities Program Engagement Serve as principal engineering advisor to the SECDEF and USD(AT&L) in support of critical acquisition decisions Provide continuous engineering oversight and mentoring of Major DoD Programs to identify, assess, and mitigate engineering risk; focus on helping ensure program success Serve as approval authority for Systems Engineering Plans for all Major DoD Programs Certify completeness of Preliminary Design Reviews and Critical Design Reviews for all Major DoD Programs Policy and Guidance Develop engineering, manufacturing, reliability, program protection, and modeling and simulation policy and guidance for the DoD Serve as Defense Standardization Executive – approve military standards and coordinate DoD engagement on non-military standards Technical Workforce Development Provide functional leadership for the Non-Construction (Engineering) and the Acquisition (ENG and PQM) workforce Engineering Research and Development Sponsor the DoD Systems Engineering Research Center (SERC) University Affiliated Research Center (UARC) Sponsor the MITRE National Security Engineering Center (NSEC) Federally Funded Research and Development Center (FFRDC) Manufacturing & Quality Highlights: Program Engagement This includes providing continues Manufacturing and Quality oversight and mentoring to MAIS and MDAPs. Policy & Guidance To include updates to the Defense Acquisition Guidebook Chapter 4 “Quality in Design” Most recently we coordinated engagement in the publication of SAE AS6500 “Manufacturing Management Program.” Technical Workforce Development: We are just finishing a refresh of the Production, Quality, & Manufacturing (PQM) Career Field competencies. We do this every other year to ensure that our workforce is implementing the best practices being used throughout government and industry. These competencies form the basis for collaboration with Defense Acquisition University (DAU) to ensure that our workforce is receiving the right training. Reference: DoDI 5134.16, Deputy Assistant Secretary of Defense for Systems Engineering

DoD Manufacturing & Quality Activities NEAR TERM 1-2 yrs out MID TERM 2-5 yrs out FAR TERM 5-15 yrs out Mfg. Component Leadership Current policy, guidance, and workforce cap2 based on BoK I. CURRENT STATE/AS-IS III. GAP ANALYSIS IV. STRATEGY DEVELOPMENT Required critical processes based on best practices and policy/guidance II. FUTURE STATE/TO-BE Comparison of As-Is and To-Be state Identify strategies to close gaps V. EFFECTIVENESS Assess strategy effectiveness and program execution Assess Health of the Enterprise

DASD(SE) Revitalizing the DoD Manufacturing & Quality Enterprise Summary Your efforts to continually refresh the Manufacturing “Bod-K” are vital to our manufacturing activities. Engage with key leaders to identify and mitigate manufacturing and quality program risks. Continue to shape the skills and competencies for the Department’s PQM Career field. Continue to identify where we can improve the Manufacturing and Quality enterprise. Foster industrial modernization. Manufacturing and quality are essential elements for effective warfighting capability. Compiling the Manufacturing Readiness BoK is tough work. This hard work is important Your hard work is appreciated DASD(SE) Revitalizing the DoD Manufacturing & Quality Enterprise

Systems Engineering: Critical to Defense Acquisition Defense Innovation Marketplace http://www.defenseinnovationmarketplace.mil DASD, Systems Engineering http://www.acq.osd.mil/se

Backup

2017 Outreach MRL WG Quarterly Meetings 24 Jan; 25 Apr; 25 Jul; 24 Oct Model-Based Enterprise Summit, NIST, Gaithersburg, MD 6-7 Apr Two of four tracks – Manufacturing; Quality America Makes, Youngstown, OH Site Visit 19 Jan Pentagon Visit (work force) 7 Feb DASD(SE) EE Site Visit 4 Aug DMDII Chicago, IL DMDII Leadership meeting with DASD(SE) 21 Aug DASD(SE) EE Site Visit 23 Aug

2017 Outreach PPIRS-SR Meetings SAE G-23 Quarterly Meetings 23 Jan, 12 Apr, 18 Jul SAE G-23 Quarterly Meetings 22 Feb, 14 Jun, 27 Sep Alliance for Manufacturing Foresight Summit Washington, DC 25-26 Jul Annual MRL Government/Industry Workshop 26-27 Sep DMC 2017 Tampa, FL (4-7 Dec) Government/Industry M&Q Roundtable MRL Panel & Training Sessions

2017 Outreach DLA Tech Data Initiative Meetings JAMSG/JAMWG 23 Jan, 12 Apr, 18 Jul JAMSG/JAMWG

2017 Outreach America Makes DASD(SE) EE visit Aug 2017 America Makes graduation 16 Aug 17 Completed 5 year start-up period Current activities Fielded “digital store front” to allow access to additive manufacturing information to members Developing comprehensive training approach and competency model Published Additive Manufacturing Roadmaps Published initial standards and specification documents

Initial JAMSG & JAMWG Meetings Held Sep 17 Joint Additive Manufacturing Steering Group and Joint Additive Manufacturing Working Group Draft Vision Efficient and effective application of additive manufacturing for DoD, enabled by communication, coordination, and collaboration between the Services and Defense Agencies in their support of research, development, acquisition, production and sustainment of DoD products and systems. Activities Foster DoD-wide understanding of how AM can be used to build a more capable force Implement strategy for coordinating DoD investments Gather and disseminate information Identify and share best practices Prepare reports Recommend changes in law and/or policy to better implement AM Draft Mission Provide the framework for DoD senior leadership and DoD additive manufacturing practitioners to address common additive manufacturing problems, concerns, and issues, and develop the solutions that will speed the application of additive manufacturing into defense products and systems. Organization JAMSG—GO/SES level JAMWG—O-6/GS-15 Membership OSD(MIBP)--lead OSD Staff Joint Staff Military Services DoD Components/Agencies Industrial Base Council organization reps Established by USD(AT&L) Memo, 6 July 2017 Initial JAMSG & JAMWG Meetings Held Sep 17

Current State Identified manufacturing and quality leadership Hold Quarterly Meetings Expanding Participation Assessing current policy and guidance P&G Deep Dive/Gap Analysis Underway Support manufacturing workforce development Production, Quality, & Manufacturing (PQM) Functional IPT PQM Workforce Deep Dive PQM Competency Refresh Upcoming Participate in manufacturing communities MRL Working Group JAMSG/JAMWG Manufacturing Institutes DoD Current Initiatives (PPIRS, Tech Data, others) Mfg. & Q Leadership Have meet quarterly for past year Understand Current P&G: DAG SEP Outline PQM Workforce Development PQM FIPT Participated in quarterly meetings AWQI Provided inputs to DAU on Draft PQM Products & Tasks Participated in Service Subject Matter Expert Panel HCI Provided inputs to description of PQM community PQM Q Board Drafted requirements PQM Competency Refresh Participated in workshop Provided input to the 98 sub-competencies at the 100/200/300 level Adjudicated stakeholder comments Upcoming: PQM Position Category Description (PCD) Participation in Mfg. Communities: DASD(MIBP) – (JDMTP; JIBWG; NNMI; DMC; MRL Qtly WG & Annual Workshop) L&MR (Industrial Base Council) DCMA NDIA Manufacturing Division Quarterly Meeting

Future State Document manufacturing & quality activities and metrics by program phase Mature/deploy manufacturing technologies Improve PQM workforce Improve Industrial Capabilities Promote and transition science and technology Statutory & Regulatory Requirements Additional Policy Requirements DFARS DAG DoD Guides & Handbooks Non Government Standards Best Practices

Manufacturing & Quality Body of Knowledge (BoK) Completed initial draft of Manufacturing & Quality Body of Knowledge 25 Aug 17 Way Forward (FY18) Coordinate with MRL Working Group Update format and content as needed Present at Defense Manufacturing Conference Potential Pilot Programs to validate Request Industry input

PQM Career Field Assessment Data Collection & Analysis Methodology Assessment separated into two parts (Body of Knowledge and Competency Model based questions across acquisition lifecycle) Part 1: Identification of PQM functions & tasks being performed across the acquisition lifecycle Part 2: Identification of workforce performing applicable tasks & training competencies Data collection activities conducted from 12 Jun 2017 to 31 Aug 2017 with identified Service Subject Matter Experts and Technical Point of Contacts at the supervisory level: Electronic Assessments Face To Face Interviews Telephonic Interviews

Defense Manufacturing Conference M&Q Roundtable DMC (December 4-8) in Tampa, FL Manufacturing & Quality (M&Q) Government & Industry forum Address M&Q topics of mutual interest between experts from industry, academia, and US government Potential annual event held in December concurrent with the Defense Manufacturing Conference/DMSMS Conference Roundtable Format (two 90-minute sessions) Proposed Roundtable Theme: “Current DoD M&Q Challenges” Open to Conference attendees with DD Form 2345

DMC M&Q Roundtable Planning Concept Assemble a group of senior M&Q leads across the Components, with industry counterparts, to discuss DoD-related M&Q challenges Sponsored by OSD: DASD(SE) EE (chair) Objectives: 1) Allow interaction and sharing of information among participants (non-attribution), 2) Create awareness in specific areas of concern for M&Q, 3) Create forum for practitioners to share knowledge and best practices Outcomes: 1) Open exchange of information on M&Q challenges across the government and industry, 2) Free-flowing dialog among senior practitioners, 3) Establish basis for future roundtables at DMC (may evolve to formal DMC panel in long-term) Potential Attendees: DASD(SE) EE; Army, Navy, Air Force M&Q Service Leads; DCMA Others Government: MIBP, MDA Industry Leaders Request Services, Agencies and DMC to identify appropriate industry reps Topics: Solicit topics and Government Panel members from Service Leads Need Recommended topics and Service Reps ASAP

Gap Analysis Policy & Guidance Workforce Development Metrics Currently Underway Does P&G Exist (if so, where)? Is It Being Implemented? Is It Effective? What Needs To Be Revised? What Is The Best Vehicle? Workforce Development PQM Career Field Deep Dive Ph II PQM Competency Refresh Metrics Task Metrics Program Metrics Enterprise Metrics III. GAP ANALYSIS Provided Mfg. inputs to SEP Outline SAE AS6500 Rollout Publicity G23 Committee quarterly meetings AS6500 briefed at SEP 2015 SE Forum Tailoring Guidance Workforce Training MIL-HDBK-896 Update

Effectiveness Iterative process to evaluate manufacturing activities Initial analysis included: Manufacturing issues in Acquisition Decision Memorandums Defense Acquisition Executive Summary assessments (Production) Manufacturing trends in major program engagements Acquisition document comments for Systems Engineering Plans and Acquisition Strategies Analysis On-Going Information will be used to assess effectiveness Policy & Guidance Coverage/Voids Program Performance Workforce Metrics V. EFFECTIVENESS ADM 600 ADMs Analyzed (From 1986 – 2013) 60 contained manufacturing concerns/issues AS/SEP 37 SEP with Mfg Comments (150 comments) 28 AS with Mfg Comments (60 comments) DAES Reviewed the DAES Production Assessments Initial assessment included one quarter’s worth of data (Sept to Nov 2013 ) Program Engagements

Strategy Development P&G Workforce Other Technologies JDMTP IV. STRATEGY DEVELOPMENT I. CURRENT STATE/AS-IS III. GAP ANALYSIS JDMTP MIL-HDBK 896 AS 6500 Tailoring II. FUTURE STATE/TO-BE P&G DAU ELOs Q Board Competency Refresh Cybersecurity Counterfeit Parts Workforce Other Technologies Additive Manufacturing Digital Thread