1. 1 Corporate Learning Organization Career Long Support to the AT&L Workforce John Hickok Director, Knowledge Mangement Global Learning and Technology Center August 16, 2010

2. Integrated Baseline Review System IntegrationSystem DemonstrationLow-Rate Initial Production Defense Acquisition System (event driven) Planning, Programming, Budgeting, & Execution Process (biennial calendar driven) Military Departments & Defense Agencies Cost Integrated Defense Acquisition, Technology, & Logistics Life Cycle Management Framework FOC IOC Full-Rate Production/Deployment MS B System Development & Demonstration Phase Operations & Support Phase Post Deployment Performance Review Three DOD Decision Support Systems Effective Interaction is Essential Sustainment National Military Strategy FYDP updated ISSUES Budget Committees Congress DoD Budget On Year Off Year POM/Budget Formulation PCP/BCP Prep Final PBDs Actual Costs Engineering Cost Estimation Methods Parametric Analogy Technology Development PhaseConcept Refinement Phase National Security Strategy DoD Testimony Strategic Planning Guidance Off Year Optional Fiscal Guidance President’s Budget to Congress Joint Programming Guidance Off Year Optional White House OSD & Joint Staff OMB SLRG Reviews Joint Planning Document PBD Cycle PMO Budget Estimate PMO POM Input Full Funding in FYDP CDD MS C POM/Budget Submit PCP/BCP Submit FYDP updated MS A The Milestone Decision Authority may authorize entry into the acquisition process at any point, consistent with phase specific entrance criteria and statutory requirements Economic Analysis (MAIS Only) AoA Plan System Threat Assessment Information Support Plan CPD Service/JROC Validation & Approval J-6 Interoperability & Supportability Cert. Validated and approved CDD and CPD for each increment of an evolutionary acquisition Oversight & Review Clinger-Cohen Act - Compliance (all IT) - Certification (MAIS) Net-Ready KPP KPPs CPD System Threat Assessment Information Support Plan Service/JROC Validation & Approval J-6 Interoperability & Supportability Cert. Net-Ready KPP Clinger-Cohen Act - Compliance (all IT) - Certification (MAIS) Clinger-Cohen Act - Compliance (all IT) - Certification (MAIS) Clinger-Cohen Act - Compliance (all IT) - Certification (MAIS) ADM Exit Criteria Met DAB/ ITAB MDA ADM DAB/ ITAB MDA ADM Exit Criteria Met DAB/ ITAB MDAAPB ADM Exit Criteria Met DAB/ ITAB MDA ADM Exit Criteria Met DAB/ ITAB MDAAPB ADM Exit Criteria Met DAB/ ITAB MDAAPB MBI Allocation Apportionment Affordability Assessment CARD (Designated Programs) POE CCA ICE Affordability Assessment POE CCA ICE Economic Analysis (MAIS Only) Contracting Acq Plan Source Selection Plan Draft RFP Acq Plan Draft RFP Source Selection Plan Production & Deployment Phase Increment III BC DRR FRP Increment II BC DRR FRP KPPs Joint Capabilities Integration & Development System VCJCS Oversight CJCSI 3170.01D Defense Acquisition System USD(AT&L) Oversight DoDD 5000.1 Planning, Programming, Budgeting & Execution DEPSECDEF Oversight MID 913 Purpose of LRIP: Establish Production Base Ramp to Production Rate Produce systems for IOT&E Low-Rate Initial Production Systems FCA Prototypes/ Engineering Dev Models Technology Development Strategy Program Strategy Cost, schedule & performance goals & exit criteria for first tech demo Test Plan Acquisition Strategy Program Structure Acquisition Approach Capability Needs T&E Considerations Risk Management Resource Management Life-Cycle Considerations Business Considerations System Development & Demonstration Contract Integrated Baseline Review LRIP Contract AoA Best Materiel Approach(es) Draft ver. 4.7. May 21, 2004 Study Contracts Initiate Evolutionary Acquisition StrategyEvolutionary Acquisition Strategy Refine initial concept. Develop Technology Development Strategy Reduce technology risk and determine appropriate set of technologies to integrate into a full system. Develop a system or increment of capability; reduce integration and manufacturing risk; ensure operational supportability; reduce logistics footprint; implement human systems integration; design for producibility; ensure affordability and protection of critical program information; and demonstrate system integration, interoperability, safety, and utility. Achieve operational capability that satisfies mission needs. Execute a support program that meets operational support performance requirements and sustains the system in the most cost-effective manner over its total life cycle. Dispose of the system in the most cost-effective manner at the end of its useful life. Tech Demos Preliminary Integrated Architecture Acq Plan Draft RFP Source Selection Plan Technology Development Contract Supports O&M Budget Review Acq Plan Draft RFP Source Selection Plan In-Service Review OctoberApril / May August September - November October - November November December January February (1st Monday) February - September DoD Appeals Disposal This chart is a classroom aid for Defense Acquisition University students. It provides a notional illustration of the interfaces among the three major decision support systems used to develop, produce, and field a system for national defense. Defense acquisition is a complex process, with many more activities than shown here, and many concurrent processes that cannot be properly displayed on a two-dimensional chart. Supporting information is on the back of this chart. For more detailed information see the Acquisition, Technology & Logistics Knowledge Sharing System (http://akss.dau.mil). System Performance Spec Prototypes/ Engineering Dev Models Initial Production Baseline CARD – Cost Analysis Requirements Description CCA – Component Cost Assessment ICE – Independent Cost Estimate MAIS – Major Automated Information System POE – Program Office Estimate RDT&E – Research, Development, Test & Evaluation Cost Acronyms BCP – Budget Change Proposals FYDP – Future Years Defense Program MBI – Major Budget Issue OMB – Office of Management & Budget PBD – Program Budget Decision PCP – Program Change Proposals PDM – Program Decision Memorandum POM – Program Objectives Memorandum SLRG – Senior Leadership Review Group Planning, Programming, Budgeting & Execution Acronyms Joint Capabilities Integration & Development System (need driven) ADM – Acquisition Decision Memorandum AoA – Analysis of Alternatives APB – Acquisition Program Baseline CD – Concept Decision DAB – Defense Acquisition Board DRR – Design Readiness Review FOC – Full Operational Capability FRPDR – Full-Rate Production Decision Review IOC – Initial Operational Capability ITAB – Information Technology Acquisition Board LRIP – Low Rate Initial Production MAIS – Major Automated Information System MDA – Milestone Decision Authority Oversight & Review Acronyms RFP – Request for Proposal Joint Capabilities Integration & Development System - Acronyms CDD – Capability Development Document CJCSI – Chairman, Joint Chiefs of Staff Instruction CPD – Capability Production Document DOTMLPF – Doctrine, Organization, Training, Materiel, Leadership, Personnel, and Facilities DAB – Defense Acquisition Board ICD – Initial Capabilities Document IOC – Initial Operational Capability JROC – Joint Requirements Oversight Council KPP – Key Performance Parameter Draft CDD AoA updated Full-Rate Production Systems Major Products Appropriation Committees Authorization Committees Authorization/ Appropriation Acts Passed PDM(s) Appropriated Funds To Support Contracts FOC Affordability Assessment POE CCA ICE Economic Analysis (MAIS Only) CARD (Designated Programs) Post Production Software Support Contracts Sustainment Contracts Operations & Maintenance Types of Funds RDT&E – Management & Support RDT&E – Adv Component Dev & Prototypes RDT&E – Systems Development & Demonstration Decision Points/Milestones CD DRR FRP DR Acquisition Strategy Program Structure Acquisition Approach Capability Needs T&E Considerations Risk Management Resource Management Life-Cycle Considerations Business Considerations Acquisition Strategy Program Structure Acquisition Approach Capability Needs T&E Considerations Risk Management Resource Management Life-Cycle Considerations Business Considerations Procurement AoA updated n/a MAIS AoA MAIS only Preferred System Concept Final Production Baseline ICD Post Independent Analysis Functional Area Analysis Functional Needs Analysis Joint Operations Concepts DOTMLPFDOTMLPF Joint Operating Concepts Joint Functional Concepts Joint Integrating Concepts Integrated Architectures DoD Strategic Guidance Functional Solution Analysis DOTMLPF Changes (CJCSI 3180) Service/JROC Validation & Approval Materiel Changes (CJCSI 3170) Ideas for Materiel Approaches Analysis of Materiel Approaches Alternative 1 Alternative 2 Alternative N RDT&E – Advanced Technology Development Integrated Baseline Review Production Contract Joint Functional Concept Joint Integrating Concept Integrated Architecture Joint Functional Concept Joint Integrating Concept Integrated Architecture Threshold/objective tradeoffs – Revised Performance Attributes Joint Functional Concept Joint Integrating Concept Integrated Architecture FOT&E LFT&E Waiver (if appropriate) Technical Systems Engineering Test & Evaluation Supportability Analyze/Assess Concepts Versus Defined User Needs Develop Concept Performance (& Constraints) Definition & Verification Objectives Interpret User Needs, Analyze Operational Capabilities & Environmental Constraints Decompose Concept Perf into Functional Definition & Verification Objectives Assess/Analyze Concept System Versus Functional Capabilities Decompose Concept Functional Definition into Component Concepts/ Assessment Objectives Develop Component Concepts, i.e., Enabling/Critical Technologies, Constraints & Cost/Risk Drivers Assess/Analyze Enabling/Critical Components Versus Capabilities Interpret User Needs. Analyze Operational Capabilities & Environmental Constraints Demo & Validate Sys Concepts & Technology Maturity Versus Defined User Needs Develop System Perf (& Constraints) Spec & Enabling/Critical Tech &Verification Plan Develop Functional Definitions for Enabling/ Critical Technologies & Associated Verification Plan Demo System Functionality Versus Plan Decompose Functional Definitions into Critical Component Definition & Tech Verification Plan Demo Enabling/ Critical Technology Components Versus Plan Develop System Concepts, i.e., Enabling/Critical Technologies, Update Constraints & Cost/Risk Drivers TRR PDR SRR Interpret User Needs, Refine System Performance Specs & Environmental Constraints Develop System Functional Specs & System Verification Plan Evolve Functional Performance Specs into CI Functional (Design to) Specs and CI Verification Plan Evolve CI Functional Specs into Product (Build to) Documentation and Inspection Plan Fabricate, Assemble, Code to “Build-to” Documentation Integrated DT&E, LFT&E & EOAs Verify Performance Compliance to Specs Individual CI Verification DT&E SFR CDR INPUTS ICD AoA Plan Exit Criteria Alternative Maintenance & Logistics Concepts INPUTSOUTPUTS Trades Analyze Assess/Analyze Concept & Verify System Concept’s Performance Trades Analyze Demo/Model Integrated System Versus Performance Spec Trades Analyze System DT&E, LFT&E & OAs, Verify System Functionality & Constraints Compliance to Specs Monitor and Collect All Service Use Data Develop Corrective Action Analyze Data to Determine Root Cause Determine System Risk/ Hazard Severity Integrate & Test Corrective Action Implement and Field Process Change – Hardware/Support Materiel Change INPUTS Service Use Data User Feedback Failure Reports Discrepancy Reports SEP OUTPUTS Analyze Trades Assess Risk of Improved System Combined DT&E/OT&E/LFT&E Demonstrate System to Specified User Needs & Environmental Constraints ICD & Draft CDD Preferred Sys Concept Exit Criteria T&E Strategy Support & Maintenance Concepts & Technologies AoA SEP TDS Sys Performance Spec Exit Criteria Validated Sys Support & Maintenance Objectives & Requirements APB CDD SEP ISP TEMP Analyze Deficiencies To Determine Corrective Actions OUTPUTS Modify Configuration (Hardware/Software/Specs) To Correct Deficiencies Logistics & Technical Acronyms ASR – Alternative Systems Review BLRIP – Beyond Low Rate Initial Production CDR – Critical Design Review CI – Configuration Item DT&E – Developmental Test & Evaluation EDM – Engineering Development Model EOA – Early Operational Assessment ESOH – Environmental, Safety & Occupational Health FCA – Functional Configuration Audit FMECA – Failure Mode Effects & Criticality Analysis FOT&E – Follow-on Test & Evaluation FTA – Failure Tree Analysis IOT&E – Initial Operational Test & Evaluation ISR – In-Service Review JITC – Joint Interoperability Test Command LFT&E – Live Fire Test & Evaluation LCC – Life Cycle Costs LORA – Level of Repair Analysis LRIP – Low Rate Initial Production MTA – Maintenance Task Analysis OA – Operational Assessment OT&E – Operational Test & Evaluation OTRR – Operational Test Readiness Review PESHE – Programmatic Environment, Safety & Occupational Health Evaluation PDR – Preliminary Design Review PCA – Physical Configuration Audit PRR – Production Readiness Review PPP – Program Protection Plan RMS – Reliability, Maintainability & Supportability SEP – Systems Engineering Plan S&T – Science & Technology SFR – System Functional Review SRR – System Requirements Review STA – System Threat Assessment SVR – System Verification Review T&E – Test & Evaluation TEMP – Test & Evaluation Master Plan TDS – Technology Development Strategy TRA – Technology Readiness Assessment TRR – Test Readiness Review Least Acceptable Most Acceptable Recycle/Reuse Reprocessing Disposal Landfill Disposal Logistics/ Sustainment Test Results Exit Criteria APB CPD SEP TEMP Product Support Package INPUTS Operations & Sustainment Peacetime Training Joint Operations Crises Evaluate Product Support Capabilities Performance Based Agreements Business Case Analysis Product Support Integrator/ Product Support Provider LFTE Report to Congress BLRIP Report to Congress ACCDDRR FRPDR B Demonstrate Product Support Capability Footprint Reduction Supply Chain Management Product Support Elements Total Life Cycle Systems Management Verify & Validate Production Configuration Define Supportability Objectives MTA FMECA FTA RCM LORA Prelim Sys Spec T&E Strategy SEP Support & Maintenance Concepts & Technologies Inputs to: -draft CDD -AoA -TDS -Cost/Manpower Est. ASR Sys Performance Spec LFT&E Waiver Request TEMP Validated Sys Support & Maintenance Objectives & Requirements SEP PESHE PPP TRA Inputs to: -IBR -ISP -STA -CDD -Acq Strategy -Affordability Assessment -Cost/Manpower Est. SVR PRR SRR Initial Prod Baseline Test Reports TEMP Elements of Product Support Risk Assessment SEP TRA PESHE Inputs to: -CPD -STA -ISP -Cost/Manpower Est. Data for In-Service Review Input to CDD for next increment Modifications/upgrades to fielded systems SEP Independent IOT&E Production Baseline Test Reports TEMP PESHE SEP Input to: - Cost/Manpower Est. Full-Up System Level LFT&E J-6 Interoperability & Supportability Validation Product Support Package/PBL Implementation Product Support Elements Support and Cost Baseline Supply Chain Management Contract for Sustainment (organic & commercial) OTRR JITC Interoperability Certification Testing PCA Develop Initial Product Support Strategy Interoperability Supply Chain Mgmt LCC Optimization Footprint reduction Product Support Elements Performance Based Logistics (PBL) Strategy (Preferred Product Support Approach) Refine Supportability Objectives/ Constraints Set Product Support Strategy Pre-IOC & Post IOC Supportability Assessments Continuous Tech Refreshment Obsolescence Management Configuration Control Data Management Product Support/PBL Management Public-Private Partnering PBA Modifications Assessment of PSI/PSPs Supply Chain Management Product Support Plan Statutory/Regulatory Source of Support Legacy Considerations -Supply Support -Training -Maintenance -Support Data -Manpower & personnel Product Support Elements The Challenge DoD’s “A”cquisition Systems and Processes

3. The Acquisition Warrior Unpredictable activity with end users, OSD, Congress, industry, oversight organizations, and media Challenges of Human Capital Management Known Unknowns and Unknown Unknowns DAU’s Challenge: Help workforce do their jobs, continuously learn, and respond

4. Formal Courses Providing a Constant Support Presence in DoD Acquisition Careers Filling the formal learning gaps with comprehensive learning assets …with Formal & Informal Learning Guidance AAP Q&A Policies Webcasts Communities of Practice Videos Best Practices Lessons learned Templates Tools Guidebooks Regulations LawsLawsLawsLaws Handbooks Audios Simulations Gaming Scenarios Classroom Materials Browseable DL/CL courseware

5. ACC BPCh Acquisition Knowledge Management System (AKMS) AT&L knowledge repository – gateway to policy and DoD AT&L services (MOSS2007) Repository of validated practices and lessons learned. (MOSS2007) Collaborative arm of the AKMS. Hosts acquisition related Communities of Practice. (Ecco 2.0) Multimedia Video and audio library. (Qumu) Atlas Blackboard Distance learning courses and continuous learning modules. Classroom and online facilitation tools and content management. Learning Management Systems Guidance AAP Q&A Policies Webcasts Communities of Practice Videos Best Practices Lessons learned Templates Tools Guidebooks ExamplesExamplesExamplesExamples Regulations LawsLawsLawsLaws Handbooks Audios Simulations GamingScenarios Classroom Materials Beyond formal instructor led training -- users have access to informal online performance support, cohorts/experts, and learning assets through Search, ACQuipedia articles, and icatalog, – at their point and time of need.Search ACQuipedia icatalog DAP Browseable DL/CL courseware 24/7 access to Informal learning assets

6. 6 WestMidwestSouth Mid-Atlantic Capital/NE DSMC Learning Asset Delivery (Regions) Learning Capabilities Integration Center Global Learning Technology Center Learning Asset Design Performance & Resource Management Operations Support Planning, Policy & Leadership Support HCI Assistant to the President 4th Estate Defense Acq & Career Management Office of the President President Vice President Chief of Staff Human Capital Planning and Management Learning Asset Life Cycle Management and Delivery DAU Learning Organization Internet Delivery Global Learning Technology Center

7. 7 Functional Leaders Functional Center Directors Mr. Alfred Volkman AT&L IC Mr. James Dalton FE Mr. Stephen Welby SPRDE/SE/PQM Dr. John Fischer STM Mr. Randy Fowler LOG Mr. Shay Assad CON Dr. Nancy Spruill BCEFM Mr. Dave Ahern ACQ & PM Mr. Edward Greer T&E Bill MotleyJohn McElhennyLarry LeggettSharon DAnjouLarry Baker Marty Falk Ray Ward John Snoderly James Malloy John ClaxtonLeslie Deneault Tom SimcikDwayne Tripp Richard Fowler Michael Rodgers Pat Dallosta Bryan Johns David Floyd Gerald Emke Lyle Eesley Performance Learning Directors Robert Pratt Renee Butler Gail Foley Mr. Bill Kobren LOG Doug Killey Mr. Lenny Manning CON Mr. Brad Brown Pm & ACQ Mr. George Prosnik E&T Ms. Sharon Jackson BCEFM Stephen Skotte Kevin Linden Terry Johnson Revised 23 Jun 10 Dale Lippman Reggie Parks Ms. Joyce France IT/SAM

8. Learning at the Point of Need “It’s not about classroom or web, it’s about selecting the right delivery medium.... Learning at the point of need is about giving the learner more control!” Frank Anderson Former DAU President Formal and informal learning must be integrated!

9. © LearningGuide Solutions US, 2007 100% 80% 60% 40% 20% 0% 30 Min. 58% 33% 48 Hrs. Time after course completion3 weeks Source: Research Institute of America Performance Learning Model Strategy Formal Training Event MASTERYMASTERY Integrating Formal and Informal Learning Informal Learning at the Point of Need Single-Dimensional Learning Environment

10. Is this true: 80 % of learning takes place on the job (and not in a class)? Informal = 80% Formal = 20% Informal vs Formal Learning Informal: the degree which the learner has control of both the objective and the means. Formal: the degree which the institution has control of both the objective and the means. “Learning in the Workplace”, Marsick and Watkins, 1990.

11. Hours FY00FY01FY02FY03FY04FY05FY06FY07FY08FY09 DAWIA Training410,0002,563,0002,240,0003,730,0003,900,0004,129,3494,351,4784,415,0875,308,9176,479,014 CL Module Hours033120,382456,423192,000439,416535,315837,0861,205,4711,785,446 Knowledge Sharing000277,000471,500775,654782,818656,674697,5091,236,971 Mission Assistance000136,800170,317380,800400,535389,416419,504492,521 Total410,0002,563,3312,260,3824,600,2234,733,8175,725,2196,070,1466,298,2637,631,4019,993,952 DAU Provides both formal & informal learning 304% increase of informal hours over the FY03 baseline

12. 12 Second Transformation: Making “Learning at the Point of Need” a Reality! DAU Media Library DAU on iTunes U MG Erwin Lessel Living Library Interview Live WebCast Conference Speakers Guest Lecturers Defense Acquisition Portal (New) Best Practices Clearing House ACQuipedia Acquisition Community Connection (ACC) Integrated Environment Asset in one location Consumable by All Locations! DAU Training Assets Multi- dimensional Learning Environment

13. AT&L Knowledge Management System (AKMS) Systems and Tools 13

45. What’s Ahead to Support the Workforce? Personalization – A “My DAP” option, pushing the latest information based on personal profiles and needs Latest ACC social networking tools with updated software Upgraded BPCh system and integration with communities of practice Upgraded AAP system and conversion to “Ask A Question” System with tie-in to communities of practice Expanded set of Performance Learning Tools – Contract Pricing and Reference Guides, Updated ILC, Life Cycle Log Chart, Milestone ID and Development, Joint Probability of Program Success, and many others