0. Milestone A to Milestone B Requirements Management Activities
Materials: Lesson Charts , student papers selected from assignment 1, current ADM (s) from MS B
References. See student reading assignments posted to Blackboard. Read them.
Time Breakdown: 1 Hour
Lesson Outline
Purpose: To familiarize students with the requirements management related activities that take place during the acquisition process from Milestone A to Milestone B, the scope/construct of the Technology Development Phase, and the decisions made at Milestone B.  
Need To work on the PDR slide to align with TLO
(copied from word doc embedded on Chart 0)
Reading Assignments Lesson Milestone A to Milestone B, RM Activities:
Read:
Lesson Charts.
DoDI ,
Enclosure 2, Procedures, paragraph 5, Technology Development Phase.
Enclosure 4 -- Table 6. APB Policy
Defense Acquisition Guidebook section 2.2
2.2. Program Strategy Document Requirements
Program Strategies for Increments and Subprograms
2.3. Program Strategy Relationship to Other Program Documents
2.4. Relationship to Request for Proposal (RFP)
And Defense Acquisition Guidebook section 2.8
2.8. Technology Development Strategy/Acquisition Strategy (TDS/AS) Outline
Purpose
Capability Need
Acquisition Approach
Tailoring
 Scan:
Technical reviews summary for RMs (embedded object in backup Chart 14 )
DAG section
Chapter 3 - Affordability and Life-Cycle Resource Estimates
including :
Implications of Evolutionary Acquisition
Total Ownership Costs
Fully Burdened Cost of Delivered Energy
4.5. Systems Engineering Execution: Key Systems Engineering Tools and Techniques
Summary of Technical Reviews
CLE 003
Technology Readiness Assessment guidance 2011,
page 2-5 and Identify Technologies To Be Assessed
Other On line resources applicable to this lesson:
ADM Pre-EMD Joint Light Tactical Vehicle, 25 Jan 2012
ADM Ms B Joint Light Tactical Vehicle Aug 20, 2012, (establishing an account with DTIC Acq Info repository)
ADM Pre-EMD Enhanced Polar System, Mar
ADM MS B assign ACAT 1D PIM_17June11
ADM MS B KC-X _ 24 Feb 11
ADM MS B SDB II _6 Aug10
ADM MS B JHSV _30Oct08.pdf
Defense Acquisition Guidebook
This and DoD and , DTMs and other AT&L memos available at downloads
Chart 0, Introduction. This lesson is a continuation of the previous lesson on the Materiel Solution Analysis (MSA) Phase and Milestone A. We will discuss the major activities that occur during Technology Development with emphasis on those activities the requirements manger (RM) is responsible for or should closely monitor.
Tom Fritz

1. Lesson Objectives
Determine the major requirements management activities during the acquisition process from Milestone A to Milestone B
Explain the purpose and major activities of the Technology Development phase and the links between those activities
Describe the decisions the Milestone Decision Authority (MDA) makes and the items the MDA approves at Milestone B

2. Milestone A to Milestone B Technology Development
Full Rate
Prod Decision
Review
Joint Concepts
Capabilities - Based Assessment
MS C
MS B
President
SECDEF
CJCS
CCMDs and other DoD
Components
Strategic Guidance
Incremental Development
MS A
Technology
Development
Engineering & Manufacturing Development
Production & Deployment
Materiel
Solution
Analysis
Technology Opportunities & Resources
ICD
O&S
User Needs
MDD
CDD
CPD
Post CDR Assessment
Pre-EMD Review
Draft
AoA review and Portfolio Assessment
AoA
report
PDR review

3. Milestone A to Milestone B Requirements Management Activities
Purpose: Reduce technology risk
Major activity: Competitive prototyping
Pre-EMD
B (paper) A
CDD
Draft
CDD
Contract (s)
Technology
Development
Contract (s)
Final RFP
Source(s) Selection
Final RFP or
SRR
SFR
PDR
PDR
Report
TRA
Requirements Management Activities
Participate in
IPTs and Technical Reviews (during Tech Dev DAG overall DAG )
MDA Reviews: Program, Pre-EMD, and Milestone
Monitor/provide input
Develop
Update draft CDD and submit to JCIDS to provide validated CDD for Pre-EMD.
Acquisition Strategy
Acquisition Program Baseline (APB)
Test & Evaluation Master Plan (TEMP)
Affordability Requirements & Cost Estimate
PPBE Process
Technology Readiness Assessment (TRA)
Life Cycle Sustainment Plan (LCSP)
AoA Update , RAM-C report update

4. Preliminary Design Review (PDR)
PDRs before Milestone B are mandatory for MDAPs.
PDR is a technical review to establish the allocated baseline and technical assessment confirming readiness to proceed into detailed design. It includes details to ensure all of the functional baseline is allocated to hardware and software items of the system configuration.
Do the allocated and functional baselines add up to the needed operational capability?
Will the TD phase demonstrate an ability to be operational effective and suitable?
“A successful PDR will inform requirements trades; improve cost estimation; and identify remaining design, integration, and manufacturing risks. The PDR shall be conducted at the system level and include user representatives and associated certification authorities. The PDR Report shall be provided to the MDA at Milestone B and include recommended requirements trades based upon an assessment of cost, schedule, and performance risk.” (DoDI )

5. Pre-EMD Review
Pre-EMD Review is directed by AT&L Memo, Subject: Improving Milestone Process Effectiveness June 23, 2011.
Validated CDD supports Pre-EMD review
Purpose is to authorize release of final RFPs that include detailed planning documents for higher quality and less disruptive source selection for EMD contract.
MS B can focus on changes that have occurred since Pre-EMD review – provides possibility for “paper DAB” for MS B

6. Technology Readiness Assessment (TRA)
TRA is a systematic, metrics based process that assesses maturity of, and risk associated with Critical technologies to be used in an MDAP
TRA plan prepared by PM; approved by PEO, CAE and ASD(R&E).
Conducted by Subject Matter Experts independent of PMO, but assigned by PM.
Required for MDAPs for Sec. 2366b cert at Milestones B
TRA results are included in CDD/CPD
ASD(R&E) provides MDA an independent assessment and review of the TRA final report as to whether technology was demonstrated in relevant environment
Technology Readiness Levels (TRLs) are knowledge-based standard but not a substitute for professional judgment
A TRA focuses on the program’s “critical” technologies (i.e., those that may pose major technological risk during development, …). Page 1-1 , TRA Guidance, April 2011, ASD(R&E)

7. Technology Maturity Technology Readiness Levels (TRL)
System Test, Launch & Operations
System/Subsystem Development
Technology Demonstration
Technology Development
Research to Prove Feasibility
Basic Technology Research
TRL 9
TRL 8
TRL 7
TRL 6
TRL 5
TRL 4
TRL 3
TRL 2
TRL 1
Actual system proven through successful mission operations
Actual system completed and qualified through test and demonstration (Full-Rate Production Decision)
System prototype demonstration in a operational environment (Milestone C)
System/subsystem model or prototype demonstration in a “relevant environment” (2366b certification item - Milestone B)
Component and/or breadboard validation in relevant environment
Component and/or breadboard validation in laboratory environment
Analytical and experimental critical function and/or characteristic proof-of-concept
Technology concept and/or application formulated
Basic principles observed and reported
Current update: TRA Link
Public law requires MDAPs be at TRL 6 for Milestone B

8. Milestone B
“MS B is expected to focus on changes that have occurred since the Pre-EMD Review as a result of source selection or other program events. If there have been no substantive changes since the Pre-EMD Review then a "paper DAB" should be sufficient.” AT&L June 23, 2011
MDA approves: (DAG Encl 2—6, EMD Phase)
Program Initiation (for most programs)
LRIP quantities
Exit criteria for next phase
Entry into Engineering and Manufacturing Development (EMD)
Type of Contract
Milestone B Certification
Acquisition Strategy
The ADM that captures all of these
APB (includes affordability and verbatim of KPPs)
Requires Approved CDD (to include ICD elements if ICD waived), and
Full Funding in the Future Years Defense Program (FYDP)

9. ACAT I Program Certification for MS B WSARA 2009 & NDAA 2012 Changes
MEMORANDUM FOR THE RECORD
SUBJECT: Milestone B Program Certification
As required by Section 2366b of Title 10, United States Code,
(1) I have received a business case analysis for the (name of program) and certify on the basis of the analysis that:
(A) the program is affordable when considering the ability of the Department of Defense to accomplish the program's mission using alternative systems;
(B) appropriate trade-offs among cost, schedule, and performance objectives have been made to ensure that the program is affordable when considering the per unit cost and the total acquisition cost in the context of the total resources available during the period covered by the future-years defense program submitted during the fiscal year in which the certification is made;
(C) reasonable cost and schedule estimates have been developed to execute, with the concurrence of the Director of Cost Assessment and Program Evaluation, the product development and production plan under the program;
(D) funding is available to execute the product development and production plan under the program, through the period covered by the future-years defense program submitted during the fiscal year in which the certification is made, consistent with the estimates described in paragraph (C) for the program; and
(2) I have received the results of the preliminary design review and conducted a formal post- preliminary design review assessment, and certify on the basis of such assessment that the program demonstrates a high likelihood of accomplishing its intended mission; and
Note: WSARA Changes highlighted in bold red (no NDAA 2012 changes to para. (1) and (2))

10. Program Certification for MS B continued
Program Certification for MS B continued.. WSARA 2009 & NDAA 2012 Changes
(3) I further certify that:
(A) appropriate market research has been conducted prior to technology development to reduce duplication of existing technology and products;
(B) the Depart of Defense has completed an analysis of alternatives with respect to the program;
(C) the Joint Requirements Oversight Council has accomplished its duties with respect to the program pursuant to section 181(b) of Title 10, including an analysis of the operational requirements for the program;
(D) the technology in the program has been demonstrated in a relevant environment, as determined by the Milestone Decision Authority on the basis of an independent review and assessment by the Director of Defense Research and Engineering; and
(E) life-cycle sustainment planning, including corrosion prevention and mitigation planning, has identified and evaluated relevant sustainment costs throughout development, production, operation, sustainment, and disposal of the program, and any alternatives, and that such costs are reasonable and have been accurately estimated;
(F) an estimate has been made of the requirements for core depot-level maintenance and repair capabilities, as well as the associated logistics capabilities and the associated sustaining workloads required to support such requirements; and
(G) the program complies with all relevant policies, regulations, and directives of the Department of Defense.
GAO , Dec 14, 2012
WSARA Changes highlighted in bold red; NDAA 2012 changes in bold blue italics

11. Configuration Steering Boards
Linkage: CDD, APB, TEMP & Contract for Engineering and Manufacturing Development (EMD)
Milestone A
Milestone B
Pre-EMD
Review
Cost Estimate & $$
Competitive
Designs &
Prototypes DT
PDR
TEMP
COIs, MOEs,
MOPs, CTPs or
KPPs
KSAs
Draft
CDD
Contract
AoA
Update
KPPs
KSAs
Validated
CDD
SPECs
“design-to”
Final RFP
MOEs
MOPs
APB
KPPs
KSAs
Final RFP
Source(s) Selection
EMD
Configuration Steering Boards
Technology Development Phase 11

12. BACK UP SLIDES and INFORMATION

13. Oversight & Review DAE CAE PEO IPT’s assist in oversight & review DAB
USD(AT&L)
Defense Acquisition Executive
Acquisition Category
DAE
Makes Decisions
Signs ADM
ACAT ID
DAB-Defense Acquisition Board
ITAB-Information Technology Acquisition Board
$365M RDT&E or
$2.19B Procurement
(FY2000 Constant $)
DAB
ITAB
ACAT IAM
$378M Life Cycle Cost or
$126M Total Prog. Cost or
$32M Prog. Cost
in any single year
(FY2000 Constant $)
OIPTs
Overarching IPT’s
(OIPT’s)
Issue resolution
Component Acquisition
Executive
(Asst Secretary)
ACAT IC/IAC
Configuration Steering Boards
Makes ACAT IC,
IAC & II Decisions
Signs ADM
CAE
ACAT II
Working-Level IPT’s
(WIPT’s)
$140M RDT&E or
$660M Procurement
(FY2000 Constant $)
Component HQ Review
Issue resolution
Program Level
IPT’s
Program Executive Officer
(General Officer/SES Civilian)
ACAT III
PEO
Makes ACAT III/IV
Decisions
Signs ADM
No Fiscal
Criteria
IPT’s assist in
oversight & review
Program Manager
(Col/LtCol/Civilian Equivalent)
ACAT IV PM
Navy
USMC
Note: Some PMs report directly to CAE.

14. IPTs and Technical Reviews for RMs, Drawn from DAG 4.5.9
Provided here so it is available to students as prelesson information

15. Diagram of Requirements flowdown to baselines
From DAG Figure F1. Depiction of a sample set of configuration baselines