0. Milestone A to Milestone B Requirements Management Activities
Tom Fritz

1. Lesson Objectives
Determine the major requirements management activities during the acquisition process from Milestone A to Milestone B
Explain the purpose and major activities of the Technology Development phase and the links between those activities
Describe the decisions the Milestone Decision Authority (MDA) makes and the items the MDA approves at Milestone B

2. Milestone A to Milestone B Technology Development
Full Rate
Prod Decision
Review
Joint Concepts
Capabilities - Based Assessment
MS C
MS B
President
SECDEF
CJCS
CCMDs and other DoD
Components
Strategic Guidance
Incremental Development
MS A
Technology
Development
Engineering & Manufacturing Development
Production & Deployment
Materiel
Solution
Analysis
Technology Opportunities & Resources
ICD
O&S
User Needs
MDD
CDD
CPD
Post CDR Assessment
Pre-EMD Review
Draft
AoA review and Portfolio Assessment
AoA
report
PDR review

3. Milestone A to Milestone B Requirements Management Activities
Purpose: Reduce technology risk
Major activity: Competitive prototyping
B (via staffing
If no sgnft chngs)
Pre-EMD A
Validated
CDD
Draft*
CDD
Contract (s)
Technology
Development
Final RFP
EMD Phase
Source(s) Selection
Final RFP
TD Phase
Contract (s) or
SRR
SFR
TRA
PDR and
Report
*Draft CDD is sponsor approved but not reviewed in JCIDS
Requirements Management Activities
Participate in
IPTs and Technical Reviews (during Tech Dev DAG overall DAG )
MDA Reviews: Program, Pre-EMD, and Milestone
Monitor/provide input
Develop
Update draft CDD and submit to JCIDS to provide validated CDD for Pre-EMD.
Acquisition Strategy
Acquisition Program Baseline (APB)
Test & Evaluation Master Plan (TEMP)
Affordability Requirements & Cost Estimate
PPBE Process
Technology Readiness Assessment (TRA)
Life Cycle Sustainment Plan (LCSP)
AoA Update , RAM-C report update

4. Preliminary Design Review (PDR)
PDRs before Milestone B are mandatory for MDAPs.
PDR is a technical review that provides the acquisition community, end user, and other stakeholders with an opportunity to understand the trade studies conducted during the preliminary design, and thus confirm that design decisions are consistent with the user’s performance and schedule needs prior to formal validation of the CDD.
“A successful PDR will inform requirements trades; improve cost estimation; and identify remaining design, integration, and manufacturing risks. The PDR shall be conducted at the system level and include user representatives and associated certification authorities. The PDR Report shall be provided to the MDA at Milestone B and include recommended requirements trades based upon an assessment of cost, schedule, and performance risk.” (DoDI )

5. Pre-EMD Review
Pre-EMD Review is directed by AT&L Memo, Subject: Improving Milestone Process Effectiveness June 23, 2011.
Validated CDD supports Pre-EMD review
Purpose is to authorize release of final RFPs that include detailed planning documents for higher quality and less disruptive source selection for EMD contract.
MS B can focus on changes that have occurred since Pre-EMD review – provides possibility for “paper DAB” for MS B

6. Technology Readiness Assessment (TRA)
TRA is a systematic, metrics based process that assesses maturity of, and risk associated with Critical technologies to be used in an MDAP
TRA plan prepared by PM; approved by PEO, CAE and ASD(R&E).
Conducted by Subject Matter Experts independent of PMO, but assigned by PM.
Required for MDAPs for Sec. 2366b cert at Milestones B
TRA results are included in CDD/CPD
ASD(R&E) provides MDA an independent assessment and review of the TRA final report as to whether technology was demonstrated in relevant environment
Technology Readiness Levels (TRLs) are knowledge-based standard but not a substitute for professional judgment
A TRA focuses on the program’s “critical” technologies (i.e., those that may pose major technological risk during development, …). Page 1-1 , TRA Guidance, April 2011, ASD(R&E)

7. Technology Maturity Technology Readiness Levels (TRL)
System Test, Launch & Operations
System/Subsystem Development
Technology Demonstration
Technology Development
Research to Prove Feasibility
Basic Technology Research
TRL 9
TRL 8
TRL 7
TRL 6
TRL 5
TRL 4
TRL 3
TRL 2
TRL 1
Actual system proven through successful mission operations
Actual system completed and qualified through test and demonstration (Full-Rate Production Decision)
System prototype demonstration in a operational environment (Milestone C)
System/subsystem model or prototype demonstration in a “relevant environment” (2366b certification item - Milestone B)
Component and/or breadboard validation in relevant environment
Component and/or breadboard validation in laboratory environment
Analytical and experimental critical function and/or characteristic proof-of-concept
Technology concept and/or application formulated
Basic principles observed and reported
Current update: TRA Link
Public law requires MDAPs be at TRL 6 for Milestone B

8. Milestone B
“MS B is expected to focus on changes that have occurred since the Pre-EMD Review as a result of source selection or other program events. If there have been no substantive changes since the Pre-EMD Review then a "paper DAB" should be sufficient.” AT&L June 23, 2011
MDA approves: ( Link DoD Encl 2—6, EMD Phase)
Program Initiation (for most programs)
LRIP quantities (details – in MS B to IOC lesson)
Entry into Engineering and Manufacturing Development (EMD)
Exit criteria for next phase
Type of Contract
Milestone B Certification
Acquisition Strategy
The ADM that captures all of these
APB (includes affordability and verbatim of KPPs)
Requires Validated CDD (to include ICD elements if ICD waived), and
Full Funding in the Future Years Defense Program (FYDP)

9. ACAT I Program Certification for MS B WSARA 2009 & NDAA 2012 Changes
MEMORANDUM FOR THE RECORD
SUBJECT: Milestone B Program Certification
As required by Section 2366b of Title 10, United States Code,
(1) I have received a business case analysis for the (name of program) and certify on the basis of the analysis that:
(A) the program is affordable when considering the ability of the Department of Defense to accomplish the program's mission using alternative systems;
(B) appropriate trade-offs among cost, schedule, and performance objectives have been made to ensure that the program is affordable when considering the per unit cost and the total acquisition cost in the context of the total resources available during the period covered by the future-years defense program submitted during the fiscal year in which the certification is made;
(C) reasonable cost and schedule estimates have been developed to execute, with the concurrence of the Director of Cost Assessment and Program Evaluation, the product development and production plan under the program;
(D) funding is available to execute the product development and production plan under the program, through the period covered by the future-years defense program submitted during the fiscal year in which the certification is made, consistent with the estimates described in paragraph (C) for the program; and
(2) I have received the results of the preliminary design review and conducted a formal post- preliminary design review assessment, and certify on the basis of such assessment that the program demonstrates a high likelihood of accomplishing its intended mission; and
Note: WSARA Changes highlighted in bold red (no NDAA 2012 changes to para. (1) and (2))

10. Program Certification for MS B continued
Program Certification for MS B continued.. WSARA 2009 & NDAA 2012 Changes
(3) I further certify that:
(A) appropriate market research has been conducted prior to technology development to reduce duplication of existing technology and products;
(B) the Depart of Defense has completed an analysis of alternatives with respect to the program;
(C) the Joint Requirements Oversight Council has accomplished its duties with respect to the program pursuant to section 181(b) of Title 10, including an analysis of the operational requirements for the program;
(D) the technology in the program has been demonstrated in a relevant environment, as determined by the Milestone Decision Authority on the basis of an independent review and assessment by the Director of Defense Research and Engineering; and
(E) life-cycle sustainment planning, including corrosion prevention and mitigation planning, has identified and evaluated relevant sustainment costs throughout development, production, operation, sustainment, and disposal of the program, and any alternatives, and that such costs are reasonable and have been accurately estimated;
(F) an estimate has been made of the requirements for core depot-level maintenance and repair capabilities, as well as the associated logistics capabilities and the associated sustaining workloads required to support such requirements; and
(G) the program complies with all relevant policies, regulations, and directives of the Department of Defense.
GAO , Dec 14, 2012
WSARA Changes highlighted in bold red; NDAA 2012 changes in bold blue italics

11. Configuration Steering Boards
Linkage: CDD, APB, TEMP & Contract for Engineering and Manufacturing Development (EMD)
Milestone A
Milestone B
Pre-EMD
Review
(via staffing
If no sgnft chngs)
Cost Estimate & $$
Competitive
Designs &
Prototypes DT
PDR
TEMP
COIs, MOEs,
MOPs, CTPs or
Draft*
CDD TD
Contract(s)
EMD
Contract(s)
AoA
Update
Validated
CDD
SPECs
“design-to”
KPPs
KSAs
Final
RFP TD
MOEs
MOPs
APB
KPPs
Final
RFP
EMD
Source Selection
Source Selection
KPPs
KSAs
Configuration Steering Boards
Technology Development Phase
*CDD is sponsor approved but not submitted for JCIDS staffing within KM/DS 11

12. BACK UP SLIDES and INFORMATION

13. Oversight & Review DAE CAE PEO IPT’s assist in oversight & review DAB
USD(AT&L)
Defense Acquisition Executive
Acquisition Category
DAE
Makes Decisions
Signs ADM
ACAT ID
DAB-Defense Acquisition Board
ITAB-Information Technology Acquisition Board
$365M RDT&E or
$2.19B Procurement
(FY2000 Constant $)
DAB
ITAB
ACAT IAM
$378M Life Cycle Cost or
$126M Total Prog. Cost or
$32M Prog. Cost
in any single year
(FY2000 Constant $)
OIPTs
Overarching IPT’s
(OIPT’s)
Issue resolution
Component Acquisition
Executive
(Asst Secretary)
ACAT IC/IAC
Configuration Steering Boards
Makes ACAT IC,
IAC & II Decisions
Signs ADM
CAE
ACAT II
Working-Level IPT’s
(WIPT’s)
$140M RDT&E or
$660M Procurement
(FY2000 Constant $)
Component HQ Review
Issue resolution
Program Level
IPT’s
Program Executive Officer
(General Officer/SES Civilian)
ACAT III
PEO
Makes ACAT III/IV
Decisions
Signs ADM
No Fiscal
Criteria
IPT’s assist in
oversight & review
Program Manager
(Col/LtCol/Civilian Equivalent)
ACAT IV PM
Navy
USMC
Note: Some PMs report directly to CAE.

14. Technical Reviews for RMs, Drawn from DAG 4.2.8 thru 4.2.17