1. Curriculum Review
LOG 103
Reliability, Availability & Maintainability (RAM) Presented to the Life Cycle Logistics (LCL) Functional Integrated Product Team (FIPT) Presented by Patrick M. Dallosta, CPL Performance Learning Director Defense Acquisition University

2. Agenda Key Personnel FY 13 LCL Certification Curriculum “Path Ahead”
LCL Competency – DAU Curriculum Crosswalk
Background
Current Status
Course Description
Course Content / TLOs & ELOs / Course Outline
MTM / Projected Throughput
PLD Assessment / Impact on Training
Questions & Answers

3. LOG 103 Key Personnel Course Manager (CM) Dr. Andre Murphy
Course Manager Regional Representatives (CMRR)
Capital and Northeast: John Sullivan
West: Andre Murphy
Midwest: Steve Putman
South: Bryan Hammond
Mid-Atlantic: Phil Littrell
GLTC Instructional Systems Specialist (ISS) Debra Moore
LCIC Performance Learning Director (PLD) Patrick Dallosta
LCIC Director for Logistics and Sustainment Bill Kobren

4. FY13 LCL Certification Curriculum
25 hrs, on-line
Level I Certification
ACQ 101
Fundamentals of Systems Acquisition Management
Knowledge based
GS 5-9 & E7-O3
26 hrs, on-line
30 hrs, on-line P
2 Continuous Learning Modules:
PBL & Designing for Supportability
LOG 103
Reliability, Availability & Maintainability
LOG 102
Systems Sustainment
Management
1-3 hrs ea, on-line
LOG 101
Acquisition Logistics
Fundamentals
28 hrs, on-line
Application/case based
GS 9-12 & E7-O4
Level II Certification
LOG 201
Intermediate Acquisition Logistics
35 hours, online
LOG 200
LOG 235
Performance Based Life Cycle Product Support
35 hours on-line
4.5 days classroom P
LOG 211
Supportability Analysis
ACQ 202
Intermediate
Systems
Acquisition
ACQ 203
LOG 206
Intermediate Systems Sustainment
40 hours, online
NOTE: There would still be NO prerequisites
for LOG235
xx hours on-line
Case/scenario based
GS & E7-O5
Level III
Certification P
LOG 350
Enterprise Life Cycle Logistics Management
LOG 340
Performance Based Life Cycle Sustainment
8.5 days classroom P P
Level I “Core Plus”
Courses & CL Modules
(See DAU catalog for details)
Level II “Core Plus”
Courses & CL Modules
(Includes LOG 204 CM Course
& new LOG 2xx Tech Data Mgt Course)
Level III “Core Plus”
Courses & CL Modules
(See DAU catalog for details)
New Cert Courses 4
P = Prerequisite

5. LCL Competency – DAU Curriculum Crosswalk
Course
LOG
101
102
103
200
201
204
206
211
LOG 215
235
236
340
350
Logistics Design Influence
Integrated Logistics Support (ILS) Planning
Product Support and Sustainment
Configuration Management
Reliability & Maintainability Analysis
Technical/Product Data Management
Supportability Analysis
Legend:
Principal course that addresses the competency Deployed course/significant upgrade in progress
Courses where the competency is a major learning point New course in development/planning

6. LOG 103 Competency Analysis
COMPETENCY/PROFICIENCY
1. Historic Roots
2. Acquisition Reform
3 .KPP/KSA
4. Legislation/Policy
5. Life Cycle Product Spt
6. Warfighter Capability
7. Op/Contract Rqmts
8. System Design Model
9. Design for Reliability,
10. Test & Evaluation
11. Manufacturing/
LOGISTICS DESIGN INFLUENCE (Note 1)
Use analysis tools and techniques to influence logistics design. *
Apply Logistics Design Influences to include RAM, CBM/RCM, Supportability.
Apply and relate diagnostics/prognostics and CBM to Design Influence.
Evaluate impacts on supportability based on changes in policy, procedures and tools.
Evaluate Performance Metrics and relate them to Design Influence.
Incorporate Reliability Centered Maintenance (RCM) into systems Design
Recognize shortfalls in program information and data
Perform data collection/analysis of failure data and supply rates
Recommend design changes to optimize sustainability/min Life cycle Cost/Footprint
Ensure design incorporates sustainment-related design criteria
Integrate supportability requirements into the systems engineering process
Develop and implement product support strategies
Assess the impact of design changes on supportability
Perform Maintenance Task Analysis, Level of Repair Analysis, Core Workload Assessment, Depot Source of Repair

7. LOG 103 Background
Recent Legislation/updated DoD Policy has significantly strengthened DOD Reliability, Availability and Maintainability (RAM) Policy, Systems Engineering/Reliability/Test & Evaluation processes and organizations.
Life Cycle Logistics DAWIA certification path reflects new course requirements in the area of RAM and Supportability
LOG 103, “Reliability, Availability and Maintainability”
Upgrading of existing LOG 203
LOG 211, “Supportability Analysis”
New curriculum development
Expect great cross-functional interest as RAM / Supportability is reconstituted in program offices – a “pendulum swing” back to government resulting from the aftermath of Acquisition Reform

8. LOG 103 Current Status
LOG Certification Course as of 1 October 2010 (FY 11)
Prerequisite – ACQ 101 Fundamentals of Sys Acq Mgt
Related Learning Assets:
CLL 008 – Designing for Supportability in DoD Weapon Systems
CLL 012 – Supportability Analysis
DAG Chapter 4, Systems Engineering / Chapter 5, Life Cycle Logistics
DL / 5 Sections / 300 students / 135 avg. /No Wait Listing
15% failure rate / GREEN MTMs
Instructor/Student Pilot 7-11 Mar 2011
Delivery/Migration to DAU ATLAS 24 Mar 2011

9. LOG 103 Course Description
“Professionals who take this course will be able to understand the relationship between reliability, availability and maintainability (RAM) as a critical factor in design, performance, cost, and sustainment.
The course addresses the cross-disciplinary actions of Program Management, Systems Engineering, Test & Evaluation and both Acquisition and Sustainment Logistics to evaluate the impact of reliability and maintainability decisions.
Stressing a conceptual approach, the course presents basic reliability, availability and maintainability terminology and engineering practices.
It discusses current legislative and DoD policy that have invigorated systems engineering and logistics engineering processes to improve the requirements process, minimize risk through reliability growth programs and ensure effectiveness and suitability through developmental and operational test and evaluation.”

10. LOG 103 Course “Take-Aways”
Relationship between Logistics and RAM
Impact of RAM on system design and product support
RAM activities within JCIDS / Systems Engineering / Test & Evaluation and Sustainment processes
RAM concepts, terminology, engineering practices and mathematical calculations
Legislation/OSD policy/Sustainment governance
Historical roots of RAM
Apply DAU Learning Assets to establish a collaborative environment and facilitate insight into current events. 10

11. LOG 103 Lessons
New Lesson
Current Lesson
Historical Roots of Reliability, Availability & Maintainability
Impact of Acquisition Reform on Reliability, Availability & Maintainability
Origins of the Mandatory Sustainment Metrics KPP/KSAs
Impact of Legislation/ DoD Policy on RAM Initiatives
RAM as a Key Element of Life-Cycle Performance-Based Product Support
Impacts of RAM on Warfighter Capability
Operational and Contractual RAM Requirements
The Affordable Systems Operational Effectiveness Model (ASOE)
Providing Insight Into Designing for RAM
Risk Reduction Through Test and Evaluation
Impacts of RAM on Manufacturing 11

12. LOG 103 TLO/ELO - 1
Lesson 1: Historical Roots of Reliability, Availability, and Maintainability (RAM)
TLO: Recognize historical roots of reliability, availability, and maintainability (RAM)
ELOs:
Identify significant events that transformed and improved reliability.
Indicate documentation used to write current RAM policy.
Identify how RAM impacts sustainment and cost.
Identify how developmental test and evaluation aids RAM achievement.
Indicate the role of RAM in the systems engineering process.
Identify how RAM aids supportability and impacts logistics.
Recognize how operational test and evaluation aids weapon system effectiveness and suitability.

13. LOG 103 TLO/ELO - 2
Lesson 2: The Impact of Acquisition Reform on Reliability, Availability, and Maintainability (RAM)
TLO: Recognize the impact of acquisition reform on Reliability, Availability, and Maintainability (RAM).
 ELOs:
Recall the scope and impact of the “Perry Memorandum”.
Indicate how the discontinuance of military standards and specifications impacted RAM.
Identify how the loss of workforce and skilled personnel impacted RAM.
Recognize how the use of commercial-off-the-shelf items impacted RAM.
Indicate how poor RAM design and performance decreased effectiveness and suitability, as identified during OT&E.
Identify how RAM and supportability affect early systems engineering activities and sustainment planning.

14. LOG 103 TLO/ELO - 3
Lesson 3: Mandatory Sustainment Availability Key Performance Parameter (KPP) and Supporting Key System Attributes (KSA) of Materiel Reliability and Ownership Costs
TLO: Recognize how the availability KPP and the material reliability and ownership costs KSAs strengthen Reliability, Availability, and Maintainability (RAM).
 ELOs:
Identify the origin of the availability KPP, the material reliability KSA, and the ownership cost KSA.
Identify the impact of the availability KPP/KSA on the Joint Capabilities Integration and Development System (JCIDS) process.
Indicate the role of the combat developer in the refinement of the KPP/KSAs within the JCIDS process.
Recall how the Reliability, Availability, Maintainability – Cost Rationale Report Handbook is used to calculate the availability KPP and its KSAs.
Recognize the use of enabling technologies in meeting availability KPP/KSA requirements.

15. LOG 103 TLO/ELO - 4
Lesson 4: The impact of legislation and DoD policy on RAM.
TLO: Recognize the impact of legislation and DoD policy on RAM.
ELOs:
Identify the impacts of defense policy on RAM, per the GAO report.
Identify the impact of the DOT&E 2007 Report on RAM.
Identify the impact of the Defense Science Board Task Force on DOT&E on RAM.
Identify the impact of the Reliability Improvement Working Group (RIWG) on RAM.
Indicate the impact of the 2008 AT&L Memorandum on RAM.
Indicate the impact of DoDI on RAM.
Indicate the impact of the Weapons System Acquisition Reform Act on RAM.
Indicate the impact of the Weapon System Acquisition Reform Product Support Assessment Report of November 2009 on RAM.
Recognize the changes to the Defense Acquisition Guidebook (DAG) as a result of legislation and acquisition policy changes.
Recall how changes in the JCIDS process improved RAM requirements.
Identify how reliability growth programs have been implemented.
Recall how integrating Developmental and Operational Testing strengthen RAM.

16. LOG 103 TLO/ELO - 5
Lesson 5: RAM as a Key Element of Life Cycle Performance-Based Product Support
TLO: Recognize how RAM is a key element of Life Cycle Performance-Based Product Support.
 ELOs:
Identify the key elements of availability.
Identify the four key elements in the definition of reliability.
Indicate two key MTBxs that are logistics reliability parameters.
Identify the key elements of maintainability.
Recognize how RAM affects support costs.
Recognize how Availability KPP/KSA trade spaces are balanced.
Recall how RAM is a key driver in the development of a Performance-Based Product Support Strategy.
Recall how RAM is a key driver in demand forecasting, spares planning, provisioning, and supply support.
Recall how RAM is a key driver of Total Ownership Costs.
Recall how RAM is a key driver of Sustainment Maturity Levels.

17. LOG 103 TLO/ELO - 6 Lesson 6: Impacts of RAM on Warfighter Capability
TLO: Given a scenario, recognize how RAM impacts Warfighter Capability
ELOs:
Identify User RAM requirements
Recall how the Joint Capabilities Integration and Development System (JCIDS) Process works
List the measures of combat capability that are enhanced by RAM
 Note changes

18. LOG 103 TLO/ELO - 7
Lesson 7: Operational and Contractual RAM Requirements
TLO: Describe how contractual requirements are developed from Operational Requirements for a new development systems and one using COTS/NDI items.
ELOs:
State the methods for converting operational RAM requirements into contractual RAM requirements.
List the differences between field reliability data and contractual reliability data.
Distinguish between Mean Time Between Failure (MTBF) and Mean Time Between Maintenance (MTBM).
Define Commercial and Nondevelopmental items.
List the methods for assessing the RAM of Commercial and Nondevelopmental Items.
List the methods for ensuring the RAM of Commercial and Nondevelopmental Items.

19. LOG 103 TLO/ELO - 8
Lesson 8: The Affordable Systems Operational Effectiveness (ASOE) Model
TLO: Explain how the Affordable Systems Operational Effectiveness (ASOE) Model is used to enhance system design for supportability.
ELOs:
Explain how the ASOE model is used
Identify the ASOE domains
Explain the Supportability Analysis process
Summarize how the ASOE outputs impact on performance, RAM, and sustainment characteristics in the final system design

20. LOG 103 TLO/ELO - 9 Lesson 9: Providing Insight into Designing for RAM
TLO: Given a scenario, describe how the process inputs and expected outcomes of the System Engineering Process supports RAM requirements.
ELOs:
State Design Interface concepts
Identify the Supportability elements
State the Reliability Availability & Maintainability trade space considerations
State the analytic methodologies and tools used in the design process
Identify the design-supportability analyses processes
State the relationships between Mission reliability and logistics reliability
Identify the process for Reliability Centered Maintenance (RCM)
Identify the process for Condition Based Maintenance Plus (CBM+)
State how the Diagnostics, Prognostics and Health Management of the system are related

21. LOG 103 TLO/ELO – 9 (Continued)
Lesson 9: Providing Insight into Designing for RAM
TLO: Given a scenario, describe how the process inputs and expected outcomes of the System Engineering Process supports RAM requirements.
ELOs:
Identify the reason that failure rates are easier to deal with than MTBFs
Identify the aim of FMECA
List three purposes for reliability predictions
Distinguish between maintenance and maintainability
List the types of diagnostic errors and their associated effects
Recognize the benefit of vertical testability
Distinguish among mean down time, mean active maintenance time, and mean time to repair
Describe why the maintainability of a system depends on the reliability and maintainability of its subsystems

22. LOG 103 TLO/ELO - 10
Lesson 10: Risk Reduction Through Test and Evaluation
TLO: Recognize how Test and Evaluation activities contribute to achievement of the RAM requirements.
ELOs:
State the benefits of utilizing Developmental and Operational Test and Evaluation (D/OT&E).
Define the purpose of the Test & Evaluation Master Plan (TEMP)
List the requirements of the Reliability Management program
Name the requirements of the Reliability Growth Test program
Identify how the DT&E Test-Analyze-Fix process contribute to reliability growth
State the benefits of the Operational Test and Evaluation program in evaluating military capability
Identify the risks in making early decisions
Identify industry and government best practices in the Test and Evaluation program
Recognize the importance of a contractual definition of failure 
 Restored per discussion re Lesson 7.

23. LOG 103 TLO/ELO - 11
Lesson 11: The Impact of Manufacturing Process Anomalies on RAM
TLO: Recognize the impact of manufacturing process anomalies on system RAM performance.
ELOs:
Recognize how stated RAM requirements drive the level of quality in the manufacturing processes.[DAU1] 
Identify the Impact of latent defects on performance and logistics
Identify how the process of the analysis of field data is used to in determine the root causes of defects
State how latent defect issues are identified from field failure data
Identify the techniques used to eliminate latent manufacturing process defects

24. LOG 103 Metrics That Matter (MTM)
Question/ Categories
FY10
FY11*
Courseware
n=499
n=721
Online Delivery
n=500
n=719
Learning Effectiveness
n=495
N=714
Job Impact
n=722
5.98
5.86
6.07
5.67
5.89
5.80
5.74
5.96
* Data (from Data Mart) as of 31 Dec 2010 24

25. LOG 103 Projected Throughput
FY 10*
FY 11**
FY 11***
Graduates
1,688
1,847
7,392
FY 09
LOG 203
COMPARISION
1,140
Army
512
821
3,284
Air Force
421
376
1,508
DoN
327
369
1,476
Industry
367
194
776
Other DoD 46 76
304
All Others 15 11 44
* Period of Mar 15 – Sep ** Period of Oct 1 – Dec *** FY 11 Projection 25

26. LOG 103 PLD Assessment
Challenges students with minimal math and engineering skills.
Expands students’ knowledge beyond the ‘traditional logistics’ perspective.
Consistent statements
“…glad I took this course.’
“…never really understood what RAM was before.”
“…it was difficult, but I really learned a lot.”
“…really had to think about the answers.”
“…I’m glad I passed.”

27. LOG 103 Impact on Training
Directly addresses critical LCL RAM Competency and Curriculum needs
Weapons Systems Acquisition Reform Act (WSARA)
DoD
OSD Memorandum /DOT&E Memorandum
Provides basic instruction in new area for students
Availability KPP/KSAs
RAM metrics / Sustainment governance
Systems Engineering – Reliability Growth – T&E processes
Sustainment governance/metrics
Cross-DAWIA Career Field training will promote communications between PM, SPRDE, T&E and LCL

28. Questions & Answers LOG 103 Curriculum Review Thank You
for the Opportunity to Serve the
Life Cycle Logistics (LCL)
Functional Integrated Product Team (FIPT) 27

29. Back-up 29

30. LOG 103 Course Outline
Lesson 1: Introduction to LOG 203 Reliability, Availability and Maintainability (RAM)
Identify the role of LOG 103 within the LCL and other DAWIA Certification Paths
Identify the relationships between LOG 103 and other certification courses
Identify the role of Reliability, Availability and Maintainability(RAM)as a key part of the systems engineering process
Identify the role of Reliability, Availability and Maintainability(RAM) in minimizing the need for logistics
Lesson 2: Historical Roots of Reliability, Availability and Maintainability (RAM)
Recognize Early Commercial/DoD Reliability Analyses, Tools and Outcomes
Recognize development and use of DoD Reliability, Availability and Maintainability processes, specifications and documentation
Recognize the impact of RAM on DoD Systems performance, sustainment and costs
Lesson 3: The Impact of Acquisition Reform on Reliability, Availability and Maintainability
Discuss the scope and impact of the Perry Memorandum
Discuss the Loss of workforce and skilled RAM personnel
Discuss the Discontinuance of Military Standards and Specifications and its impact
Discuss the Impact of the use of Commercial-Off-The-Shelf on system reliability and performance
Discuss the decrease in effectiveness and suitability as determined by operational Test and Evaluation
Lesson 4: Mandatory Sustainment Materiel Availability Key Performance Parameter and Supporting Key System Attributes of Materiel Reliability and Ownership costs
Discuss the origins of the Material Availability KPP, the Material Reliability KSA and the Ownership Cost KSA
Identify the impact of the KPP/KSA on the requirements management process
Discuss the development of the KPP/KSAs within the JCIDS process
Discuss the enablers to materiel readiness that impact RAM, e.g., RCM, CBM, diagnostics/prognostics
Lesson 5: Impact of Legislation and DoD Policy on Reliability, Availability and Maintainability
Discuss USD(AT&L) RAM Policy Memorandum of July 08 and its impact on systems engineering, reliability/logistics and test & evaluation, with emphasis on reliability growth programs
Discuss impact of the Weapons System Acquisition Reform Act of 2009 and updates to DoDI on the Defense Acquisition Management System, systems engineering processes, sustainment and governance
Lesson 6/1: Impacts of RAM on Logistics
Recognize how RAM affects support costs
Recognize how RAM affects Total Ownership Costs
List 4 key elements in the definition of reliability
List 2 MTB_s that are logistics reliability parameters
Discuss the definitions of availability
Lesson 7/2: Impacts of RAM on Missions
Distinguish between latent failures, random failures and wear out
Identify 3 measures of combat capability that are enhanced by RAM
Distinguish between reliability and maintainability 30

31. LOG 103 Course Outline (Continued)
Lesson 8/3: Operational & Contractual RAM Requirements
List 3 methods for converting operational RAM requirements into contractual RAM requirements
List 3 approaches for assessing RAM of Commercial and Non-Developmental Items
Lesson 7: The Systems Design and Operational Effectiveness (SDOE) Model
Discuss the SDOE model and domains
Discuss specific SDOE engineering outputs and their impact on performance, RAM, and sustainment
Lesson 8/4: Providing Insight into Designing for RAM
Discuss the concept of design interface
Discuss the elements of supportability
Discuss specific Reliability Availability & Maintainability trade space considerations
Discuss common methodologies and analytic tools
Identify the specific analyses to be conducts, e.g., block diagram development, allocation and prediction, failure modes and effects analysis, maintenance task analysis
Identify the reason that failure rates are easier to deal with than MTBFs
Distinguish between mission reliability and logistics reliability
Identify the aim of Reliability Centered Maintenance
Identify the aim of Condition Based Maintenance
Identify the aim of diagnostics and prognostics
Lesson 9/5: RAM Growth Programs and Risk Reduction
Discuss requirements for reliability management programs
Discuss requirements for reliability growth test programs
Discuss best practices
Recognize the Test-Analyze-and Fix process of achieving reliability growth
Recognize the concept of decision risk
Lesson 10/6: Impacts of RAM on Manufacturing
Identify the effect that latent defects can have on missions and logistics
How to recognize a manufacturing defect from field data
3 lines of defense to keep manufacturing from producing latent defects
Lesson 6/3: Operational & Contractual RAM Requirements
List 3 methods for converting operational RAM requirements into contractual RAM requirements
List 3 approaches for assessing RAM of Commercial and Non-Developmental Items
Lesson 7/4: Providing Insight into Designing for Reliability
Identify the reason that failure rates are easier to deal with than MTBFs
Distinguish between mission reliability and logistics reliability
Identify the aim of Reliability Centered Maintenance Analysis
Identify the aim of Condition Based Maintenance
Identify the aim of diagnostics and prognostics
in reliability qualification test (RQT)
Lesson 9/6: Impacts of RAM on Manufacturing
Identify the effect that latent defects can have on missions and logistics
How to recognize a manufacturing defect from field data
3 lines of defense to keep manufacturing from producing latent defects 31