1. Module 5 Introduction to Verification
CMQ101 - Course Introduction
9/16/2018
Module 5 Introduction to Verification
Last revision 2/1/2018

2. Module Terminal Learning Objective (TLO)
Given an Engineering Change Proposal (ECP) packet and supporting documentation, analyze the ECP attributes to identify the proper verification elements and DCMA’s role in determining that verification.

3. Enabling Learning Objectives (ELOs)
Recall the verification process for ECPs, including DCMA’s role in determining that verification.
Discuss the verification process for Engineering Change Proposals (ECPs) and DCMA’s role in determining that verification.
Given an Engineering Change Proposal (ECP) packet and supporting documentation, analyze the ECP attributes to identify the proper verification elements and DCMA’s role in determining that verification

4. Enabling Learning Objectives (ELOs), Cont.
Given an Engineering Change Proposal (ECP) scenario, discuss the necessity of proper classification.

5. Module Topics ECP verification process ECP change document status
Configuration verification actions
Class I and Class II ECP verification
Verify and evaluate activity

6. What’s In It For Me? (WIIFM)
What do you know about the verification process?
What do you want to know about DCMA’s role in the process?
What do you want to learn?

7. CME204 Engineering Change Proposal Review
Pre-inspection Verification

8. DCMA-INST 217
DCMA Engineers shall perform all CCM document verification and validation procedures in accordance with Appendix C.

9. DCMA-INST 217 Appendix C, Verification Elements
C3.1 Implementation
C3.2 Completeness
C3.3 Coordination
C3.4 Content

10. Verification Element: C3.1 - Implementation
Confirms the document evaluated is a VALID Configuration Control document
Confirms the document is ready for Configuration Approval Authority (CAA) evaluation

11. Knowledge Review
What does a Pre-inspection verification (implementation) confirm? (Select all that apply.)
That the proposed change has been implemented in the configuration item
Confirms the document evaluated is a VALID Configuration Control document
Confirms the document is ready for Configuration Approval Authority (CAA) evaluation

12. Verification Element: C3.2 - Completeness
Ensure ECP meets contract CDRL and DID requirements
Check for missing or incorrect information
Necessity
Proper classification

13. Completeness: Proper Format (C3.2.1.1)
ECP format and structure is defined by the contract’s DID listed in the CDRL.
DID usually states the ECP can be in the supplier’s format but must contain the same data elements of the Government’s DD Forms listed:
DD Form 1692 “Engineering Change Proposal (ECP)”
DD Form 2617 “Engineering Release Record (ERR)”
DD Form 1695 “Notice of Revision (NOR)”
DD Form 1696 “Specification Change Notice (SCN)”

14. Completeness: Missing or Incorrect Information (C3.2.1.3)
Identify missing or incorrect information in ECP data fields
For example, N/A for empty data fields

15. Completeness: Necessity (C3.2.1.2, C3.4.1.1)
Ask yourself:
Is the ECP necessary?
Has the supplier clearly identified the need for ECP?

16. Completeness: Necessity, Cont’d.
What makes an ECP Necessary?
Correct deficiencies or interface issues
Safety concerns
Significantly reduce manufacturing, operational or logistics support costs
Improve system performance or operational requirements
Prevent slippage in an approved production schedule
Resolve obsolescence issues
Serve as a Value Engineering Proposal

17. Completeness: Necessity – Example 1 (DD1692, p1)
ECP page 1 form box 9 Description of Change: Provide label plates to align with for the power connections on the junction converter and box 10 Need for Change: General Note 2 of drawing provides inconsistent guidance for AC and DC power cable harnesses. Installing label plates will provide real time instructions to the user of the converter. No effect on form, fit, function or interfaces.

18. Completeness: Necessity – Example 2 (DD1692, p1)
ECP Page 1 form box 9 Description of Change: Test and evaluation indicates MTBF hours for spindle and hub bolt have increased R&R rate. Inspection reveals scoring of shafts and discoloration due to heat and load requirements. Box 10 Need for Change: Replace wheel hardware with 316 Stainless steel hardware providing increased strength and toughness for operating conditions. No effect on form, fit, function, or interface. (Reference Paper 00041(
Replace wheel hardware with 316 Stainless steel hardware providing increased strength and toughness for operating conditions. No effect on form, fit, function, or interface. (Reference Paper 00041)
Test and evaluation indicates MTBF hours for spindle and hub bolt have increased R&R rate. Inspection reveals scoring of shafts and discoloration due to heat and load requirements.

19. Completeness: Proper Classification (C3.2.12)
Final check
Supplier’s ECP classification rules should match or be synonymous with the Government’s classification guidelines identified in MIL-HDBK-61A
Class I (Major)
VECP
Class II (Minor)

20. Knowledge Review
What does the completeness verification element check for in the ECP? (Select all that apply.)
Proper format and structure
The ECP is necessary
The proposed change has been implemented in the configuration item
Proper classification

21. Classification: Class I ECP
Change with significant impacts
Requires approval by Government CCB
Authorized through a contract modification

22. Classification: Class I ECP Criteria
MIL-HDBK-61A
EIA-649-B
EIA-649-1
A Class I ECP is required if the change affects any approved functional or Configuration Documentation (CD) impacting:
Form
Fit
Function
Interface Characteristics

23. Classification: Class I ECP Criteria, (DD1692, p3)
ECP Page 3 of the form a checklist for Class I ECP Criteria.

24. Classification: Class I ECP Criteria, (DD1692, p2)
ECP Page 2 form Effects on Functional/Allocated Configuration Documentation (For use if Block 17 is functional or allocated).

25. Classification: Class II ECP
Change that has little or no significant impact
Typically reviewed for concurrence in classification only by DCMA
Reviewed to ensure change doesn’t contain any Class I criteria

26. Which are Class I ECP criteria? (Select all that apply)
Knowledge Review
Which are Class I ECP criteria? (Select all that apply)
Form, Fit and/or Function
Interface Characteristics
Administrative Changes
Minor Change to configuration documentation

27. Verification Elements
C3.1 Implementation
C3.2 Completeness
C3.3 Coordination
C3.4 Content

28. Verification Element: C3.3 Coordination
Properly coordinated across supplier functional areas
Supplier department signatures complete and dated
ECP addressed in normal workflow process
Evidence of coordination may be contained within electronic CM or ERP systems or may be a hardcopy of signed review/coordination form
ECP workflow Supplier's CM plan or corporate procedures may define coordination and methods of documenting

29. Verification Element: Coordination Example
A completed example of a coordination addendum.

30. Knowledge Review
The coordination element verifies which of the following in the Engineering Change Proposal (ECP)? (Select all that apply.)
That the Government (Acquirer) will accept the ECP
Properly coordinated across supplier functional areas
Supplier department signatures are complete and dated
ECP addressed in workflow process

31. Verification Element: C3.4 Content
Technical adequacy
Effectivity
Producibility
Cost/savings impact
Schedule

32. Content: Technical Adequacy (C3.4.1.1-C3.4.1.3)
TDP contains all technical information required to justify CCB disposition
Includes effectivity data for selected Class I criteria
Proposed changes easier to understand with draft revisions included

33. Content: Effectivity (C3.4.1.4)
Urgency
Inventory
Configuration
Lead time
Timing

34. Content: Producibility (C3.4.1.7)
The following are risk factors that should be considered when a supplier justifies a change under the auspices of "producibility“
New or unproven manufacturing process
Unknown or optimistic process yields
Labor intensive manufacturing
Excessive learning curve, need for highly skilled workforce
Excessive scrap and rework
Delays caused by long lead items

35. Content: Cost/Savings Impact (C3.4.3)
Production
Retrofit
Integrated product support
Other

36. Content: Cost/Savings Impact, (DD1692, p4)
ECP Page 4 of the form Estimated Net Cost of Impact with red boxes around integrated product support costs and retrofit.

37. Content: Cost/Savings Impact, (DD1692, p4 cont.)
ECP Page 4 of the form Estimated Net Cost of Impact with red boxes around integrated product support costs and retrofit.
Page 4 continued

38. Content: Cost/Savings Impact, (DD1692, p5)
ECP Page 5 form Cost/Savings Summary Related ECP blank form.

39. Content: Cost/Savings Impact, (DD1692, p5 cont.)
Page 5 continued
ECP Page 5 form Cost/Savings Summary Related ECP blank form.

40. Knowledge Review
Which elements should the ECP include (in sufficient detail) for the CCB to make an informed decision? (Select all that apply.)
Proper classification
Technical adequacy
Effectivity of the change
Cost/Savings impact

41. Knowledge Review
Based on the previous slides, which are ECP cost/savings factors? (Select all that apply.)
Integrated product support
Retrofit
Government administration
Production

42. Content: Schedule (DD1692, p6 – Hardware)
ECP Page 6 of the form is schedule blank form.

43. Content: Schedule (DD1692, p7 – Software)

44. Knowledge Review
How does the DD1692 (pp 6-7) convey schedule impact for incorporating ECP changes? (Select all that apply)
In terms of months after contractual approval
In terms of man-hours it will take to incorporate changes
In terms of both hardware and software schedule elements
By the number and severity of risk areas in the schedule

45. Verification Elements: Summary – Appendix C
C4.1 Implementation
C4.2 Completeness
C4.3 Coordination
C4.4 Content

46. CME204 Engineering Change Proposal Review
Verification and Evaluation Application

47. Graded Activity : Verify and Evaluate
M5 Exercise Folder (Resources)
Timing
Small Groups: 60 minutes
Class Debrief: 40 minutes
Artifacts
ECP DD Form 1692 with supporting documents
Blank DD Forms - reference
Instructions
Review the ECP and supporting documentation.
Discuss the assigned attributes with your team.
Document and upload findings to Blackboard using Team PowerPoint template.
Prepare and deliver a presentation with the class.
You will be assessed as a team using a rubric.

48. Introduction to Verification
Summary

49. Key Points The necessity and proper classification of an ECP packet
The verification process for ECPs and DCMA’s role in determining that verification
Analyze the ECP attributes to identify the proper verification elements

50. Summary What did you know about verification of ECPs when you arrived?
What did you want to know about verification ECPs?
What did you learn about verification ECPs??

51. Questions?