Agenda 24 July 2018 0900 – 1000 Around the room All 1000 – 1015 Review April meeting action items Jim/Gary 1015 – 1030 DMC 2018 Jim 1030 – 1045 OSD BoK path forward Steve 1045 – 1100 User’s guide update Tom L./Jack 1100 – 1115 Matrix Scrub Update Scott 1115 - 1130 Deskbook Update Jack 1130 – 1145 Cyber Security Update Scott 1145 - 1200 OSD S&T Workshop Harts 1200 – 1300 Lunch 1300 – 1400 2018 MRL WG Workshop Jim/All 1400 - 1500 ARDEC MRL Blackbelt Jordan 1500 – 1530 Review action items/Adjourn Gary/Jim

April MRL WG Action Item Update 1. Scrub the criteria matrix for administrative/grammatical errors, OPR Scott P. due 13 June 2018. 2. Tom L. to provide to Jack ESH changes to the Deskbook, OPR Tom L., 13 June 2018. 3. Jack to update Deskbook as appropriate, OPR Jack, due 24 July 2018. 4. Jack to update matrix with ESH material and work with Scott(#1) for 2018 version of criteria, OPR Jack and Scott, due 24 July 2018. 5. Develop a definition for special handling for Deskbook/matrix/User’s guide, OPR Tom L., due 24 July 2018. 6. Larry D. to send S&T MRL 1-4 recommendation to Jim, OPR Larry., due 13 June 2018. 7. Collect AS6500 info and put on website, OPR Jim and Mark G., due 13 June 2108. 8. Secure three slots at DMC for MRL WG sessions, OPR Jim, due 13 June 2108. 9. Get confirmation that David G. will present Navy MRL use at DMC, Jim, due 13 June 2018. 10. Confirm Boeing will brief overall MRL approach at DMC, OPR Jason, due 24 July 2018. 11. Encourage colleagues to attend Mr. Gold’s round table during DMC, OPR all MRL WG members, due, 24 July 2018. 12. Set up telecoms to further discuss cyber security with selected team, OPR Scott, due 13 July 2018. 13. Harts to provide Dr. Griffin’s MRL Philosophy to Jim, OPR Harts, due 8 May 2018. 14. Prepare a draft letter and questionnaire for S&T workshop and provide to OPRs, OPR Jim and Gary, due 18 May 2018. 15. Develop a draft agenda for S&T workshop, OPR Jim and Scott, due 8 May 2018. 16. Provide names of attendees to workshop to Jim, OPR Don, Mike, and Mark, due 6 July 2018. 17. DCMA to provide feedback on checklist to address MRL assessments during pre-award surveys, OPR Harry, due 24 June 2018 (next meeting). 18. Provide feedback to OSD BOK, OPR all MRL WG members, due 24 July 2018. 19. Send user’s Guide comments to Ali, OPR Tom L. and WG, due 25 May 2018. Green – In progress Red – needs completed Black – done/OBE  

DMC 2018 (proposed) Suggested agenda Day 1 (Tuesday, 4 Dec) OSD Perspective - TBD MRL WG Activities - Scott P. MRA metrics - Jordan M. DCMA NAVAIR Boeing Day 2 (Wednesday, 5 Dec) MRL Training – Tom L. AS6500 training – Dave K. Mr. Gold Roundtable by invite only (Wednesday, 5 Dec) Other ideas for day 1? Standard SOW?

OSD BoK Path Forward Steve Gray

Users Guide & Matrix Update Committee Tom Lastoskie Chair Jack Galuardi Vice Chair

Users Guide & Matrix Update Committee Members Tom Lastoskie – Chair Jack Galuardi – Vice Chair Scott Pearl – Member, USAF (AFRL) Jordon Masters – Member, Army Ali Al-Hamdani – Member, USAF (AFRL) All members verified their membership All members verified their membership

Overview 3Q2018 Presentation/Discussion Go-Forward Plan for 3 Focused Tasks to be Completed in Sequence: Robust Update/Add Content to Current Users Guide to Support MRL Deskbook 2016 & 2017 Versions Based on 1., Potentially Update Existing Criteria Wording & Add ESH Criteria Wording to Support MRL Deskbook 2018 Version Once MRL Deskbook 2018 Version Published, Update Users Guide to Support MRL Deskbook 2018 Version

Robust Update/Add Content to Current Users Guide Information to Support MRL Deskbook 2016 & 2017 Versions Making Users Guide more robust, add useful content (e.g., adding Objective Evidence examples) and cleaning-up existing content (e.g., standardize the content format of all matrix cell information) There are numerous inconsistencies in the current version of the Users Guide (has been present for a few years) Committee is doing a deep-dive of MRLs 4 – 10 to update and add content

Robust Update/Add Content to Current Users Guide Information to Support MRL Deskbook 2016 & 2017 Versions (cont.) This is a much more involved activity than what was originally anticipated! The committee has reviewed MRLs 4 – 6, changes are captured and work continuing The committee is reviewing MRLs 7 – 8 and is currently targeted for end of July MRLs 9 – 10 are targeted for end of Aug Above changes to be incorporated in Users Guide (AFRL is action office) with target of the MRL Workshop (Sep 25th)

Update Existing Criteria Wording & Add ESH Criteria Wording to Support MRL Deskbook 2018 Version There are some inconsistencies/confusion factors in the current criteria in the MRL Deskbook Scott Pearl and Jordon Masters have provided updates for the current criteria (Jack & Tom also have updates) ESH criteria has been codified and is captured for use Committee will provide proposed updated criteria wording for incorporation in the MRL Deskbook 2018 Version, for review by the MRL Working Group, 2 weeks prior to the MRL WG Meeting (Oct 23rd)

Once MRL Deskbook 2018 Version Published, Update Users Guide to Support MRL Deskbook 2018 Version Update the Users Guide to support the 2018 Version of the MRL Deskbook The committee will ensure that we have: Version of the Users Guide to support the 2016/2017 Version of the MRL Deskbook and Version of the Users Guide to support the 2018 Version of the MRL Deskbook Completed 2016/2017 & 2018 Users Guides target availability is the Defense Manufacturing Conference (Dec 2018)

Comments?

User’s Guide Update Tom L./Jack

Matrix Scrub Scott/Jack Grammar, sentence structure, typos, etc. ESH

Deskbook Jack ESH Matrix

Cyber Security Scott

OSD S&T Workshop Robert Hartzell

2018 MRL WG Workshop (proposed) Day 1, 25 Sept. 0900 – 0910 Welcome/Administration Pearl/Alberg 0910 – 0940 MRL WG Activities Pearl 0940 – 0950 Workshop Objectives Pearl 0950 – 1000 Introductions All 1000 – 1030 Invited Leadership presentation (Gold/Monje/Frost) TBD 1030 – 1100 Cyber Security Pearl/TBD 1100 – 1130 MRL 1-3/S&T Considerations Morgan/Stanley/Harts? 1130 – 1200 MRL Matrix Update Pearl 1200 – 1300 Lunch 1300 – 1330 Deskbook Update Galuardi 1330 – 1400 User’s Guide Update Lastoskie 1400 – 1430 Standardized SOW Stanley 1430 – 1500 DOCENT Loiacono 1500 – 1515 Breakout Session Objectives Pearl 1515 – 1630 First Breakout Session All   Day 2, 26 Sept. 0800 – 1100 Second Breakout Session All 1100 – 1200 Breakout Summary All 1300 – 1600 G-23 committee meeting Karr

2018 MRL WG Workshop Is anything missing? Other ideas?

2018 Workshop Breakout Sessions (Proposed) Breakout session discussions: MRL 1-3 way forward Cyber feedback DOCENT feedback SOW feedback? Questions to answer: With respect to the MRL process, what is working, what is not? What could make the MRL process better or more efficient? What should the MRL WG concentrate on during 2019? Short list please!

ARDEC MRL Blackbelt Jordan Masters Charts are completed and will be shown in the meeting, however, they have not yet been approved for public release. Once they have been approved they will be made available on the website.