CMC submission from A to Z Yoshiya Terao, NMIJ/AIST November 23, 2018, Singapore

Contents How to make your CMC Table Examples of CMCｓ Supporting Documents Submission (Step-by-step Chart) Intra- and Inter-RMO review (APMP review and CCM/WGFF review) Publication of MRA Appendix C

How to make your CMC Table First you need to find…… CMC Table basic template Classification of services WGFF Guideline Good examples from published CMCs

How to make your CMC Table CMC Table basic template Find it at https://www.bipm.org/en/cipm-mra/cipm-mra-documents/cmc_excel_files.html or just Google “BIPM CMC basic template”. The Excel file contains five sheets: Template Field descriptions Links to service categories Formatting Instructions Formatting Examples

How to make your CMC Table b. Classification of services “Links to service categories” sheet of the CMC basic template has links to the latest classifications. Click the link to “Classification of services in Mass and Related Quantities”.

How to make your CMC Table b. Classification of services (30 March 2016) 9. Fluid Flow 9.1 Volume liquid flow rate 9.1.1 Volume water flow rate 9.1.2 Volume hydrocarbon flow rate 9.2 Volume gas flow rate 9.2.1 Volume gas flow rate 9.3 Mass liquid flow rate 9.3.1 Mass water flow rate 9.3.2 Mass hydrocarbon flow rate 9.4 Gas flow rate 9.4.1 Mass gas flow rate 9.4.2 Molar flow rate 9.5 Volume of liquid 9.5.1 Volume of liquid 9.6 Mass of liquid 9.6.1 Mass of liquid 9.7 Flow speed 9.7.1 Gas flow speed 9.7.2 Liquid flow speed 9.8 Multiphase flow 9.8.1 Multiphase flow 9.9 Heat flow rate 9.9.1 Heat flow rate

How to make your CMC Table c. WGFF Guideline Title: Review Protocol for Fluid Flow Calibration and Measurement Capabilities (CMCs) URL: https://www.bipm.org/en/committees/cc/wg/ccm-wgff.html  ”WGFF guidelines” tab  ”CMC Review Protocol

How to make your CMC Table d. Good examples from published CMCs You can get other NMIs’ CMC tables from KCDB. https://kcdb.bipm.org/

How to make your CMC Table d. Good examples from published CMCs You can get other NMIs’ CMC tables from KCDB. However the tables are in PDF format, which you can not edit. To get Excel files, ask your friends at TCFF.

How to make your CMC Table Definition of “CMC entry” An CMC entry consists of one or several lines (In this case, each entry has three lines). This table contains three CMC entries. An entry An entry An entry

How to fill each column (1) How to make your CMC Table How to fill each column (1) Calibration or Measurement Service Quantity/Class The quantity being measured. Instrument or Artifact Name(s) of DUT(s) Instrument Type or Method More detailed type of DUT or the calibration method Measurand Level or Range Minimum value Calibration range of Flowrate, Flow speed, or Volume For volume, use L or m3 Maximum value Units

How to fill each column (2) How to make your CMC Table How to fill each column (2) Measurement Conditions/ Independent Variable Parameter Calibration conditions: temperature, line pressure, fluid viscosity, fluid type, etc. Specifications Value with unit or name of the fluid Use a separate line for each of the parameters

How to fill each column (3) How to make your CMC Table How to fill each column (3) Expanded Uncertainty Value A fixed value, or a range of values, or a formula A range of values indicates linear interpolation can be used to find intermediate values. Units Coverage Factor Normal values are 2 and 95 % Level of Confidence Is the expanded uncertainty a relative one? "Yes" or "No". It is preferred that the uncertainty be stated in percent rather than the units of the measurand. However, for air speed, it is reasonable to use m/s.

How to fill each column (4) How to make your CMC Table How to fill each column (4) Reference Standard used in calibration Standard The reference standard used for the calibration Source of traceability If you establish the reference standard by yourself, just write your NMIs name. If you have your reference standard calibrated by other NMI, write the name of that NMI. List of Comparisons supporting this measurement/calibration service The name of comparisons. If they are listed in MRA Appendix B, hyperlinks for the final reports should be provided. These columns are information for reviewers. Not to be published in MRA Appendix C. Check the WGFF Guideline to make it sure you really need comparison results. Comments to be published via the web page Additional information. Another set of flow range and uncertainty for merged entries (explained later).

How to fill each column (5) How to make your CMC Table How to fill each column (5) Administration NMI Service Identifier Identifier defined by yourself. Service Category Choose one from “Classification of services”. NMI Abbreviation of your NMI. Review Status To be used by the RMO review panel. Review Comments Put a comment to reviewers here. For example, “New entry”, “The maximum flow rate is changed from 10 m3/h to 50 m3/h”, “Out of review scope”, etc. Information for reviewers. Not to be published in MRA Appendix C except “NMI Service Identifier”.

Merging two entries for volume and mass flow rate into one. How to make your CMC Table Merging two entries for volume and mass flow rate into one. If you have volume flow and mass flow capabilities for a same reference standard, make only one entry for both of the volume and mass flow, write the smaller uncertainty measurand (volume flow or mass flow) in the “Expanded Uncertainty”, write the other capability, (the flow range and the expanded uncertainty) in the “Comments to be published”

When you save the completed table, How to make your CMC Table When you save the completed table, Rename the file as “FF.Country.date.xls”. The date should be in “YYYY-MM-DD” format. Review the information on the “Field descriptions” and “Formatting instructions” worksheets. Edit header & footer of the page configuration of the excel sheet to change “NMI (Country)” to your names; insert the date of this version. ….continue to next slide….

When you save the completed table, How to make your CMC Table When you save the completed table, ….continued from previous …. Change the worksheet label from “template” to the name of your Country. Delete the unnecessary worksheets.

2. Examples of CMC entries Example 1: A water flow calibration facility Name of the economy: Klingon Empire (KLE) Name of NMI: NMIK DUT: Water flow meters Calibration method: Static gravimetric method with flying start and finish Flow range: 2 m3/h to 120 m3/h (0.556 kg/s to 33.3 kg/s) Expanded Uncertainty: 0.070 % Line Pressure: 100 kPa to 250 kPa (gauge) Water Temperature: 5 °C to 30 °C (ambient) Test line size: 25 mm to 250 mm Capacity of weighing tank: 2 t See sheet ”Example1” of “Example(FF.KLE.2018-11-23).xls”.

2. Examples of CMC entries Example 2: A gas flow calibration facility Name of the economy: Klingon Empire (KLE) Name of NMI: NMIK DUT: Gas flow meters Calibration method: Comparison method with standard critical nozzles (Critical nozzles are calibrated by NMIJ) Flow range: 1 m3/h to 100 m3/h (volume flow only) Expanded Uncertainty: 0.25 % Fluid: Dry air Line Pressure: 100 kPa to 500 kPa (absolute) Air Temperature: 15 °C to 25 °C (controlled) Test line size: 15 mm to 50 mm Critical Nozzles DUT PT See sheet ”Example2” of “Example(FF.KLE.2018-11-23).xls”.

2. Examples of CMC entries Suggestions It is strongly recommended to fill out your CMC table BEFORE you have a peer review so that a reviewer can make sure your CMC table is properly made. If possible, it is suggested to get a signature of the reviewer on a printed sheet of your CMC table at the end of the peer review. It make APMP and Inter-regional CMC review smoother.

2. Supporting Documents APMP QS1 Form Peer review report Technical peer approval Accreditation certificate (for pathway A and B) Reports of intercomparisons (if some of CMC entries are supported by non-key comparisons) A copy of CMC table signed by a peer reviewer (If you have)

APMP QS1 Form You can download the template from 2. Supporting Documents APMP QS1 Form You can download the template from http://www.apmpweb.org/documents/qsdocuments.php

3. Submission - Compress the CMC table and the supporting documents into a zip file, then e-mail it to TCFF Chair and TCQS Chair, CC to APMP Secretariat(*) * APMP-secretariat@aist.go.jp

JCRB MRA Appendix C – BIPM Database Peer Review / Assessment Team APMP Secretary TCQS Chair TC JCRB MRA Appendix C – BIPM Database QS-3, QS-7 Completed CMCs RMOs QS-1 with Evidence CMCs with Evidence CMC Reviewers 5 Review Request 6 Review Results QS QS-3 QS-7 7 Additional information/questions 8 Reply 7,14 Review results 8,15 Revision 4 CMC Submission 11,17 Review 12,18 Review JCRB CMC website NMI: TC / TCQS delegate Peer Review / Assessment Team 13 Review 19 CMC Approval Notice NMI action TC Chair action JCRB action TCQS Chair action Reviewer action RMOs to/from NMI or TC Chair (if necessary) APMP Secretary action 10,16 Posting CMCs 9 QS Approval 10 20 3 On-site peer review / assessment 2 Approval of technical reviewers 1 Request for approval of technical reviewers 21 Confirmation of CMC publication

4. Intra- and Inter-RMO review APMP review and CCM/WGFF review JCRB website How long does it take to complete?

4. Intra- and Inter-RMO review APMP review (Intra-RMO review) Technical review by TCFF review team QS review by TCQS Performed by e-mail correspondences.

4. Intra- and Inter-RMO review TCFF CMC review team Water Flow: KRISS, NMIJ Hydrocarbon Flow: CMS, NMIJ Air Speed: NMIJ, CMS Volume: NMIA, NIM, NPLI High Pressure Gas Flow: KRISS, CMS, NIM Low Pressure Gas Flow: NMIJ, NIM Viscosity: NIM, NPLI

4. Intra- and Inter-RMO review CCM/WGFF review (Inter-RMO review) Technical review by RMOs review team No QS review Performed on JCRB web site and also by e-mail correspondences. JCRB web site issues an identifier automatically (20XX.APMP.M.nn).

4. Intra- and Inter-RMO review JCRB website

4. Intra- and Inter-RMO review How long does it take to complete? 4. Intra- and Inter-RMO review Some experiences at NMIJ Flow Labs 2010 Aug. 2013 Aug. 2014 Jun. 2018 Apr. APMP review initiated days APMP TCFF review completed APMP TCQS review completed Inter-RMO review starts Inter-RMO review ongoing Published to Appendix C

5. Publication in MRA Appendix C Congratulations!

Conclusion When you make your CMC table, read the related documents thoroughly and carefully, then you save your time. Be patient after you submit your CMC.