1. CMC submission from A to Z
Yoshiya Terao, NMIJ/AIST
November 23, 2018, Singapore

2. Contents How to make your CMC Table Examples of CMCｓ
Supporting Documents
Submission (Step-by-step Chart)
Intra- and Inter-RMO review (APMP review and CCM/WGFF review)
Publication of MRA Appendix C

3. How to make your CMC Table
First you need to find……
CMC Table basic template
Classification of services
WGFF Guideline
Good examples from published CMCs

4. How to make your CMC Table
CMC Table basic template
Find it at
or just Google “BIPM CMC basic template”.
The Excel file contains five sheets:
Template
Field descriptions
Links to service categories
Formatting Instructions
Formatting Examples

5. How to make your CMC Table
b. Classification of services
“Links to service categories” sheet of the CMC basic template has links to the latest classifications.
Click the link to “Classification of services in Mass and Related Quantities”.

6. How to make your CMC Table
b. Classification of services (30 March 2016)
9. Fluid Flow
9.1 Volume liquid flow rate
9.1.1 Volume water flow rate
9.1.2 Volume hydrocarbon flow rate
9.2 Volume gas flow rate
9.2.1 Volume gas flow rate
9.3 Mass liquid flow rate
9.3.1 Mass water flow rate
9.3.2 Mass hydrocarbon flow rate
9.4 Gas flow rate
9.4.1 Mass gas flow rate
9.4.2 Molar flow rate
9.5 Volume of liquid
9.5.1 Volume of liquid
9.6 Mass of liquid
9.6.1 Mass of liquid
9.7 Flow speed
9.7.1 Gas flow speed
9.7.2 Liquid flow speed
9.8 Multiphase flow
9.8.1 Multiphase flow
9.9 Heat flow rate
9.9.1 Heat flow rate

7. How to make your CMC Table
c. WGFF Guideline
Title: Review Protocol for Fluid Flow Calibration and Measurement Capabilities (CMCs)
URL:  ”WGFF guidelines” tab  ”CMC Review Protocol

8. How to make your CMC Table
d. Good examples from published CMCs
You can get other NMIs’ CMC tables from KCDB.

9. How to make your CMC Table
d. Good examples from published CMCs
You can get other NMIs’ CMC tables from KCDB.
However the tables are in PDF format, which you can not edit.
To get Excel files, ask your friends at TCFF.

10. How to make your CMC Table
Definition of “CMC entry”
An CMC entry consists of one or several lines (In this case, each entry has three lines).
This table contains three CMC entries.
An entry
An entry
An entry

11. How to fill each column (1)
How to make your CMC Table
How to fill each column (1)
Calibration or Measurement Service
Quantity/Class
The quantity being measured.
Instrument or Artifact
Name(s) of DUT(s)
Instrument Type or Method
More detailed type of DUT
or the calibration method
Measurand Level or Range
Minimum value
Calibration range of Flowrate, Flow speed, or Volume
For volume, use L or m3
Maximum value
Units

12. How to fill each column (2)
How to make your CMC Table
How to fill each column (2)
Measurement Conditions/
Independent Variable
Parameter
Calibration conditions:
temperature, line pressure, fluid viscosity, fluid type, etc.
Specifications
Value with unit
or name of the fluid
Use a separate line for each of the parameters

13. How to fill each column (3)
How to make your CMC Table
How to fill each column (3)
Expanded Uncertainty
Value
A fixed value, or
a range of values, or
a formula
A range of values indicates linear interpolation can be used to find intermediate values.
Units
Coverage Factor
Normal values are 2 and 95 %
Level of Confidence
Is the expanded uncertainty a relative one?
"Yes" or "No".
It is preferred that the uncertainty be stated in percent rather than the units of the measurand. However, for air speed, it is reasonable to use m/s.

14. How to fill each column (4)
How to make your CMC Table
How to fill each column (4)
Reference Standard used in calibration
Standard
The reference standard used for the calibration
Source of traceability
If you establish the reference standard by yourself, just write your NMIs name.
If you have your reference standard calibrated by other NMI, write the name of that NMI.
List of Comparisons supporting this measurement/calibration service
The name of comparisons.
If they are listed in MRA Appendix B, hyperlinks for the final reports should be provided.
These columns are information for reviewers. Not to be published in MRA Appendix C.
Check the WGFF Guideline to make it sure you really need comparison results.
Comments to be published
via the web page
Additional information.
Another set of flow range and uncertainty for merged entries (explained later).

15. How to fill each column (5)
How to make your CMC Table
How to fill each column (5)
Administration
NMI Service Identifier
Identifier defined by yourself.
Service Category
Choose one from “Classification of services”.
NMI
Abbreviation of your NMI.
Review Status
To be used by the RMO review panel.
Review Comments
Put a comment to reviewers here.
For example,
“New entry”,
“The maximum flow rate is changed from 10 m3/h to 50 m3/h”,
“Out of review scope”, etc.
Information for reviewers. Not to be published in MRA Appendix C
except “NMI Service Identifier”.

16. Merging two entries for volume and mass flow rate into one.
How to make your CMC Table
Merging two entries for volume and mass flow rate into one.
If you have volume flow and mass flow capabilities for a same reference standard,
make only one entry for both of the volume and mass flow,
write the smaller uncertainty measurand (volume flow or mass flow) in the “Expanded Uncertainty”,
write the other capability, (the flow range and the expanded uncertainty) in the “Comments to be published”

17. When you save the completed table,
How to make your CMC Table
When you save the completed table,
Rename the file as “FF.Country.date.xls”. The date should be in “YYYY-MM-DD” format.
Review the information on the “Field descriptions” and “Formatting instructions” worksheets.
Edit header & footer of the page configuration of the excel sheet to change “NMI (Country)” to your names; insert the date of this version.
….continue to next slide….

18. When you save the completed table,
How to make your CMC Table
When you save the completed table,
….continued from previous ….
Change the worksheet label from “template” to the name of your Country.
Delete the unnecessary worksheets.

19. 2. Examples of CMC entries
Example 1: A water flow calibration facility
Name of the economy: Klingon Empire (KLE)
Name of NMI: NMIK
DUT: Water flow meters
Calibration method: Static gravimetric method with flying start and finish
Flow range: 2 m3/h to 120 m3/h (0.556 kg/s to 33.3 kg/s)
Expanded Uncertainty: %
Line Pressure: 100 kPa to 250 kPa (gauge)
Water Temperature: 5 °C to 30 °C (ambient)
Test line size: 25 mm to 250 mm
Capacity of weighing tank: 2 t
See sheet ”Example1” of “Example(FF.KLE ).xls”.

20. 2. Examples of CMC entries
Example 2: A gas flow calibration facility
Name of the economy: Klingon Empire (KLE)
Name of NMI: NMIK
DUT: Gas flow meters
Calibration method: Comparison method with standard critical nozzles
(Critical nozzles are calibrated by NMIJ)
Flow range: 1 m3/h to 100 m3/h (volume flow only)
Expanded Uncertainty: 0.25 %
Fluid: Dry air
Line Pressure: 100 kPa to 500 kPa (absolute)
Air Temperature: 15 °C to 25 °C (controlled)
Test line size: 15 mm to 50 mm
Critical Nozzles
DUT PT
See sheet ”Example2” of “Example(FF.KLE ).xls”.

21. 2. Examples of CMC entries
Suggestions
It is strongly recommended to fill out your CMC table BEFORE you have a peer review so that a reviewer can make sure your CMC table is properly made.
If possible, it is suggested to get a signature of the reviewer on a printed sheet of your CMC table at the end of the peer review. It make APMP and Inter-regional CMC review smoother.

22. 2. Supporting Documents APMP QS1 Form Peer review report
Technical peer approval
Accreditation certificate (for pathway A and B)
Reports of intercomparisons (if some of CMC entries are supported by non-key comparisons)
A copy of CMC table signed by a peer reviewer (If you have)

23. APMP QS1 Form You can download the template from
2. Supporting Documents
APMP QS1 Form
You can download the template from

24. 3. Submission
- Compress the CMC table and the supporting documents into a zip file, then
it to TCFF Chair and TCQS Chair,
CC to APMP Secretariat(*) *

25. JCRB MRA Appendix C – BIPM Database Peer Review / Assessment Team
APMP
Secretary
TCQS
Chair TC
JCRB MRA Appendix C – BIPM Database
QS-3, QS-7
Completed CMCs
RMOs
QS-1 with Evidence
CMCs with Evidence
CMC
Reviewers
5 Review
Request
6 Review
Results QS
QS-3
QS-7
7 Additional
information/questions
8 Reply
7,14 Review
results
8,15 Revision
4 CMC Submission
11,17 Review
12,18 Review
JCRB
CMC website
NMI: TC / TCQS delegate
Peer Review / Assessment Team
13 Review
19 CMC Approval
Notice
NMI action
TC Chair action
JCRB action
TCQS Chair action
Reviewer action
RMOs to/from NMI
or TC Chair
(if necessary)
APMP Secretary
action
10,16 Posting CMCs
9 QS Approval 10 20
3 On-site peer review / assessment
2 Approval of
technical reviewers
1 Request for approval
of technical reviewers
21 Confirmation of
CMC publication

26. 4. Intra- and Inter-RMO review
APMP review and CCM/WGFF review
JCRB website
How long does it take to complete?

27. 4. Intra- and Inter-RMO review
APMP review (Intra-RMO review)
Technical review by TCFF review team
QS review by TCQS
Performed by correspondences.

28. 4. Intra- and Inter-RMO review
TCFF CMC review team
Water Flow: KRISS, NMIJ
Hydrocarbon Flow: CMS, NMIJ
Air Speed: NMIJ, CMS
Volume: NMIA, NIM, NPLI
High Pressure Gas Flow: KRISS, CMS, NIM
Low Pressure Gas Flow: NMIJ, NIM
Viscosity: NIM, NPLI

29. 4. Intra- and Inter-RMO review
CCM/WGFF review (Inter-RMO review)
Technical review by RMOs review team
No QS review
Performed on JCRB web site and also by correspondences.
JCRB web site issues an identifier automatically (20XX.APMP.M.nn).

30. 4. Intra- and Inter-RMO review
JCRB website

31. 4. Intra- and Inter-RMO review
How long does it take to complete?
4. Intra- and Inter-RMO review
Some experiences at NMIJ Flow Labs
2010 Aug.
2013 Aug.
2014 Jun.
2018 Apr.
APMP review initiated
days
APMP TCFF review completed
APMP TCQS review completed
Inter-RMO review starts
Inter-RMO review
ongoing
Published to Appendix C

32. 5. Publication in MRA Appendix C
Congratulations!

33. Conclusion
When you make your CMC table, read the related documents thoroughly and carefully, then you save your time.
Be patient after you submit your CMC.