Assessment of Lab Performance and Analytical Equivalence in Milk Testing in North America ICAR, June 16, 2008 Niagara Falls, New York

Paul Sauvé Canadian Lab Services Capital Laboratory Services Ottawa, Ontario, CA

DHI Testing in North America - Facts and Figures

55 official (accredited/certified) DHI laboratories in North America

DHI Testing in North America - Facts and Figures 55 official (accredited/certified) DHI laboratories in North America 44 in USA (including 1 in Puerto Rico), 8 in Canada, 1 in Mexico *

DHI Testing in North America - Facts and Figures 55 official (accredited/certified) DHI laboratories in North America 44 in USA (including 1 in Puerto Rico), 8 in Canada, 1 in Mexico * approximately 115 infrared analyzers (fat, protein, MUN)

DHI Testing in North America - Facts and Figures 55 official (accredited/certified) DHI laboratories in North America 44 in USA (including 1 in Puerto Rico), 8 in Canada, 1 in Mexico * approximately 115 infrared analyzers (fat, protein, MUN) approximately 130 somatic cell counters

DHI Testing in North America - Facts and Figures 55 official (accredited/certified) DHI laboratories in North America 44 in USA (including 1 in Puerto Rico), 8 in Canada, 1 in Mexico * approximately 115 infrared analyzers (fat, protein, MUN) approximately 130 somatic cell counters approximately 40 MUN analyzers (IR, differential pH, FIA, etc.)

DHI Testing in North America - Facts and Figures 55 official (accredited/certified) DHI laboratories in North America 44 in USA (including 1 in Puerto Rico), 8 in Canada, 1 in Mexico * approximately 115 infrared analyzers (fat, protein, MUN) approximately 130 somatic cell counters approximately 40 MUN analyzers (IR, differential pH, FIA, etc.) approximately 70,000,000 samples tested annually *

DHI Testing in North America - Facts and Figures 55 official (accredited/certified) DHI laboratories in North America 44 in USA (including 1 in Puerto Rico), 8 in Canada, 1 in Mexico * approximately 115 infrared analyzers (fat, protein, MUN) approximately 130 somatic cell counters approximately 40 MUN analyzers (IR, differential pH, FIA, etc.) approximately 70,000,000 samples tested annually * several DHI labs offering additional services

DHI Testing in North America - Facts and Figures 55 official (accredited/certified) DHI laboratories in North America 44 in USA (including 1 in Puerto Rico), 8 in Canada, 1 in Mexico * approximately 115 infrared analyzers (fat, protein, MUN) approximately 130 somatic cell counters approximately 40 MUN analyzers (IR, differential pH, FIA, etc.) approximately 70,000,000 samples tested annually * several DHI labs offering additional services (forage analysis, Johnes screening, water analysis, component payment testing, drug residues, bacteria, added water, vet services, nutritional consulting, etc.)

Accreditation / Certification

Canada

Accreditation / Certification Canada DHI labs are accredited under ISO

Accreditation / Certification Canada DHI labs are accredited under ISO Accreditation is delivered by the Standards Council of Canada and coordinated by CLS.

Accreditation / Certification Canada DHI labs are accredited under ISO Accreditation is delivered by the Standards Council of Canada and coordinated by CLS. On-site assessments are conducted every two years.

Accreditation / Certification Canada DHI labs are accredited under ISO Accreditation is delivered by the Standards Council of Canada and coordinated by CLS. On-site assessments are conducted every two years. USA and Mexico

Accreditation / Certification Canada DHI labs are accredited under ISO Accreditation is delivered by the Standards Council of Canada and coordinated by CLS. On-site assessments are conducted every two years. USA and Mexico DHI labs are certified under guidelines developed by the Council on Dairy Cattle Breeding.

Accreditation / Certification Canada DHI labs are accredited under ISO Accreditation is delivered by the Standards Council of Canada and coordinated by CLS. On-site assessments are conducted every two years. USA and Mexico DHI labs are certified under guidelines developed by the Council on Dairy Cattle Breeding. Certification is delivered and coordinated by QCS.

Accreditation / Certification Canada DHI labs are accredited under ISO Accreditation is delivered by the Standards Council of Canada and coordinated by CLS. On-site assessments are conducted every two years. USA and Mexico DHI labs are certified under guidelines developed by the Council on Dairy Cattle Breeding. Certification is delivered and coordinated by QCS. On-site audits are conducted every two years.

Proficiency Testing Programs

Canada

Proficiency Testing Programs Canada Analytical performance is assessed monthly using samples provided by Canadian Lab Services.

Proficiency Testing Programs Canada Analytical performance is assessed monthly using samples provided by Canadian Lab Services. Data analysis and reporting is coordinated by CLS.

Proficiency Testing Programs Canada Analytical performance is assessed monthly using samples provided by Canadian Lab Services. Data analysis and reporting is coordinated by CLS. USA and Mexico

Proficiency Testing Programs Canada Analytical performance is assessed monthly using samples provided by Canadian Lab Services. Data analysis and reporting is coordinated by CLS. USA and Mexico Analytical performance is assessed monthly using samples provided by Eastern Lab Services.

Proficiency Testing Programs Canada Analytical performance is assessed monthly using samples provided by Canadian Lab Services. Data analysis and reporting is coordinated by CLS. USA and Mexico Analytical performance is assessed monthly using samples provided by Eastern Lab Services. Data analysis and reporting is coordinated by QCS with involvement of an outside contractor.

Proficiency Testing - Schedules and Samples

Canada

Proficiency Testing - Schedules and Samples Canada Six times annually sets of 20 blind duplicate samples are circulated according to a pre-arranged schedule.

Proficiency Testing - Schedules and Samples Canada Six times annually sets of 20 blind duplicate samples are circulated according to a pre-arranged schedule. Six times annually sets of 16 individual samples are circulated unannounced. *

Proficiency Testing - Schedules and Samples Canada Six times annually sets of 20 blind duplicate samples are circulated according to a pre-arranged schedule. Six times annually sets of 16 individual samples are circulated unannounced. * Samples are sent by overnight courier.

Proficiency Testing - Schedules and Samples Canada Six times annually sets of 20 blind duplicate samples are circulated according to a pre-arranged schedule. Six times annually sets of 16 individual samples are circulated unannounced. * Samples are sent by overnight courier. USA and Mexico

Proficiency Testing - Schedules and Samples Canada Six times annually sets of 20 blind duplicate samples are circulated according to a pre-arranged schedule. Six times annually sets of 16 individual samples are circulated unannounced. * Samples are sent by overnight courier. USA and Mexico Every month sets of 24 duplicate samples are circulated according to a pre-arranged schedule.

Proficiency Testing - Schedules and Samples Canada Six times annually sets of 20 blind duplicate samples are circulated according to a pre-arranged schedule. Six times annually sets of 16 individual samples are circulated unannounced. * Samples are sent by overnight courier. USA and Mexico Every month sets of 24 duplicate samples are circulated according to a pre-arranged schedule. Samples are sent by overnight courier.

Proficiency Testing - Data submission and Reporting

Canada

Proficiency Testing - Data submission and Reporting Canada Test results are submitted electronically and performance reports are returned electronically.

Proficiency Testing - Data submission and Reporting Canada Test results are submitted electronically and performance reports are returned electronically. Reports include coded data from all participating labs.

Proficiency Testing - Data submission and Reporting Canada Test results are submitted electronically and performance reports are returned electronically. Reports include coded data from all participating labs. Turn around time from deadline to circulation of reports < 3 days.

Proficiency Testing - Data submission and Reporting Canada Test results are submitted electronically and performance reports are returned electronically. Reports include coded data from all participating labs. Turn around time from deadline to circulation of reports < 3 days. USA and Mexico

Proficiency Testing - Data submission and Reporting Canada Test results are submitted electronically and performance reports are returned electronically. Reports include coded data from all participating labs. Turn around time from deadline to circulation of reports < 3 days. USA and Mexico Test results are submitted and reports are returned via a secure web site.

Proficiency Testing - Data submission and Reporting Canada Test results are submitted electronically and performance reports are returned electronically. Reports include coded data from all participating labs. Turn around time from deadline to circulation of reports < 3 days. USA and Mexico Test results are submitted and reports are returned via a secure web site. Reports include individual data and summary graphs from all labs.

Proficiency Testing - Data submission and Reporting Canada Test results are submitted electronically and performance reports are returned electronically. Reports include coded data from all participating labs. Turn around time from deadline to circulation of reports < 3 days. USA and Mexico Test results are submitted and reports are returned via a secure web site. Reports include individual data and summary graphs from all labs. Turn around time < 3 days.

Proficiency Testing - Components included

Canada

Proficiency Testing - Components included Canada 6 times annually: fat, protein, lactose, total solids, MUN, SCC

Proficiency Testing - Components included Canada 6 times annually: fat, protein, lactose, total solids, MUN, SCC 6 times annually: fat, protein, SCC, MUN

Proficiency Testing - Components included Canada 6 times annually: fat, protein, lactose, total solids, MUN, SCC 6 times annually: fat, protein, SCC, MUN monthly: MUN

Proficiency Testing - Components included Canada 6 times annually: fat, protein, lactose, total solids, MUN, SCC 6 times annually: fat, protein, SCC, MUN monthly: MUN A program for Johnes screening is under development.

Proficiency Testing - Components included Canada 6 times annually: fat, protein, lactose, total solids, MUN, SCC 6 times annually: fat, protein, SCC, MUN monthly: MUN A program for Johnes screening is under development. USA and Mexico

Proficiency Testing - Components included Canada 6 times annually: fat, protein, lactose, total solids, MUN, SCC 6 times annually: fat, protein, SCC, MUN monthly: MUN A program for Johnes screening is under development. USA and Mexico monthly: fat, protein, SCC, MUN *

Proficiency Testing - Components included Canada 6 times annually: fat, protein, lactose, total solids, MUN, SCC 6 times annually: fat, protein, SCC, MUN monthly: MUN A program for Johnes screening is under development. USA and Mexico monthly: fat, protein, SCC, MUN * A program for Johnes screening is under development.

Proficiency Testing - Tolerances (fat and protein)

Canada

Proficiency Testing - Tolerances (fat and protein) Canada MD < +/-.04% and SDD <.04% in three of the last four trials

Proficiency Testing - Tolerances (fat and protein) Canada MD < +/-.04% and SDD <.04% in three of the last four trials RMD (rolling mean difference) <.02% across the last six trials

Proficiency Testing - Tolerances (fat and protein) Canada MD < +/-.04% and SDD <.04% in three of the last four trials RMD (rolling mean difference) <.02% across the last six trials USA and Mexico

Proficiency Testing - Tolerances (fat and protein) Canada MD < +/-.04% and SDD <.04% in three of the last four trials RMD (rolling mean difference) <.02% across the last six trials USA and Mexico MD < +/-.04% and SDD <.04% in three of the last four trials

Proficiency Testing - Tolerances (fat and protein) Canada MD < +/-.04% and SDD <.04% in three of the last four trials RMD (rolling mean difference) <.02% across the last six trials USA and Mexico MD < +/-.04% and SDD <.04% in three of the last four trials RMD (rolling mean difference) <.02% across the last six trials

Proficiency Testing - Tolerances (SCC)

Canada

Proficiency Testing - Tolerances (SCC) Canada M%D < +/- 10% and SD%D < 10% in three of the last four trials

Proficiency Testing - Tolerances (SCC) Canada M%D < +/- 10% and SD%D < 10% in three of the last four trials RM%D (rolling mean difference) < 5% across the last six trials

Proficiency Testing - Tolerances (SCC) Canada M%D < +/- 10% and SD%D < 10% in three of the last four trials RM%D (rolling mean difference) < 5% across the last six trials USA and Mexico

Proficiency Testing - Tolerances (SCC) Canada M%D < +/- 10% and SD%D < 10% in three of the last four trials RM%D (rolling mean difference) < 5% across the last six trials USA and Mexico M%D < +/- 10% and SD%D < 10% in three of the last four trials

Proficiency Testing - Tolerances (SCC) Canada M%D < +/- 10% and SD%D < 10% in three of the last four trials RM%D (rolling mean difference) < 5% across the last six trials USA and Mexico M%D < +/- 10% and SD%D < 10% in three of the last four trials RM%D (rolling mean difference) < 5% across the last six trials

Proficiency testing - Example SampleFat (ref)Fat (IR)Diff MD0.027 SDD.0010

Proficiency testing - Example SampleFat (ref)Fat (IR)Diff MD0.027 SDD.0010

Proficiency testing - Example SampleFat (ref)Fat (IR)Diff MD0.027 SDD.0010 MD < +/-.04% in three of the last four trials

Proficiency testing - Example SampleFat (ref)Fat (IR)Diff MD0.027 SDD.0010

Proficiency testing - Example SampleFat (ref)Fat (IR)Diff MD0.027 SDD.0010

Proficiency testing - Example SampleFat (ref)Fat (IR)Diff MD0.027 SDD.0010 SDD <.04% in three of the last four trials

Proficiency Testing - Example

The rolling mean difference (RMD) must be less than.02 percent across the last six trials.

Proficiency Testing - Example The rolling mean difference (RMD) must be less than.02 percent across the last six trials. Date MD Jan Feb Mar Apr May Jun RMD

Proficiency Testing - Example The rolling mean difference (RMD) must be less than.02 percent across the last six trials. Date MD Jan Feb Mar Apr May Jun RMD 0.004

Canadian Program - Individual Data, Tabular Presentation

Canadian Program - Individual Data, Graphical Presentation

Canadian Program - Summary Table

Canadian Program - Summary Graph

QCS Program, Individual Data, Tabular Presentation B2500 A Butterfat Sample| Lab/Instrument Avg |Instr Results| Prec Stats |Accuracy Stats Number| Ref Inst Diff | Rep1 Rep2 | Range SD Reps |IR Mean Diff __________________________________________________________________________ 1 | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | __________________________________________________________________________ MD SDA MD SDD SDD 0.033

QCS Program - Summary Graph

QCS Program - Historical Data, Tabular Presentation FAT Results Month | MD SDD RMD | | Jun | | Jul | | Aug | | Sep | | Oct | | Changed cell here! Nov | | Dec | | Jan | | Feb | | Mar | | Apr | | May | |

QCS Program - Historical Data, Graphical Presentation