WHO EQAP for the detection of influenza A virus subtype by PCR Wilina Lim Centre for Health Protection Hong Kong SAR, China

Aims/objectives To monitor quality and standards of performance To monitor quality and standards of performance To facilitate information exchange To facilitate information exchange To identify problems with assays To identify problems with assays To help develop testing strategies To help develop testing strategies To provide mechanisms to remedy any deficiencies revealed To provide mechanisms to remedy any deficiencies revealed Requirement of lab accreditation in accordance with international standard such as ISO Requirement of lab accreditation in accordance with international standard such as ISO 15189

Benefits identified by NICs To monitor feasibility to ship samples to countries laboratory capability timeliness of reporting

1A. Invitation 2. Preparation of Panels 4. Data Collection 3. Panel Distribution 5. Preliminary report 6. Data Analysis 7. Final report QAP Process 1B. New Participants The EQAP has been accredited in accordance With ISO 17043

Preparation of panels Include different subtypes/clades Include different subtypes/clades Dried RNA of influenza AH5, H1, H3, H1v and influenza B viruses Gamma-ray inactivated seasonal influenza samples Verify sample content Verify sample content Verify sufficient homogeneity Verify sufficient homogeneity Samples in final packaged form selected and tested Assure sufficient stability Assure sufficient stability Test over a range of storage conditions prior to distribution Samples were tested after 7 days of storage at 37 o C using both conventional and real-time PCR assays

Temperature survey Monitor the temperature change during shipment Monitor the temperature change during shipment Target participants Target participants With temperature record higher than 37 ℃ during sample dispatch periodWith temperature record higher than 37 ℃ during sample dispatch period Panel 9: Jan-Mar 2011Panel 9: Jan-Mar 2011 Region No. of logger sent returned AFRO51 AMRO32 EMRO22 WPRO32 Total137

Temperature survey on EQAP panel 9 shipment Longest duration with temperature higher than 37 ℃ was 6 hours

Temperature above 37 ℃ were recorded during the transit in daytime

Panel contents No. of samples in the panel Panel 1 Panel 2 Panel 3 Panel 4 Panel 5 Panel 6 Panel 7 Panel 8 Panel Feb-MarAug-OctJan-FebJun-JulJan-FebJun-AugJan-MarJun-AugJan-Mar RNA sample H5 sample: - clade 1 - clade clade clade clade clade clade clade clade clade H1 sample H3 sample H1pdm sample 2222 Influenza B sample 111 Negative sample Inactivated virus sample H1 sample 1 H3 sample 1 Total Composition of panels

WHO region No. of laboratories participated and reported results Panel 1Panel 2Panel 3Panel 4Panel 5Panel 6Panel 7Panel 8Panel Feb-MarAug-OctJan-FebJun-JulJan-FebJun-AugJan-MarJun-AugJan-Mar AFR AMR EMR EUR SEAR WPR All Response of participants

Problems encountered No PCR capacity No PCR capacity No reagents No reagents Delay in obtaining import permit Delay in obtaining import permit Varying requirements at the customs Varying requirements at the customs Shipment detained at customs for prolonged period Shipment detained at customs for prolonged period

Reasons for laboratories not receiving panels among total invited

Performance of participants

Panel No. of participants invitedrespondedparticipatedreceivedreportedall correct Panel Panel Panel Panel Panel Panel Panel Panel Panel Performance of SEAR participants % of all correct

Panel No. of participants invitedrespondedparticipatedreceivedreportedall correct Panel Panel Panel Panel Panel Panel Panel Panel Panel Performance of WPR participants % of all correct

Performance in Panel 8

Performance in Panel 9

Problems identified in EQAP Inconsistent technical performance Inconsistent technical performance Positive control not used appropriately Positive control not used appropriately Lab contamination Lab contamination Misinterpretation of results Misinterpretation of results Primers and probes mismatch Primers and probes mismatch Transcriptional error Transcriptional error

False negative results due to probe mis-matches An example of a H5 real-time PCR primer/probe set An example of a H5 real-time PCR primer/probe set Forward primer: 1 bp mis-match Forward primer: 1 bp mis-match Probe: 2 bp mis-matches Probe: 2 bp mis-matches Reverse primer: none Reverse primer: none

GLP survey 2007 survey composed of 73 questions 2007 survey composed of 73 questions 2008 survey composed of 25 questions 2008 survey composed of 25 questions 2010 survey composed of 32 questions 2010 survey composed of 32 questions Questions on the following seven categories: Questions on the following seven categories: personnelpersonnel quality managementsquality managements design, equipment and consumablesdesign, equipment and consumables pre-analytical procedurespre-analytical procedures analytical proceduresanalytical procedures post-analytical procedurespost-analytical procedures reporting and record keepingreporting and record keeping safetysafety

Molecular diagnosis (PCR) & Good laboratory practice (GLP) Laboratories returning completed GLP survey forms ( 96%) (82%) (89%)

Good laboratory practices More than 80% of laboratories Separate work room for molecular diagnosis (99%) Separate set of equipment and consumables in each working area (94%) Equipment maintenance programme (87%) Control materials for molecular diagnosis (100%) Standard operating procedures (94%) Separate work room for molecular diagnosis (99%) Separate set of equipment and consumables in each working area (94%) Equipment maintenance programme (87%) Control materials for molecular diagnosis (100%) Standard operating procedures (94%) Less than 80% of laboratories Evaluation of the reagents used for molecular tests (67%) Evaluation of the sensitivity/specificity of the molecular tests (59%) Internal audit programme (54%) Accredited by international/national scheme (34%) Countercheck results (78%) Evaluation of the reagents used for molecular tests (67%) Evaluation of the sensitivity/specificity of the molecular tests (59%) Internal audit programme (54%) Accredited by international/national scheme (34%) Countercheck results (78%) Data from GLP survey 2010

GLP and EQAP performance Compare GLP with EQAP results Group A (laboratories returned correct answers for all 10 samples) Group B (laboratories returned less than 10 corrects answers) Laboratories with less good performance (Group B) Lab did not return all correct results tends to meet less quality parameters; significantly more likely (p < 0.05) not having - audits of personnel - separate rooms for all steps involving PCR - programme to monitor equipment - more samples in recent representative month - SOP on preparation of in-house controls - established test turn-around-time

Reagents/tests evaluation, internal audit and accreditation in laboratories of different WHO regions Data from GLP survey 2010

The way forward Review Review - materials for simulated specimens/scope - type/subtype/clade to include in the panel - frequency of shipment Enhance performance through training Enhance performance through training Accreditation by recognized authority Accreditation by recognized authority

Thank You