cap.org v. 1 Gynecologic Consensus Conference Topic Group 3: GYN Workload Limits June 4, 2011

Although the issue of workload was not included in the original survey questions, this workgroup recognizes that workload is an area of cytology laboratory quality that warrants further discussion. Evaluation of individual workload assessments, as well as laboratory daily screening limits, have been questioned. Background © 2011 College of American Pathologists. All rights reserved. 2

Workload Limits mandated by CLIA were established to prevent excessive workloads, which could decrease sensitivity and result in false negative results. Current literature suggests that workload limits should be reevaluated, based on daily screening sensitivity and laboratory abnormal rates. Background © 2011 College of American Pathologists. All rights reserved. 3

The American Society of Cytopathology (ASC) Productivity and Quality Assurance in the Era of Automated Screening Task Force has compiled preliminary recommendations for imaged guided screening workloads This committee is presenting for discussion: o A summary of the ASC preliminary recommendations for automated screening o Items for consideration for manual (non-imaged guided) screening Background © 2011 College of American Pathologists. All rights reserved. 4

Cytotechnologists’ screening time should not exceed 7 hours in an 8-hour work shift, provided there are no additional duties or distractions, and should not exceed 7 hours in a 24 hour day. o Based on the ARTISTIC Trial and other literature indicating sensitivity decreases below 95% after 5 hours of screening in a work day. o In comparison, US studies show a sensitivity of 80-85% when screening for an entire work day. Kitchener HC, et al. Lancet Oncol2009 Jul;10(7): Ellis K, et al. Diagn Cytopathol 2010 Nov 2. Wilbur DC, et al. Am J Clin Pathol2009 Nov;132(5): Biscotti CV, et al. Am J Clin Pathol2005;123: Discussion: Preliminary ASC Recommendation #1 © 2011 College of American Pathologists. All rights reserved. 5

Recommendation #1: Cytotechnologists’ screening time should not exceed 7 hours in an 8-hour work shift, provided there are no additional duties or distractions, and should not exceed 7 hours in a 24 hour day. 61.Do you agree with recommendation #1? A.Yes86.67% B.No11.67% C.Other1.67% Voting © 2011 College of American Pathologists. All rights reserved. 6

Workload limits should not be extrapolated to 8 hrs of screening, rather it should take into account screening time plus necessary mini breaks. o Workload limits set for the FDA TIS trial and BD FocalPoint GS were based on extrapolated data o Literature suggests that these limits are too high and sensitivity decreases after 4 hours for most cytotechnologists ThinPrep Imaging System. Package Insert Becton Dickinson Co. BD FocalPoint GS Imaging System Package Insert. Biscotti CV, et al. Am J Clin Pathol2005;123:281-7 Elsheikh T, et al. Cancer Cytopathol2010;118:75-82 Discussion: Preliminary ASC Recommendation #2 © 2011 College of American Pathologists. All rights reserved. 7

Recommendation #2: Workload limits should not be extrapolated to 8 hrs of screening, rather it should take into account screening time plus necessary mini breaks. 62.Do you agree with recommendation #2? A.Yes96.67% B.No3.33% Voting © 2011 College of American Pathologists. All rights reserved. 8

Although the False Negative Rate (FNR) is not an ideal measurement, it should be calculated at the ASCUS (not LSIL) threshold, if utilized by the laboratory. o No studies have used the FNR as a successful primary measure of screening sensitivity. o Rare studies show the results of FNR calculated at the threshold of ASCUS correlate with other measures associated with sensitivity. o Performance of screening for LSIL may not be a good surrogate for screening of other more significant lesions Elsheikh T, et al. Cancer Cytopathol2010;118:75-82 Renshaw AA, et al. Arch Pathol Lab Med2006;130: Renshaw AA, et al. Arch Pathol Lab Med2005;129: Renshaw AA,et al. Arch Pathol Lab Med2006;130: Renshaw AA, et al. Arch Pathol Lab Med2005;129:23-5 Discussion: Preliminary ASC Recommendation #3 © 2011 College of American Pathologists. All rights reserved. 9

Recommendation #3: Although the False Negative Rate (FNR) is not an ideal measurement, it should be calculated at the ASCUS (not LSIL) threshold, if utilized by the laboratory. 63.Do you agree with recommendation #3? A.Yes68.52% B.No22.22% C.Other9.26% Voting © 2011 College of American Pathologists. All rights reserved. 10

The average laboratory cytotechnologist productivity should not exceed: 80 slides/day using the new FDA/CLIA/CAP recommendations for calculating workload (imaged slide only = 0.5 slide, full manual review = 1.0 slide, imaged + manual review = 1.5 slide) Or 100 slides/day, where all examined slides (imaged or not) are counted as 1.0 slides o Studies that document the move from manual to automated screening show a consistent increase in ECA sensitivity when workload is restricted to these values, and a consistent decrease in ECA sensitivity when workload exceeds these limits. o Studies examining ECA rate when cytotechnologists increase their workload over a relatively short time period show a decrease in ECA rate above these limits. Renshaw AA, et al. Diagn Cytopathol2010 Oct 13 Elsheikh T, et al. Cancer Cytopathol2010;118: Levi A, et al. Cancer Cytopathol2010;118:307. Discussion: Preliminary ASC Recommendation #4 © 2011 College of American Pathologists. All rights reserved. 11

Recommendation #4: Do you: A.Agree with statement as is32.61% B.Agree with FDA only32.61% C.Agree with 100/day only26.09% D.Disagree with the whole statement 8.70% Voting © 2011 College of American Pathologists. All rights reserved. 12

The percentage of imaged slides that undergo full manual review should be at least either 15%, or twice (2x) the epithelial cell abnormality (ECA) rate, whichever is greater. o Recommendation based on survey data presented at the 2009 ASC Annual Scientific meeting. The majority of laboratories manually review at least 15% of cases. Miller FN. What is a Reasonable and Realistic Workload Limit in the Age of Image-Assisted Pap Testing? ASC Annual Scientific Meeting, Nov 16, 2009 Discussion: Preliminary ASC Recommendation #5 © 2011 College of American Pathologists. All rights reserved. 13

Recommendation #5: The percentage of imaged slides that undergo full manual review should be at least either 15%, or twice (2x) the epithelial cell abnormality (ECA) rate, whichever is greater. 65.Do you agree with recommendation #5? A.Yes72.41 B.No22.41% C.Other5.17% Voting © 2011 College of American Pathologists. All rights reserved. 14

The Epithelial Cell Abnormality (ECA)-adjusted workload measure is a promising new method for calculating and monitoring cytotechnologist workload, and can be correlated to desired laboratory screening sensitivity. This method may be especially useful in the setting of higher ECA rates. Further studies of this method are encouraged before full endorsement of this method, by this task force, is issued. o ECA-adjusted workload is the only measure that has been directly correlated with screening sensitivity. o ECA-adjusted workload has been shown to directly correlate with screening sensitivity at the level of ASCUS, LSIL, and HSIL in the FDA TIS trial and when comparing manual and automated screening to assess the workload cut off in Recommendation #4 Renshaw AA, Elsheikh TM. Diagn Cytopathol2010 Nov 22. Renshaw AA, et al. Diagn Cytopathol2010 Oct 13 Elsheikh T, et al. Cancer Cytopathol2010;118: Levi A, et al. Cancer Cytopathol2010;118:307. Discussion: Preliminary ASC Recommendation #6 © 2011 College of American Pathologists. All rights reserved. 15

66.Should the ECA adjusted workload measure be further investigated A.Yes87.27% B.No12.73% Voting © 2011 College of American Pathologists. All rights reserved. 16

Cytotechnologist productivity and workload limits are just one aspect of a good quality assurance program in a cytology laboratory. Other quality indicators to assess cytotechnologist performance (screening not interpretation) should be implemented. The other quality indicators, many of which of will be discussed and voted on today, are also important components in determining screening limits. Discussion: Preliminary ASC Recommendation #7 © 2011 College of American Pathologists. All rights reserved. 17

Although there are studies documenting the utility of the recommended measures for general QA, few correlate them with screening sensitivity No current studies correlate these QA measures with workload. Renshaw AA, et al. Diagn Cytopathol2010(38): Renshaw AA, et al. Cytojournal2009;6:19 Discussion: Preliminary ASC Recommendation #7 © 2011 College of American Pathologists. All rights reserved. 18

67.Should QA and workload correlation be further investigated? A.Yes94.55% B.No 5.45% Voting © 2011 College of American Pathologists. All rights reserved. 19

Anecdotal evidence suggests that most cytotechnologists cannot achieve adequate sensitivity at workloads set at the upper limit of the CLIA workload limit. Many of the suggested recommendations for imaged-guided workload are also appropriate for manual screening: o Recommendation #1 o Recommendation #2 o Recommendation #3 o Recommendation #6 o Recommendation #7 In addition Renshaw AA, et al. Diagn Cytopathol 2010 Nov 22 Discussion: Additional recommendations for manual workload © 2011 College of American Pathologists. All rights reserved. 20