What is CCT? CBT = Computer-Based Testing CCT = Computerized Classification Test Competent or Not Competent? Focus on measurement precision near cut score Focus on reliability of decision

The Testing Programs Program# Items # Pretest Items Time allowed RD hours DTR hours (CBT since 9/1/99)

The Testing Programs Program Total # Items Minimum sec./item Avg. Item Latency RD sec.46 sec. DTR sec.51 sec.

The Testing Blueprints Content RDDTR Food & Nutrition15%10% Nutrition Srvcs: Commun./Clinical 40%38% Educ. (& Research) 7% Foodservice Sys.18%25% Management20%

The Testing Programs Program Total # Examinees/yr. % Passing RD4,22172% DTR35157%

Sequential Probability Ratio Test (SPRT) RDDTR Min. Ability Level Zone of Indifference+/-0.20 Acceptable Error Rate5%

The Pros Candidates love instant results! Helps control item exposure (esp. with no review) Year-round testing provides more flexibility - more locations Computer testing provides more potential for creativity - fidelity

The Cons Quality control usually = once/yr. Item analysis/review corrective “for next time” - not linked to candidate score Expense Sometimes variable-length test seen as disadvantage

Security Considerations Innocent Conversations Internet Brain Dump sites Test Prep Agencies Technology (text message, camera phones, tie cams)

Item Exposure Over-exposure of items at popular ability levels Computer routines to control item over- exposure (Simpson-Header Control)

Challenges Small sample size = Hard to get sufficient N for item analysis Small sample size = Hard to get sufficient N for pretest items Small sample size = Hard to get sufficient $ for program

Text Future? More candidates! Dietetics Education Task Force Minimum for 3 Parameter = 300? Rasch?