Presentation is loading. Please wait.

Presentation is loading. Please wait.

What is CCT? CBT = Computer-Based Testing CCT = Computerized Classification Test Competent or Not Competent? Focus on measurement precision near cut score.

Similar presentations


Presentation on theme: "What is CCT? CBT = Computer-Based Testing CCT = Computerized Classification Test Competent or Not Competent? Focus on measurement precision near cut score."— Presentation transcript:

1

2 What is CCT? CBT = Computer-Based Testing CCT = Computerized Classification Test Competent or Not Competent? Focus on measurement precision near cut score Focus on reliability of decision

3 The Testing Programs Program# Items # Pretest Items Time allowed RD100-120253 hours DTR80-100303 hours (CBT since 9/1/99)

4 The Testing Programs Program Total # Items Minimum sec./item Avg. Item Latency RD125-14574 sec.46 sec. DTR110-13083 sec.51 sec.

5 The Testing Blueprints Content RDDTR Food & Nutrition15%10% Nutrition Srvcs: Commun./Clinical 40%38% Educ. (& Research) 7% Foodservice Sys.18%25% Management20%

6 The Testing Programs Program Total # Examinees/yr. % Passing RD4,22172% DTR35157%

7 Sequential Probability Ratio Test (SPRT) RDDTR Min. Ability Level-0.69-0.34 Zone of Indifference+/-0.20 Acceptable Error Rate5%

8 The Pros Candidates love instant results! Helps control item exposure (esp. with no review) Year-round testing provides more flexibility - more locations Computer testing provides more potential for creativity - fidelity

9 The Cons Quality control usually = once/yr. Item analysis/review corrective “for next time” - not linked to candidate score Expense Sometimes variable-length test seen as disadvantage

10 Security Considerations Innocent Conversations Internet Brain Dump sites Test Prep Agencies Technology (text message, camera phones, tie cams)

11 Item Exposure Over-exposure of items at popular ability levels Computer routines to control item over- exposure (Simpson-Header Control)

12 Challenges Small sample size = Hard to get sufficient N for item analysis Small sample size = Hard to get sufficient N for pretest items Small sample size = Hard to get sufficient $ for program

13 Text Future? More candidates! Dietetics Education Task Force Minimum for 3 Parameter = 300? Rasch?

14


Download ppt "What is CCT? CBT = Computer-Based Testing CCT = Computerized Classification Test Competent or Not Competent? Focus on measurement precision near cut score."

Similar presentations


Ads by Google