June 09 Testing: Back to Basics. Abdellatif Zoubair Abdellatif

June 09 Outline 1. Definition 1. Definition 2. Main principles 2. Main principles 3. Test types 3. Test types 4. Test design procedure 4. Test design procedure 5. Use of statistics 5. Use of statistics 6. Technolgy and testing 6. Technolgy and testing 7. Bibliography 7. Bibliography

June 09 I. Definition: « a of measuring a person’s ability, or in a given «

June 09 « a method of measuring a person’s ability, knowledge or performance in a given knowledge or performance in a given domain. » domain. » D. Brown, D. Brown, 2004.

June 09 Terminolgy -Performance vs knowledge -Quiz vs test -Testing vs assessment -Assessment vs evaluation

June 09 II. Main principles 1. Usefulness 1. Usefulness 2. Practicality 2. Practicality 3. Validity 3. Validity 4. Reliability 4. Reliability 5. Authenticity 5. Authenticity

June 09 Main principles (cont’d) 6. Transparency 6. Transparency 7. Washback 7. Washback 8. Security 8. Security 9. Fairness 9. Fairness

June 09 III. Taxonomies a. Henning (1987): a. Henning (1987): 1. Diagnosis and feedback 2. Screening and selection 3. Placement 4. Program evaluation 5. Providing research criteria 6. Assessment of attitudes and socio- psychological differences

June 09 b. Alderson, Clapham and Wall (1995): b. Alderson, Clapham and Wall (1995): 1. placement 1. placement 2. progress 2. progress 3. achievement 3. achievement 4. proficiency 4. proficiency 5. diagnostic 5. diagnostic

June 09 c. objective vs. subjective tests c. objective vs. subjective tests d. high- vs. low-stakes tests d. high- vs. low-stakes tests e. formative vs summative e. formative vs summative

June 09 h. Traditional vs. Alternative Assessment. Refer to comparative chart Refer to comparative chart

June 09 Types: -self-assessment -self-assessment -portfolios -portfolios -student-designed tests -student-designed tests -projects -projects -presentations -presentations

June 09 IV. Test design procedure: a. planning: a. planning: -decide on purpose -decide on purpose -check course content -check course content -write specifications -write specifications

June 09 b. development: b. development: -format -format -grading -grading -piloting -piloting

June 09 c. administration: c. administration: -test conditions and procedures -test conditions and procedures -organize equipment needed -organize equipment needed

June 09 d. post-test d. post-test -grading -grading -statistics -statistics -item analysis -item analysis -reporting -reporting

June 09 e. reflection: e. reflection: -purpose -purpose -validity and reliability -validity and reliability -future changes -future changes

June 09 V. Statistics: a. what a. what b. rationale: b. rationale: -information on students' performance -information on students' performance -test reliability -test reliability -course content -course content -teaching -teaching

June 09 c. how: c. how: -the mean -the mean -the pass/failure rate -the pass/failure rate -histograms -histograms

June 09 VI. Technology and testing a. history: a. history: -1935: IBM model : IBM model : Book on computerized testing -1970: Book on computerized testing (Holtzman) (Holtzman) -... ? -... ?

June 09 b. main uses: b. main uses: -CMT/CAT -CMT/CAT -CBT -CBT -CAT -CAT -Web/internet-based testing -Web/internet-based testing

June 09 VII. Bibliography: -Alderson, J. Charles, Caroline Clapham and Dianne Wall Test Construction and Evaluation. Cambridge, U.K.: Cambridge University Press. -Alderson, J. Charles, Caroline Clapham and Dianne Wall Test Construction and Evaluation. Cambridge, U.K.: Cambridge University Press. -Bachman, Lyle F Fundamental Considerations in Language Testing. Oxford, U.K.: Oxford University Press. -Bachman, Lyle F Fundamental Considerations in Language Testing. Oxford, U.K.: Oxford University Press. -Brown, H.D Language Assessment: Principles and classroom practices. New York: Pearson Longman. -Brown, H.D Language Assessment: Principles and classroom practices. New York: Pearson Longman. -Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to Assessing English Language Learners. Ann Arbor, MI.: University of Michigan Press. -Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to Assessing English Language Learners. Ann Arbor, MI.: University of Michigan Press.

June 09 -Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – Fulcher, G. & Davidson, F Language Testing and Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series. -Fulcher, G. & Davidson, F Language Testing and Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series. - Fulcher, G The Language Tester's Guide to Cyberspace. Language Testing Update July 1995, 17, Last updated: 9th June Also available at: - Fulcher, G The Language Tester's Guide to Cyberspace. Language Testing Update July 1995, 17, Last updated: 9th June Also available at:

June 09 -Fulcher, G. Resources in Language Testing (website) ( -Fulcher, G. Resources in Language Testing (website) ( -Heaton, J. B Writing English Language Tests. Harlow, England:Longman Press. -Heaton, J. B Writing English Language Tests. Harlow, England:Longman Press. -Hughes, Arthur Testing for Language Teachers (2nd Edition). Cambridge, U.K.: Cambridge University Press. -Hughes, Arthur Testing for Language Teachers (2nd Edition). Cambridge, U.K.: Cambridge University Press.

June 09 Thank you for your patience! Thank you for your patience!