1. June 09 Testing: Back to Basics. Abdellatif Zoubair Abdellatif Zoubairzoubair2@hotmail.com

2. June 09 Outline 1. Definition 1. Definition 2. Main principles 2. Main principles 3. Test types 3. Test types 4. Test design procedure 4. Test design procedure 5. Use of statistics 5. Use of statistics 6. Technolgy and testing 6. Technolgy and testing 7. Bibliography 7. Bibliography

3. June 09 I. Definition: « a...... of measuring a person’s ability,.......... or........... in a given........ «

4. June 09 « a method of measuring a person’s ability, knowledge or performance in a given knowledge or performance in a given domain. » domain. » D. Brown, 2004. D. Brown, 2004.

5. June 09 Terminolgy -Performance vs knowledge -Quiz vs test -Testing vs assessment -Assessment vs evaluation

6. June 09 II. Main principles 1. Usefulness 1. Usefulness 2. Practicality 2. Practicality 3. Validity 3. Validity 4. Reliability 4. Reliability 5. Authenticity 5. Authenticity

7. June 09 Main principles (cont’d) 6. Transparency 6. Transparency 7. Washback 7. Washback 8. Security 8. Security 9. Fairness 9. Fairness 10.... 10....

8. June 09 III. Taxonomies a. Henning (1987): a. Henning (1987): 1. Diagnosis and feedback 2. Screening and selection 3. Placement 4. Program evaluation 5. Providing research criteria 6. Assessment of attitudes and socio- psychological differences

9. June 09 b. Alderson, Clapham and Wall (1995): b. Alderson, Clapham and Wall (1995): 1. placement 1. placement 2. progress 2. progress 3. achievement 3. achievement 4. proficiency 4. proficiency 5. diagnostic 5. diagnostic

10. June 09 c. objective vs. subjective tests c. objective vs. subjective tests d. high- vs. low-stakes tests d. high- vs. low-stakes tests e. formative vs summative e. formative vs summative -..... -.....

11. June 09 h. Traditional vs. Alternative Assessment. Refer to comparative chart Refer to comparative chart

12. June 09 Types: -self-assessment -self-assessment -portfolios -portfolios -student-designed tests -student-designed tests -projects -projects -presentations -presentations -.... -....

13. June 09 IV. Test design procedure: a. planning: a. planning: -decide on purpose -decide on purpose -check course content -check course content -write specifications -write specifications

14. June 09 b. development: b. development: -format -format -grading -grading -piloting -piloting

15. June 09 c. administration: c. administration: -test conditions and procedures -test conditions and procedures -organize equipment needed -organize equipment needed

16. June 09 d. post-test d. post-test -grading -grading -statistics -statistics -item analysis -item analysis -reporting -reporting

17. June 09 e. reflection: e. reflection: -purpose -purpose -validity and reliability -validity and reliability -future changes -future changes

18. June 09 V. Statistics: a. what a. what b. rationale: b. rationale: -information on students' performance -information on students' performance -test reliability -test reliability -course content -course content -teaching -teaching

19. June 09 c. how: c. how: -the mean -the mean -the pass/failure rate -the pass/failure rate -histograms -histograms -..... -.....

20. June 09 VI. Technology and testing a. history: a. history: -1935: IBM model 805 -1935: IBM model 805 -1970: Book on computerized testing -1970: Book on computerized testing (Holtzman) (Holtzman) -... ? -... ?

21. June 09 b. main uses: b. main uses: -CMT/CAT -CMT/CAT -CBT -CBT -CAT -CAT -Web/internet-based testing -Web/internet-based testing

22. June 09 VII. Bibliography: -Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. Test Construction and Evaluation. Cambridge, U.K.: Cambridge University Press. -Alderson, J. Charles, Caroline Clapham and Dianne Wall. 1995. Test Construction and Evaluation. Cambridge, U.K.: Cambridge University Press. -Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing. Oxford, U.K.: Oxford University Press. -Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing. Oxford, U.K.: Oxford University Press. -Brown, H.D. 2004. Language Assessment: Principles and classroom practices. New York: Pearson Longman. -Brown, H.D. 2004. Language Assessment: Principles and classroom practices. New York: Pearson Longman. -Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to Assessing English Language Learners. Ann Arbor, MI.: University of Michigan Press. -Coombe, C., Folse, K., & Hubley, N. (2007). A Practical Guide to Assessing English Language Learners. Ann Arbor, MI.: University of Michigan Press.

23. June 09 -Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – 107. -Fulcher, G. Computers in Language Testing. In Brett, P. and G. Motteram (Eds) 2000, A Special Interest in Computers. Manchester: IATEFL Publications, 93 – 107. -Fulcher, G. & Davidson, F. 2007. Language Testing and Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series. -Fulcher, G. & Davidson, F. 2007. Language Testing and Assessment: An Advanced Resource Book. Routledge Applied Linguistics Series. - Fulcher, G. 1995. The Language Tester's Guide to Cyberspace. Language Testing Update July 1995, 17, 62 - 65. Last updated: 9th June 2008. Also available at: http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#top - Fulcher, G. 1995. The Language Tester's Guide to Cyberspace. Language Testing Update July 1995, 17, 62 - 65. Last updated: 9th June 2008. Also available at: http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#top http://www.le.ac.uk/education/testing/ltrfile/cybertxt.html#top

24. June 09 -Fulcher, G. Resources in Language Testing (website) (http://www.dundee.ac.uk/languagestudies/ltest/ltr.html) -Fulcher, G. Resources in Language Testing (website) (http://www.dundee.ac.uk/languagestudies/ltest/ltr.html)http://www.dundee.ac.uk/languagestudies/ltest/ltr.html -Heaton, J. B. 1988. Writing English Language Tests. Harlow, England:Longman Press. -Heaton, J. B. 1988. Writing English Language Tests. Harlow, England:Longman Press. -Hughes, Arthur. 2003. Testing for Language Teachers (2nd Edition). Cambridge, U.K.: Cambridge University Press. -Hughes, Arthur. 2003. Testing for Language Teachers (2nd Edition). Cambridge, U.K.: Cambridge University Press.

25. June 09 Thank you for your patience! Thank you for your patience!