1. Second Language Writers and The Machine Scoring of Essays Deborah Crusan Wright State University

2. Agenda Define Discuss Consider

3. But first, we must remember "For there is nothing either good or bad, but thinking makes it so." ~ William Shakespeare (1564-1616), Hamlet, II.ii

4. So... What is machine scoring Computer technology that evaluates and scores written prose (Shermis & Burstein, 2003) web-based scores and responds in seconds.

6. Some Machine Scoring Software CompanyScoring EngineTechniqueInstructional Program Scoring ETSe-rater ® Natural Language Processing CriterionSingle holistic score PearsonIntelligent Essay Assessor (IEA) Latent Semantic Analysis WriteToLearnHolistic and component scoring Vantage Learning Table adapted from Dikli (2006) Warschauer & Ware (2006) IntelliMetric ™ Artificial Intelligence MY Access! (and others) Holistic and component scoring

7. How does it work?

8. Artificial Intelligence (AI) Latent Semantic Analysis (LSA) Natural Language Processing (NLP)

9. Recognized Machine Scoring Platforms https://www.ets.org/criterion

10. Recognized Machine Scoring Platforms

12. Positive features Objective Consistent Broad in scope High stakes testing environment

13. The trouble with humans

14. DESKILLING OF TEACHERS AUDIENCE INADEQUATE DESCRIPTION OF ELL ERRORS BORROWING SOCIAL ASPECTS OF WRITING ONE DRAFT WONDERS

17. For a complete reference list, contact deborah.crusan@wright.edu