1. Tools & Resources for the ELL Classroom from ETS Annabelle Galera Simpson Regional Director Latin America & ETS Global Institute

2. One Company, Two Families
TOEFL® family of products
TOEFL ® iBT
TOEFL ® ITP
TOEFL ® Jr
TOEIC® family of products
- TOEIC ® Listening & Reading
- TOEIC ® Speaking & Writing
- TOEIC Bridge ™
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

3. English Language Tools for Students & Teachers

4. Tools for Students and Teachers from ETS… and the TOEFL® Family of Products
English Language Learning Tools:
TOEFL Practice Online
The Official Guide to the New TOEFL iBT
CriterionSM Online Writing Evaluation
Engaging English ™
PROPELL ™ Workshop for TOEFL iBT™
Coming Soon: Official Guide in Spanish for TOEFL ITP
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

5. TOEFL Practice Online - Product Overview
TOEFL Practice Online (TPO) is the official TOEFL iBT test practice website –
Offers a variety of practice tests)
Consists of previously administered TOEFL iBT test questions
Helps prepare students for test day in several ways:
Anytime, anywhere Web browser access
Option to practice in one of 2 modes - timed or untimed
Simulates the real TOEFL iBT testing experience
Provides instant scores & predicts performance feedback on test day
Provides targeted practice of skill student needs to improve
Resource in Colombia: IN Other Words, S.A.; ETS website – “Value Packs”
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

6. Official Guide to the New TOEFL® iBT
Published for ETS by McGraw-Hill
Book with 500 real TOEFL iBT practice questions
A companion audio CD with authentic TOEFL iBT
Listening passages and students’ spoken responses
ETS raters’ comments to student spoken and written responses
Special rates for Latin America!
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

7. Criterionsm Online Writing Evaluation
is a web-based instructional tool
that helps students plan, write, and revise essays
provides - instant scoring with annotated diagnostic feedback
This is the key descriptive slide for Criterion. Emphasis points:
a comprehensive tool which helps students with the three essential tasks which drive writing improvement: planning, writing, revising. Recent research suggests that planning plays just as important a role as revising drafts in helping students to produce better quality writing.
an instructional tool which assists the instructor in teaching students how to plan, write, and revise their work by offering instructor-driven guidance for all three stages of the writing process.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

8. Overview- The CriterionSM Approach
Comprehensive writing instructional tool that guides students through each stage of the writing process:
Planning to write — students choose one of eight prewriting tools to assist in the planning process
Writing the essay — instructors select topics and parameters for each assignment
Revising the essay — students respond to specific annotated feedback in five key areas: Grammar, Usage, Mechanics, Style, and Organization & Development
This is the key descriptive slide for Criterion. Emphasis points:
a comprehensive tool which helps students with the three essential tasks which drive writing improvement: planning, writing, revising. Recent research suggests that planning plays just as important a role as revising drafts in helping students to produce better quality writing.
an instructional tool which assists the instructor in teaching students how to plan, write, and revise their work by offering instructor-driven guidance for all three stages of the writing process.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

9. How Criterion Works?
As an instructional and assessment tool based on technology derived from ETS research on Natural Language Processing.
The patented e-rater® scoring engine was developed at ETS to provide both annotated diagnostic feedback and holistic scoring based on level-specific models built from essays pre-scored by ETS-trained readers.
When compared with a human scorer, the e-rater ® scoring engine generally provides holistic scores that are more than 92% in agreement with human scores.
The emphasis should be on Criterion as an instructional tool to be used collaboratively by instructors and students to improve student writing. The holistic score provides an overall comparative score, which can be used to motivate the student by showing improvement from revision to revision, but this is secondary to its use as an instructional tool and is never to be used as a sole evaluation of student writing ability. The assessment provided in Criterion includes both the individuated diagnostic feedback and the holistic score.
The computer-generated holistic score is aligned to each grade/level based on models built from essays previously scored by human readers. Holistic scoring is NEVER to be equated with a grade or mark which takes into account everything about the essay, including content, which Criterion cannot evaluate. The Criterion score reflects the overall quality of the writing, comparing it to other essays written at that grade/level. It is a single numerical score given to the essay as a whole. Scores range from 1 to 6 or 1 to 4, with 1 being the lowest score.
The agreement between one human scorer and Criterion is slightly better than the agreement between two human scorers. Depending on the study, the agreement is shown anywhere from 92 to 98%. Remember, “agreement” refers to the same holistic score or no more than one point difference between the two scores. Thus if Criterion gives an essay a 4 out of 6, and a human scorer gives the essay either a 3 out of 6 or a 5 out of 6, this is still considered “agreement.”
E-rater® is an ETS proprietary automated engine which provides diagnostic trait feedback in five key categories: Grammar, Usage, Mechanics, Style and Organization & Development, which are used by the student to guide the process of revision.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

10. The CriterionSM service provides:
Unlimited assignments — the number of student submissions is determined by the instructor
Unlimited number of instructors who can use the program in their classes
Unlimited control over scoring and feedback provided to students
Unlimited instructor-created topics
Criterion is designed to supplement writing instruction and expands opportunities for students to practice writing and receive reliable feedback based on widely accepted standards.
Criterion gives instructors the power and flexibility to choose assignments from the topics library or create their own Scored Instructor Topics and tailor the kinds of feedback and scoring the students will see.
The entire Criterion library of writing prompts features topics developed by both classroom instructors and writing experts. 10 10

11. What the Instructor Does
Creates all assignments and provides writing instruction for the class as a whole
Provides instructor feedback which addresses the higher writing skills such as idea or voice
Makes instructor comments which address individual student problems and focus on issues addressed in the class
Evaluates the content of submitted essays in ways that only an instructor can provide
Guides the overall process of revision
This slide differentiates what Criterion does from what needs to be done by the instructor. Criterion does not read like students and instructors and thus cannot focus on essay content. It cannot “know” the overall strengths and weaknesses of individual students. Criterion’s concentration on grammar, usage and mechanics errors and comments which evaluate style and organization, allows the instructor to spend more class time explaining and working with the higher writing skills, including such elements as “Idea” or “Voice.”
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

12. What the Student Does
Responds to assignments as directed by the instructor
Proofreads and corrects all work before submitting it for evaluation
Reviews all feedback both from Trait Feedback and from instructor comments and asks for clarification where necessary
Uses the Writer’s Handbook which provides additional instruction for problem areas
Revises the essay based on feedback provided
Continues the process of revision until the essay is satisfactory both to the student and the instructor
Internalizes lessons learned before proceeding to next assignment
By describing what the student responsibility is when using Criterion, you are actually emphasizing how good writing instruction depends on involvement from both student and instructor, which helps guide and is guided by the Criterion tool.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

13. Topic Modes Persuasive Descriptive Narrative Expository
Cause and Effect
Comparison and Contrast
Process
Argument
Issue
The Criterion comprehensive library offers topics that span a broad range of writing modes usually included in writing instruction programs.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

14. Using the Topics Library to Create an Assignment
Choose <Essay Topic Category> (= grade/level)
Choose <Topic Mode>, if you wish
Under <Essay Topics>, choose a topic by name
Click <View All Topics> to see details for all topics in library
3.2 This is the basic and easiest kind of assignment to create. Can be done in under 10 seconds once you are used to working with available possibilities.
The Essay Topic Category fixes the grade/level against which submitted essays will be compared. This both tells instructor what level they have chosen for scoring and also “tells” e-rater which scoring model to use.
They may choose a specific topic mode, but to see all available assignments at that grade level, leave Topic Mode set to “All Modes.”
The “View All Topics” button will take them to the full list of topics in the Criterion Topics Library. They need to choose the same graded level they chose for Essay Topic Category to see the topics at that grade level.
For each topic they will see: name of topic, mode of topic, text of prompt as students will see it on the assignment, and scoring guide (click on yellow banner) for both four- and six-point scoring.
When they have decided which topic they want to create, they merely close the Topics Library screen which is covering the Create Assignment page and choose that topic by name from the drop-down box. 14 14

15. Trait Feedback Categories
Grammar
Usage
Mechanics
Style
Org/Dev
Fragment or missing comma
Run-on Sentences
Wrong or missing word
Garbled sentences
S-V agreement
Ill-formed verb
Pronoun error
Missing possessive
Wrong article
Missing article
Nonstandard verb or word form
Confused words
Wrong word form
Faulty comparisons
Spelling
Capitalization of proper nouns
Initial capitalization in a sentence
Missing question mark
Missing apostrophe for contractions
Missing end punctuation
Comma error
Fused words
Compound words
Duplicates
Repetition
Inappropriate words
Sentences containing passive voice
Long sentences
Short sentences
Sentences beginning with coordinating conjunctions
Essay statistics
Number of words
Number of sentences
Avg. number of words in sentence
Introductory material
Thesis statement
Topic relationship
Technical Quality
Main ideas
Supporting ideas
Conclusion
Transitional words and phrases
Other
If the Criterion scoring engine identifies a specific error from the above list it will appear in bold-face with an indication of how many such errors a student has made in this individual essay. If the student clicks on the bold-faced error it will appear highlighted in the student’s essay. Rolling over the highlighted error will bring up a window which identifies the error and offers suggestions for correction. Further instruction is available to the student from the context-sensitive Writer’s Handbook.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

16. Engaging English™
Facilitates reading skill development using Lexile ® reading tool
Choose online reading material tracked to Lexile
Measures progress toward desired Reading level
Suggest appropriate readings, texts, etc.
See for more information 16 16

17. PROPELL ™ Workshops for the TOEFL iBT Test™
An interactive all-day workshop that helps you build a curriculum based on TOEFL iBT learning objectives and related classroom activities.
Local resources:
Centro Colombo Americano – Medellin
Sandra Caceres, ETS Consultant for Colombia
Next scheduled 2010 workshops:
September: Santiago, Chile; Sao Paulo, Brazil
This slide describes the two basic types of assignment possible in Criterion.
to create topics from the Topics Library at Grade Level or from special categories (state specific in CA and TX, GRE and TOEFL topics).
Note that not all of the TX and CA topics will produce a score since insufficient essays were collected to build a model. These are identified as “No holistic score” on the Create Assignments page. If a customer wants scoring they need to copy and paste the topic into a Scored Instructor Topic to receive scoring.
to use the < Scored Instructor Topic> option in three possible ways:
To create your own topic
To copy and paste a topic from the topics library or any public domain topic and then edit it if you wish
To change the scoring level of a previously created topic 17 17

18. TOEIC® Family of Products

19. TOEIC® Tools Pronunciation Idioms in English Assessments
TOEIC Test – assessment of English listening and reading skills for the workplace
TOEIC Speaking and Writing Tests – assessment of English speaking and writing skills for the workplace (available in Latin America 2009)
TOEIC Bridge – assessment of everyday English Skills
Test Practice
Tactics for TOEIC – Speaking and Writing (Print)
Tactics for TOEIC – Listening and Reading (Print)
Coming Soon: Official Guide in Spanish for classic TOEIC;
Official Guide in Spanish for TOEIC Bridge
AmEnglish (Download and Smart Phone application)
Writing
Pronunciation
Idioms in English
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

20. AmEnglish - Writing in English
Interactive multimedia program that Helps learners improve their written English skills
Focuses on helping users write in English more clearly and concisely while sharpening English grammar and syntax skills for the TOEFL® and TOEIC® tests.
More than 200 screens of interactive lessons and practices
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

21. AmEnglish - Pronunciation in English
Interactive multimedia program that improves pronunciation skills for non-native speakers of English
Focuses on how to identify and use the most important elements of pronunciation: stress, intonation and rhythm
130 interactive (30 hours) lessons and practice activities
Suitable for individual use, classroom use, training and distance learning.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

22. AmEnglish - Idioms in English
Interactive program designed for to help non-native English speakers “get up to speed” and communicate like a native speaker.
Understanding idioms is critical for success.
Improves listening, vocabulary, comprehension and speech.
Self-study or classroom use program featuring one hundred current idioms in English.
220 lessons, final quiz, scoring.
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.

23. PROPELL ™ Workshops for Teachers, TOEIC
Workshops for TOEIC Listening & Reading
Workshops for TOEIC Speaking & Writing
Workshops for TOEIC Bridge
Day-long interactive workshops focusing on learning objectives and activities linked to specific English language skill development.
Resource in Colombia: IN Other Words, S.A.
Resource in Cali: English World tel
Next 2010 workshops:
September: Sao Paulo, Brazil; Santiago, Chile
October: Bogota, Colombia 23
Confidential and Proprietary. Copyright ©2006 Educational Testing Service. 23

24. Questions? www.ets.org asimpson@ets.org
Confidential and Proprietary. Copyright ©2006 Educational Testing Service.