1. Audience: Teachers who will serve as TELPAS raters
Texas English Language Proficiency Assessment System (TELPAS): Holistic Rating Training
Audience: Teachers who will serve as TELPAS raters

2. General Information about TELPAS (p. 1)
Fulfills federal requirements for assessing English Language Learners (ELLs), K-12
Aligned with the Texas English Language Proficiency Standards (ELPS)
Results used in state and federal accountability and performance-based monitoring system

3. Holistically Rated Components of TELPAS (p. 1)
Grade Levels
Language Domains
K–1
Observational assessments in listening, speaking, reading, and writing
2–12*
Observational assessments in listening and speaking; writing collections for writing
*Online multiple-choice reading tests are used to assess the reading domain for grades 2–12.

4. Georgetown ISD Calendar of Events for TELPAS (p. 2 – Scheduling)
Dates
Administration procedures training for holistic component
By February 20
New raters complete online basic course (K-1 or Gr. 2-12)
By February 27
Returning raters review TELPAS basics (see Slide 30 for resources)
Before attempting calibration activities
All raters complete online calibration activities
February 20 – March 2
Collect samples for Gr writing collections
February 20 – March 30
Training for Gr TELPAS Online Reading Test
By March 16
TELPAS Assessment Window (holistically rating all ELLs & completing online reading test for Gr. 2-12)
March 19 – April 5
Campus Verifiers ensure that Gr writing collections meet all assembly criteria
March 26 – April 2
Extended Collection Window (if needed to collect more writing samples)
April 2 – 5
Extended Assessment Window (to rate/test ELLs in extenuating circumstances)
April 9 – 11
Deadline for CTCs to enter all holistic ratings in the Texas Assessment Management System
April 11 by 5:00 PM

5. Student & Test Data Submission for TELPAS (p. 2)
All information is submitted online, including:
Student Identification, Demographic, and Program Information (submitted by Assessment Dept., verified by campus personnel)
TELPAS Assessment Information (holistic ratings, rater information, reading accommodations used, reasons why a student could not be assessed as well as student-entered answers to reading tests for Gr. 2-12)

6. Eligibility Requirements (p. 2)
All ELLs in Gr. K-12, including ELLs with parent denials, are required to be assessed in all language domains, with the following exceptions:
ARD Decision: only in rare cases and made on a domain-by-domain basis as documented in the student’s IEP in conjunction with the LPAC
Newly Enrolled ELLs: students from another school district, state, or country who enroll on or after March 19 will not be assessed in the holistically rated domains; newly enrolled Gr students will take TELPAS reading test

7. Eligibility Requirements (p. 3)
Note: ELLs in Gr who first enter U.S. schools in the 2nd semester must now take the online reading test. In the past, we could automatically assign a rating of beginning and not test the student, but this is no longer allowed. All Gr ELLs must attempt the online reading test.

8. Test Security & Confidentiality Requirements (p. 4)
TELPAS – secure testing program (just like TAKS/STAAR)
Only trained, certified staff and/or their trained designees who have signed oaths have access to test materials
Must receive training & sign oath before handling test materials, confidential information, or administering a test
Must administer tests in strict accordance with instructions in manuals
Must maintain confidentiality of confidential information (such as completed student rating rosters)
Must destroy scratch paper used during reading tests

9. Test Security & Confidentiality Requirements (p. 4-5)
No viewing, revealing, or discussing test content before, during, or after a test administration unless specifically authorized to do so by test administration procedures
No duplication, printing, recording, writing notes about, or capturing by any electronic means any secure assessment instrument
No individuals other than students may respond to test items
No reviewing or discussing student responses or student performance data during or after a test unless authorized to do so by test administration procedures

10. Penalities for Prohibited Conduct (p. 5-6)
Placement of restrictions on the issuance, renewal, or holding of a Texas educator certificate, either indefinitely or for a set term
Issuance of an inscribed or non-inscribed reprimand
Suspension of a Texas educator certificate for a set term
Revocation or cancellation of a Texas educator certificate without opportunity for reapplication for a set term or permanently
Criminal prosecution
Additionally, student test results may be invalidated.

11. Security Oaths (p. 6)
Oaths for TELPAS raters, writing collection verifiers, test administrators, and technology staff found in Appendix A (p. 83)
Each oath must be read and completed AFTER training and BEFORE handling or viewing secure test materials or confidential information.
Some oaths include spaces to initial for assigned roles, so some lines may remain blank. (Read carefully before initialing!)

12. Testing Irregularities (p. 6-8)
Definition: Incidents resulting in a deviation from documented testing procedures
Each person is responsible for reporting immediately to the campus or district testing coordinator any violation or suspected violation of test security or confidentiality.
Failure to report is in violation of 19 TAC, Chapter 101 and could results in sanctions.
Two types: Serious & Procedural

13. Serious Irregularities (p. 6-7)
Could result in referral to the TEA Educator Certification and Standards Division for disciplinary action
Assisting students (directly/indirectly)
Tampering with student responses or writing samples
Falsifying TELPAS holistic ratings
Viewing secure test content (unless authorized to do so)
Discussing secure test content, student responses, or student performance
Scoring student reading tests (formally/informally)
Duplicating, recording, or capturing electronically secure test content

14. Examples of Procedural Irregularities (p. 7-8)
Eligibility Error
IEP Implementation Issue
Improper Accounting for Confidential or Secure Materials
Monitoring Error
Procedural Error

15. Reporting of Disciplinary Actions Taken Against Students for Cheating on State Assessments (p. 8)
A district may invalidate a student’s test if the district determines that the student cheated.
Additional disciplinary action may be taken at the local level.
Any local actions must be submitted to TEA using a special online reporting form.
A separate online incident report form is necessary ONLY IF the district determines that testing personnel contributed to, caused, or did not detect the cheating due to inadequate monitoring or another error.

16. Rater Responsibilities (p. 9 - 44)

17. Overview of the Rating & Reporting Process (p. 9)
Districts identify ELLs in grades K–12 and designate raters to assess students
Training on test administration procedures and holistic rating is conducted to prepare grades K–12 raters to assess English language proficiency consistent with the holistic scoring rubrics, the Proficiency Level Descriptors (PLDs)
Raters gather writing samples for ELLs in grades 2–12 to include in each student’s writing collection
Raters use PLDs to assign students a rating in each language domain assessed 17 4

18. Rater Credentials (p. 10)
A TELPAS Rater is a teacher designated to be the official rater of an ELL’s English language proficiency.
Each TELPAS Rater must:
Have the student in class during spring semester
Be knowledgeable about the student’s ability to use English
Hold valid teacher certificate or permit
Successfully complete holistic training & calibration activities
Rate the student in all eligible language domains

19. Accommodations (p. 10)
Holistic ratings are based on student classwork and observations of student in daily instruction.
For ELLs receiving SPED services, raters take into account the ability of students to use English to access the general curriculum at their enrolled grade level in accordance with accommodations called for in their IEP.
Accommodations generally should not interfere with the holistic rating process.
Talk to your Campus Testing Coordinator if you have any concerns in this area.

20. Rater Checklist (p. 11)
Will help you keep track of holistic rating activities
We will go through each activity in more detail in the next set of slides.

21. Attend Training Session on Administration Procedures (p. 12)
Today’s training is a part of your training on TELPAS holistic rating procedures.
Read and study the TELPAS Manual for Raters and Test Administrators.
Sign your Oath of Test Security and Confidentiality for TELPAS Rater on p. 85 after this training session and return it to the Campus Testing Coordinator (CTC). If you need more time to read the manual before you feel comfortable signing the oath, then return it by the date designated by your CTC.

22. Complete Holistic Rating Training Requirements (p. 13-18)
An online training process is used.
New raters complete an online basic training course. (The course is optional, but highly recommended, for returning raters.)
Both new and returning raters complete calibration activities.
All eligible language domains are included in the calibration activities, rather than just the writing domain.

23. Activity 2: Page 13 New Raters Returning Raters
Spring TELPAS Administration Procedures Training
Covers holistic rating training requirements and procedures for conducting TELPAS
New Raters
Returning Raters
Online Basic Training Course
(Basic Training Course is optional for Returning Raters.)
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful on Set 1
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful on Set 1
This flowchart is from page 19 of the TELPAS Rater Manual.
Summary of process:
Teachers unfamiliar with the ELPS and/or TELPAS should receive foundational training in the fall as a best practice. Spring TELPAS rater training will be a smoother process for teachers who already have this foundation.
In the spring, testing coordinators cover holistic rating training requirements and any needed background during TELPAS administration procedures training.
New raters complete an online basic training course, which includes practice rating activities for each language domain – listening, speaking, reading (K–1 only), and writing.
New raters and raters from previous years complete calibration activities online to ensure that they are applying the PLD rubrics consistently and accurately. The concept of a one-time qualification will no longer be used.
Raters from previous years have the option of reviewing the online basic training course, if desired, before completing calibration activities.
There are two sets of initial calibration activities. Each set contains 10 students. Each language domain is represented in each set. Raters successful on the first set do not calibrate further.
Only individuals who do not rate accurately enough on the first set complete the second set. Those not successful on the second set will receive supplemental training, followed by the third and final calibration set.
Individuals not successful on the final set will either not be used as raters (a district decision) or will be provided rater support in accordance with test administration regulations.
If not calibrated: Supplemental Holistic Rating Training
Final Online
Calibration Activity
Set 3

24. Online Training Components (p. 14)
Online Basic Training Course (Required for New Raters & Highly Recommended for Returning Raters)
One for raters of K–1 and one for raters of Gr. 2–12 (Approximate Completion Time: 4-5 hours)
Online Calibration (Required for New and Returning Raters)
Separate calibration activities for grades K–1, 2, 3–5, 6–8, and 9–12 (Approximate Completion Time: 1-2 hours)

25. Online Training Components (p. 14-15)
Online courses are designed to prepare raters to assess the English language proficiency of students in a uniform manner statewide.
New Raters: Complete Online Basic Training Course by February 27 (Deadline for GISD New Raters)
Training courses and calibration activities are grade cluster specific (K-1, 2, 3-5, 6-8, 9-12), so confirm your cluster BEFORE starting your online training.
If you will rate students from more than one grade cluster, consult your Campus Testing Coordinator for instructions. 25 25

26. Online Basic Training Course (p. 15)
Complete course in a distraction-free setting.
You may complete the course in more than one sitting.
The rating practice activities must be completed independently. (online oath included)
Five practice activities are included for each language domain.
There is no required number of students to rate correctly since the activities are for practice.
It is a violation of state assessment procedures to share or discuss answers to the rating practice activities with individuals who have not yet completed the course.
You will be issued a course certificate upon completion.

27. Online Calibration (p. 16)
Each calibration set contains 10 students to rate, and all holistically assessed language domains are represented in each set.
For K–1: listening, speaking, reading, and writing
For 2–12: listening, speaking, and writing
A rater needs to rate at least 70 percent of the students correctly to calibrate.
If a Returning Rater is unsuccessful on the first set, you must complete the Online Basic Training Course (if not already completed) and provide your CTC with your training certificate (GISD requirement). 27 27

28. Online Calibration (p. 16)
Raters complete only as many sets as it takes to calibrate.
Many raters will be able to calibrate on the first set of activities, and many others will be able to calibrate by the end of the second set.
Calibration sets are available on February 20 and must be completed by March 2 (in GISD).
Individuals who do not calibrate by the end of the second set will be provided with supplemental training prior to the third and final set.

29. Supplemental Holistic Rating Training (p. 17)
Raters not calibrated after Set 2 must receive supplemental support and then complete Set 3 before the start of testing window (in GISD this means BEFORE spring break).
Raters need access code to complete Set 3
3rd Calibration Set: Available February 29
The access code will be communicated to supplemental support providers during WebEx training sessions. Additionally, an will be sent to district testing coordinators with the access code shortly before February 16th, when set 3 becomes available.

30. Resources for New & Returning TELPAS Raters
TELPAS Manual for Raters & Test Administrators, p ; p
Educator Guide to TELPAS Grades K-12 (web-based guide to familiarize educators with TELPAS; includes student video segments, authentic student writing, & sample test questions)
PowerPoint presentations are available at the website referenced above under the heading: Rater Training for
Making the ELPS-TELPAS Connection Grades K12 Overview
Introductory Training on the PLDs Gr. K-1
Introductory Training on the PLDs Gr. 2-12

31. Calibration – Key Points (p. 18)
3 opportunities to calibrate
Resources available as warm-ups (see slide 28)
Online oath
Self-paced
Students presented in random fashion but domain order fixed (listening, speaking, reading (K-1 only), & writing
Score & rating annotations available right away
Although the 2nd set is available right away, DO NOT ATTEMPT until you check in with your CTC. If you did not complete the Online Basic Training Course, you MUST complete it before attempting the 2nd set. Review other support materials as well.
Training is complete after successful calibration on Set 1 or Set 2. Print Calibration certificate and give it to your CTC.
Raters not successful after 2 attempts will receive supplemental training before Set 3 can be accessed.

32. Accessing the TrainingCenter Website (Appendix D)
See Appendix D starting on p. 97 for specific information about accessing the TrainingCenter website.
Site code for new TELPAS users: telpas2012
New raters must register using the directions on p
Returning raters already have an account and should review p
Returning raters should review the “My Info” link and update , phone #, region, district, campus, etc. as needed. Call Pearson at for assistance (e.g., to change name & date of birth). 32 32

33. Texas TrainingCenter Login

34. Navigating the TELPAS TrainingCenter (p. 104)
My Home: After successful login, click on TELPAS 2012. 34 34

35. TELPAS Homepage
You will then see the TELPAS TrainingCenter homepage, where you will access training courses and/or calibration activities.

36. Accessing TELPAS Online Courses (p. 106)
You must first accept the Rater Agreement for TELPAS Online Training Courses to view courses and modules.
Video clips are included, so use headphones if needed.
Click on the title of each module to access. You must go through each module and activities within the module to get credit for completing the training.
See p for further details.

37. Accessing TELPAS Online Calibration (p. 109-119)
Follow the instructions on p in the TELPAS Manual.
Calibration window opens February 20 and is available 24/7.
Make sure you choose the correct grade cluster (K-1, 2, 3-5, 6-8, 9-12) for calibration.
Video clips are included, so you may need to use headphones to maintain security/confidentiality.
You may save your work and complete calibrating at another time.
Do not click the Finish Calibration button until all students are rated.

38. Accessing TELPAS Online Calibration (p. 109-119)
You may use the TELPAS Manual and other outside resources to complete the calibration activity. (It’s an open-book test!)
However, you must complete the activity BY YOURSELF. (No phoning a friend!)
CAUTION: Do not attempt when you are tired, feel rushed, or do not feel well.
If you do not complete Set 1 successfully, you must notify your Campus Testing Coordinator (CTC) and complete the Basic Training Course before you can access Set 2. This is a GISD requirement. The system will allow you to immediately access Set 2, but do not do so without notifying your CTC and completing the Basic Training Course first. 38 38

39. Still Unsuccessful After Set 2: What happens next? (p. 119)
It is very rare in GISD for a teacher to not calibrate after 2 attempts.
Those who still need to calibrate after 2 attempts will be provided with supplemental support by Trudy Brandenburg.
These sessions may take place before or after school and/or during your conference period.
You will be give an access code to proceed to Set 3 upon completion of all supplemental support training activities. 39 39

40. Accessing Training Results & Certificate and Assistance (p. 120-121)
See p. 120 for instructions on accessing the following:
- Training History
- Certificate of Completion for Online Courses
- Certificate of Successful Completion of Online Calibration
For help accessing or navigating the Texas TrainingCenter, contact Pearson at , Monday-Friday, 7:00 AM to 7:00 PM or by at: 40 40

41. Assemble & Verify Gr. 2-12 Student Writing Collections (p. 19-20)
Writing collections must contain at least 5 samples (1 narrative about a past event; 2 academic from math, science, or social studies; 2 other samples).
Writing assigned on or after February 20 may be considered.
More than 5 samples should be collected.
The more recent the writing samples, the more accurate the collection will be.
Include student name and date on all samples.
Staple the cover sheet and verification checklist found in Appendix C (p ) to the front of the writing collection.
Photocopies of writing are okay if clear and legible.
Collect samples from February 20 through March 30. Campuses may set earlier deadlines or interim deadlines, so check with your CTC. 41 41

42. Writing Examples (p )
Type 1: Basic descriptive writing on a personal/ familiar topic
Type 2: Writing about a familiar process
Type 3: Narrative writing about a past event (REQUIRED)
Type 4: Personal narratives & reflective pieces
Type 5: Expository & other extended writing on a topic from language arts
Type 6: Expository or procedural writing from science, math, or social studies (2 samples REQUIRED) 42 42

43. Tips for Good Writing Collections (p. 23)
Encourage students to take their time and write in as much detail as possible.
Include writing tasks that allow students to truly showcase the English they know while writing on topics that are comfortable and familiar.
Also include writing tasks that stretch and push students’ limits so that you can see the full extent of their language abilities and any elements of second language acquisition they still need to develop. 43 43

44. What Not to Include in a Collection (p. 23)
Papers containing language directly copied from a textbook, lesson, or other written source
Papers with heavy reliance on a dictionary or thesaurus
Papers that show a teacher’s corrections
Papers that have been polished through editing by peers, parents, or teachers
Papers written primarily in a student’s native language
Worksheets or question-answer assignments
Papers that are brief, incomplete, or obviously reflect writing that was rushed 44 44

45. Verifying the Writing Collection Components (p. 24)
TELPAS Raters and paraprofessionals are NOT permitted to serve as a verifier.
All raters complete the verification checklist (see p. 96) for their assigned ELL students as well as the front of the cover sheet (see p. 95).
Campus verifiers (usually the CTC) must complete the online training course, Assembling and Verifying Gr Writing Collections, on the Texas TrainingCenter website by February 29 (GISD requirement).
Collections that do not meet the requirements will be returned to the rater so that additional samples may be collected.
The verifier will initial in each box and sign the verification checklist at the bottom. 45 45

46. Prepare to Rate Your Students
Prior to rating your students, review p on the following topics:
Language Domain Definitions
Proficiency Level Descriptors and Global Definitions
Progress Through the Proficiency Levels
Social and Academic Language Proficiency
Academic Language Proficiency Versus Academic Achievement
Observing Students in Each Language Domain: Listening, Speaking, Reading (K-1), Writing (K-1)
Collaboration with Others: GISD requires that you collaborate with other teachers and school personnel on your holistic ratings.
Final Preparations 46 46

47. Rate Your Students (p. 32) You will need the following:
TELPAS Rater Manual, which includes the PLDs
The GISD Version of the TELPAS Student Rater Roster (Do not use the one in Appendix B. The GISD version has a column for collaborators to initial for each student.)
The TELPAS Writing Collection Cover Sheet (p ) run front/back for Gr students
Keep student writing collections & student rating rosters in locked storage when not in use.
The primary rating window in GISD is March 19 through April 5. 47 47

48. Procedures for Rating Students (p. 33)
Use the PLDs on p to rate your students.
Always refer to the PLDs.
You may copy the PLDs and make notes on individual students if helpful.
Start with students whose English proficiency levels are clearest to you.
Holistic ratings should be based on a variety of observations.
Evaluate the most current level of English proficiency & consider at which level the student performs most consistently.
Collaborate with others. (GISD Requirement!)
Complete all ratings for one student before proceeding to the next student.
Compare each student to the PLDs and do not let proficiency levels of other ELLs influence your ratings.
Except for Gr writing, your determination is based on reflections of observations, not formal language observation tasks.
Remember that academic language proficiency is not the same as academic achievement. A student does not have to be a high achiever in order to have an advanced high level of English language proficiency. 48 48

49. TAMS Online Activities (p. 39-43)
You will not be required to create and manage rating entry groups. (Yipee!)
You will not be required to enter rating information online. (Hurray!)
Your Campus Testing Coordinator or the District Testing Coordinator will complete these tasks. 49 49

50. Prepare Materials for Return (p. 44)
Verify holistic ratings and rater information you supplied on the Georgetown ISD TELPAS Student Rating Roster are accurate and complete.
Review the accuracy of any other student data you have been asked to verify.
Make sure you have completed, signed, and dated the GISD TELPAS Student Rating Roster and obtained the initials of a Collaborator for each student.
Gr. 2-12: Make sure that you have completed the TELPAS Writing Collection Cover Sheet (front & back) and stapled it to the front of each writing collection. 50 50

51. Return Materials (p. 44)
Signed Oath of Test Security & Confidentiality for TELPAS Rater (if not already returned)
Return your GISD TELPAS Student Rating Roster.
Turn in your student writing collections.
Return your TELPAS Manual after all TELPAS activities have been completed. 51 51

52. TELPAS Calendar of Events in GISD: Let’s Review
Dates
Administration procedures training for holistic component
By February 20
New raters complete online basic course (K-1 or Gr. 2-12)
By February 27
Returning raters review TELPAS basics (see Slide 30 for resources)
Before attempting calibration activities
All raters complete online calibration activities
February 20 – March 2
Collect samples for Gr writing collections
February 20 – March 30
Training for Gr TELPAS Online Reading Test
By March 16
TELPAS Assessment Window (holistically rating all ELLs & completing online reading test for Gr. 2-12)
March 19 – April 5
Campus Verifiers ensure that Gr writing collections meet all assembly criteria
March 26 – April 2
Extended Collection Window (if needed to collect more writing samples)
April 2 – 5
Extended Assessment Window (to rate/test ELLs in extenuating circumstances)
April 9 – 11
Deadline for CTCs to enter all holistic ratings in the Texas Assessment Management System
April 11 by 5:00 PM