1. GRADES K-1 TELPAS HOLISTIC RATER CAMPUS TRAINING

2. ELPS-TELPAS CONNECTION TELPAS RATERS Credentials Responsibilities New & returning rater definitions HOLISTIC RATING TRAINING Overview Training requirements Basic training, calibration, and supplemental support TELPAS ONLINE TRAINING CENTER WRITING COLLECTION TEST SECURITY AND CONFIDENTIALITY RESOURCES 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 2

4.  WHAT ARE THE ELPS?  Federally required instructional standards designed to ensure that ELLs are taught the academic English they need for school purposes  WHAT IS TELPAS?  A federally required assessment program designed to measure the annual progress that ELLs make in learning the English language  WHAT ARE TELPAS RATERS?  Teachers trained to assess ELLs for TELPAS 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 3

5. 4 LANGUAGE DOMAINS LISTENING SPEAKING READING WRITING 4 PROFICIENCY LEVELS BEGINNING INTERMEDIATE ADVANCED ADVANCED HIGH The ELPS are used in foundation and enrichment instruction of K–12 ELLs TELPAS assesses K–12 ELLs. The ELPS and TELPAS encompass – 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 5

6. All ELLs in grades K–12, including those whose parents decline bilingual/ESL program services, are assessed annually In extremely rare cases, an ELL served by special education may be exempted from TELPAS by the ARD committee in conjunction with the LPAC. 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 6

7. 7

8. 8

9. 9

10. TELPAS RESULTS ARE USED TO — set learning goals for ELLs keep parents and students aware of annual progress in learning English inform instructional planning and bilingual/ESL program exit decisions report performance to the public evaluate programs, resources, and staffing patterns evaluate districts and campuses in federal and state accountability and monitoring indicators 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 10

12. Each Teacher selected to rate an ELL must: Know the student well - have the student in class Be knowledgeable about the student’s ability to use English in instructional and informal settings Hold valid education credentials such as a Teacher certificate or permit Be appropriately trained, as required by TEA Rate the student in ALL domains – cannot have different Raters for different domains for the same student 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 12

13.  The training webpage informs Raters that districts may sometimes require a returning Rater to complete new-Rater training and to consult with their Testing Coordinator if they need clarification. 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 13

15.  A direct and authentic way to assess English language proficiency  Rubrics-based process of evaluating abilities as a whole rather than as skills in isolation  Focuses on overall ability of students to understand and use English in grade- level academic settings  Teacher-conducted and used in ongoing quality instruction and formative assessment  Used for official summative TELPAS assessment in spring of year 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 15

16. Teachers determine English proficiency levels by observing students in class. They watch how their ELLs  interact informally with them and other students  understand and use English  when receiving academic instruction and completing class work  during cooperative learning activities 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 17

17. Students will be listed on the Student Rating Roster All ELL students are assigned to be Rated. Even those student who are: exempt from one or more domains Not receiving services due to parental waivers Ratings and Rater Information will be recorded on the Student Rating Roster 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING 17

18. New Raters Online Basic Training Course If not calibrated: Supplemental Holistic Rating eCourse Required Final Online Calibration Activity Set 2 Online Calibration Activities Set 1 Fall ELPS-TELPAS Professional Development (For new teachers and new prospective raters -- recommended) Returning Raters Online Calibration Activities Set 1 Spring TELPAS Administration Procedures Training Covers holistic rating training requirements and procedures for conducting TELPAS 18 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

19. Note that we are on Spring Break during the TELPAS window, so our window is one week shorter than we typically have 19 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

20. 20 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

21. Raters must know their assigned grade cluster to select the appropriate online training Raters should consult with their Campus Testing Coordinator if they are unsure of their assigned cluster Grade Clusters Grades K–1 Grade 2 Grades 3-5 Grades 6–8 Grades 9–12 21 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

22. Because of differences in the instructional content and rating rubrics, these Raters must complete training and calibration for K–1 and at least one other cluster in 2–12 Raters with more than one additional cluster should train in the cluster in which they have the most ELLs As a best practice, these Raters should also review online basic training course practice activities in the additional cluster(s) 22 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING Example: A grade 1–3 ESL teacher has most of his ELLs in grade 2. He must complete training and calibration in grades K–1 and 2. As a best practice, he should review the online practice activities for grades 3–5 to check his readiness to apply the rubrics appropriately for his 3rd grade students.

23. Depending on campus arrangements, Raters may either complete training and calibration during school hours, after school, or on weekends The online training system allows Raters to access the training from any computer that meets the minimum system requirements It is a violation of state assessment procedures to record, discuss, or share answers to the rating practice and calibration activities. Prior to accessing the online courses and calibration activities, Raters are required to read an online statement and affirm that they will complete the rating activities independently. Notes taken during calibration activities must be shredded. 23 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

24. Calibration helps ensure that Raters have adequate training, including ample practice and feedback, before they assess their students in the spring Calibration ensures that Raters clear their heads and consider only the elements of student performance included in the PLDs Calibration supports assessment validity and reliability and is an important part of holistically scored assessment processes Calibration ensures that Raters have enough guidance, practice, and support to assess students consistently and accurately 24 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

25. 25 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

26. administration procedures All raters must receive administration procedures training prior to attending a calibration session and must have a signed oath on file. A roster of participants in each session will be maintained Raters will be given a passcode by the session proctor in order to access calibration All notes must be turned in to the proctor and destroyed at the end of the session Raters may use their TELPAS Rater Manual or a copy of the PLDs and scratch paper to make notes during calibration. All notes must be turned in to the proctor and destroyed at the end of the session individually Raters will need to complete calibration activities individually within the monitored group session. Therefore, the use of headphones is required 26 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

27. Calibration activities are taken from a bank and randomized. Trainees will rate different sets of students Submit Raters must complete a set once it’s started. They click a “Submit” button when they are finished with a set After completing a calibration set, Raters immediately see results. Results show both the rating assigned by the Rater as well as the correct rating Raters see annotations explaining the correct ratings. Raters should use the annotations to go back and review any incorrectly rated students Raters will need 1-2 hours to complete a calibration set. Raters must finish a calibration set once it is started. They will not be able to save their progress and return later to complete the set 27 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

28. RATING RUBRICS (PLDS) Yes, Raters should use their RATING RUBRICS (PLDS) and refer to, as needed, information from the: ONLINE BASIC TRAINING COURSE HOLISTIC RATING POWERPOINTS PRODUCED BY TEA AND STUDENT ASSESSMENT TELPAS RATER MANUAL EDUCATOR GUIDE TO TELPAS After Raters have completed calibration activities, all notes taken by rater must be turned into the proctor and destroyed. 28 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

29. TO BE SUCCESSFUL, RATERS NEED TO RATE 10 STUDENTS IN THEIR ASSIGNED GRADE CLUSTER WITH AT LEAST ACCURACY 29 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

30. 30 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

31. Two outcomes are possible for individuals who complete the calibration activities but are not successful: The district may choose not to assign the individual to be a TELPAS Rater If the individual is needed to serve as a Rater, the district must implement rater support procedures to ensure that the Rater’s students are evaluated consistent with the rating rubrics Individuals are not authorized to serve as Raters unless they complete the required training components. 31 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

32. Raters who take the basic training course, will provide CTC will a screen shot of completed course District coordinators will print certificates and forward to Campus Testing Coordinators Raters will print the certificate of successful calibration when they calibrate Raters must provide Testing Coordinators with a copy of their certificate(s) 32 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

33. 33 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

34. Spring 2016 34 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

35. Spring 2016 35 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

37. This is the training website for Raters and Verifiers HTTP://WWW.TEXASASSESSMEN T.COM/TELPASTRAININGCENTER HTTP://WWW.TEXASASSESSMEN T.COM/TELPASTRAININGCENTER Everyone must register, click on Sign Up KEYWORD IS TRAINING2016 37 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

38. 42

39. 39

40. 40

42. Test security involves accounting for all secure materials and confidential student information before, during, and after each test administration Raters and Verifiers are required to maintain security regarding all confidential documentation in limited-access locked storage when not in use. This includes Writing Collections and Student Rating Rosters that contain student data Raters are never allowed to remove Student Rating Rosters from campus Each person participating in the Texas student assessment program is responsible for reporting any violation or suspected violation of test security or confidentiality Notify your Campus Coordinator if you witness an irregularity or suspect that one has occurred 42 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

43. Maintaining the confidentiality of the TELPAS program involves protecting the contents of all online assessments and student rating information. This requires that: All testing personnel who meet the requirements to participate in TELPAS must complete training and sign the appropriate security oath Upon first accessing the secure online administrative features of the PearsonAccess Next and the TELPAS Online Training Center, trained and qualified testing personnel who will enter student ratings must read and accept a statement of confidentiality All student ratings must be determined in strict accordance with the instructions contained in the TELPAS Rater manual 43 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

44.  Rater Oaths must be read and completed after training and before handling or viewing any secure Student Rating Rosters 44

45.  ALL ELL students must be accounted for during the TELPAS window. Not assessing an ELL student or assessing a non-ELL student are considered testing irregularities  Use this chart as guidance for when to rate and/or administer the online Reading test for students who move before or during the TELPAS window 45 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING

46.  TELPAS RATER MANUAL AND ANNOTATED EXAMPLES OF STUDENT WRITING  NOW AVAILABLE AT HTTP://WWW.TEA.STATE.TX.US/STUDENT.ASSESSMENT/ELL/TELPAS/MANUALS/ HTTP://WWW.TEA.STATE.TX.US/STUDENT.ASSESSMENT/ELL/TELPAS/MANUALS/  TELPAS RATER USER GUIDE (BACK PORTION OF RATER MANUAL, PP. 55-76)  PEARSON TECHNICAL SUPPORT, 1-800-627-0225  ONLINE COURSE TITLED ASSEMBLING AND VERIFYING GRADES 2–12 WRITING COLLECTIONS Rater Training https://tx.scoring.pearsonassessments.com/scoring/ 46 2016 TELPAS HOLISTIC RATER CAMPUS TRAINING