TELPAS 2015 Texas English Language Proficiency Assessment System HISD Student Assessment Department HISD Multilingual Department Mandatory Training Presenters: February 5, 2015 Marlen Pena & Millie Sasmita

This Training DOES NOT Take the Place of Reading the Appropriate Manuals 2

TELPAS 2015 Spring Dates 3 DateActivity Jan 12 Assembling and Verifying Grades 2–12 Writing Collections course available/opens Verifiers must complete Jan 21, 22, 27, 28, 29, Feb 3 HISD Mandatory TELPAS Administration Procedures Training for Campus Testing Coordinators Jan 26 Online basic training courses for NEW K–1 and 2–12 raters available/opens Supplemental support provider recorded Web-based training available/opens Dates on e-Train Face-to-Face TELPAS Rater Training by Multilingual Dept. (ML0147) Feb 16 Online Calibration window opens for New and Returning raters—first 2 sets End date for training raters on administration procedures Earliest eligibility date for TELPAS writing samples- 5 samples required grades 2-12 Feb 25 3 rd and final calibration set available; supplemental training begins Mar 16-Apr 8 TELPAS assessment window April 9-10 TELPAS data verification window May 15 Districts receive TELPAS standards and optional reports/results

General Information 2015 TELPAS Assessment Window Opens March 16 and closes April 8

TELPAS General  There are two manuals for TELPAS  TELPAS Rater Manual Grades K-12  TELPAS Reading Test Administrator Manual Grades 2-12  New standards for TELPAS reading tests in grades 2-12 beginning with spring 2014 administration  Standards were adjusted to meet the new definition of grade level-appropriate that accompanies the increased rigor of STAAR  New domain weights applied beginning with spring 2014  Listening – 10%  Speaking – 10%  Writing – 30%  Reading – 50% 5

What is TELPAS? A federally required assessment designed to measure the annual progress that English Language Learners (ELLs) in K-12 make in learning academic English including parental denials (waivers W-H) in four language domains-listening, speaking, reading (K-1), and writing. Results are used to meet state & federal reporting and accountability requirements.  TELPAS uses an online multiple-choice test to assess  2–12 reading  TELPAS uses a holistic rating process and classroom observations to assess  K–12 listening, speaking, and writing  K–1 reading ALL campuses with ELL students MUST administer TELPAS 6

Eligibility Requirements Who Takes TELPAS?  All K-12 ELL students are required to participate in TELPAS, including students with parental denials (waivers W-H) Who Doesn’t Take TELPAS?  Pre-K ELL students  Monitored students who met Limited English Proficiency (LEP) exit criteria and are reclassified as Non-LEP/ELL  Non-LEP/ELL students 7

8 How are LEP students assessed?  PLD’s (Proficiency Level Descriptors) are used to determine English language proficiency levels (B, I, A, AH) of students in the domains of listening, speaking, reading, and writing (see Rater Manual pages 33-37)  The reading domain for grades 2-12 is assessed through an online multiple-choice test (untimed test)  Student’s answers to online tests, ratings from holistically rated assessments, & all other student data are submitted through the Texas Assessment Management System (TAMS) PLDs PLDs should be used all year and must be used when rating ELLs. Remind raters to use PLDs when rating students. 8

Students Who Move Guiding principles:  If an ELL enrolls in a Texas public school BEFORE March 16 (start of TELPAS assessment window), the receiving campus is responsible for all TELPAS assessments  If an ELL enrolls ON or AFTER March 16, the receiving campus is responsible for the grades 2–12 reading test only (if not already administered) This is true whether the student enrolls from another Texas school or from another state or country 9 T-33

TEST SECURITY PROCEDURES 2015 TELPAS Assessment Window Opens March 16 and closes April 8

TELPAS Security Oaths  Trained testing personnel must read & accept a statement of confidentiality when logging in to the TAMS for the first time before they can access secure administrative features to administer TELPAS online  Any person involved in the TELPAS administration must sign a security oath after training and before handling or viewing any secure test materials or confidential information (kept in district for 5 years)  Any person who has more than one testing role must sign an oath for each role (ex. rater who also serves as a Test Administrator ) 11 Non-certified personnel must be under the supervision of certified personnel

TELPAS Security Oaths cont. TELPAS Roles  Supplemental Support Providers (sign Rater oath)  Rating Entry Assistants (sign Rater oath)  Online Session Administrators (sign Test Administrator oath)  Online Reading Test Administrators (sign Test Administrator oath)  Technology Staff (sign Technology staff oath)  Verifier(s) (sign TELPAS Writing Collections Verifier oath) 12 Non-certified personnel must be under the supervision of certified personnel

Test Confidentiality Requirements Maintaining the confidentiality of the TELPAS program involves protecting the contents of all online assessments and student rating information. This requires compliance with, but not limited to, the following:  For online testing, all testing personnel must read and accept a statement of confidentiality when first accessing the secure online administrative features of TAMS  All tests must be administered in strict accordance with the instructions contained in the test administration manuals  Procedures are in place during test window for raters, verifiers, & test administrators 13

Test Security and Confidentiality Requirements Testing personnel are NOT allowed to:  Duplicate, print, capture, or photograph any portion of the secure online test  Translate test questions and reading selections into another language (p. 14 TELPAS Reading Manual)  Review or discuss test questions with anyone before, during, or after testing  Score test items/tell students how they performed  Change or instruct students to change any responses recorded 14

Holistic & Reading Administration Info 2015 TELPAS Assessment Window Opens March 16 and closes April 8

Holistically Rated Components Grades K–1  Holistically rated observational assessments of listening, speaking, reading, and writing using PLDs Grades 2–12  Holistically rated observational assessments of listening and speaking using PLDs  Holistically rated writing collections (5) using PLDs  Multiple-choice online reading tests in six grade clusters: 2, 3, 4–5, 6–7, 8–9, 10–12 16 TELPAS Reading test is untimed

Writing Collections for Grades 2-12  The verifier must ensure that writing collections contain writing assignments written on or after February 16, 2015  Each writing collection must have 5 writing samples:  1 narrative about a past event  2 academic samples (from math, science, or social studies)  2 other writing samples  Each sample must have the student’s name, date, and content area/subject  Each writing collection must have a: Writing Collection Cover Sheet and a Writing Collections Verification Checklist  Copy them back-to-back and place them in front of the writing collection of each LEP student in grades 2-12  Must be kept in LEP folder for 2 years

Writing Collection Cover Sheet & Verification Checklist - Examples 18 Copy back-to-back/two sided Appendix C

Writing Collections for Grades 2-12 cont. Verifying the Writing Collections  Collections that do not meet the requirements must be returned to the Rater  Once the collection meets all requirements, the Verifier will sign each Writing Collection Checklist to affirm that the writing collections have been assembled correctly  All writing collections (5 samples per student ) for grades 2-12 must be submitted to the CTC no later than March13, (Verifier has to have enough time to verify collections before Rater’s rate collections)  The verification of the writing collections should occur before a rating for writing is assigned 19 23

HISD TELPAS Student Rating Roster (Example) Principal The Principal plays a key role in ensuring holistic rating accuracy by reviewing and signing each rater’s TELPAS Student Rating Roster prior to the final verification of student data. 20 Years in U.S. schools column has been added Form can be found in Student Assessment SharePoint and Multilingual Portal

RATER/VERIFIER TRAINING INFORMATION 2015 TELPAS Assessment Window Opens March 16 and closes April 8

22 Rater Credentials A teacher (including a substitute teacher) selected to rate an ELL must:  have the student in class at the time of spring assessment window (March 16-April 8)  be knowledgeable about the student’s ability to use English in instructional and informal settings  hold a valid Texas education certification or permit  rate the student in all eligible domains  be appropriately trained in the holistic rating process Raters may include bilingual teachers, ESL teachers, general education teachers, special education teachers, gifted and talented teachers, and teachers of enrichment subjects. Paraprofessionals may NOT serve as raters nor verifiers. 9

Spring 2015 Online Training Components  Online Basic Training Course - Required for New Raters  Online Calibration - Required for New and Returning Raters  Assembling and Verifying Grades 2-12 Writing Collections – Required for Verifiers 23 Note: A verifier may not serve as rater. A rater may not serve as verifier. No double role.

Rater/Verifier Training Is available through the Texas TrainingCenter website- which requires a username and password for access. This is the website that raters use to complete Online Basis Training Course, Online Calibration Activities, and Supplemental Holistic Rating Training Appendix D

2015 Verifier Training Component Mandatory course for verifiers Assembling and Verifying Grades 2–12 Writing Collections (Window Opens January 12, 2015) A Verifier May Not Serve as a Rater Need to click on Other Training tab to access training 25

Grades K-12 Holistic Rating Training Flowchart Opens Jan. 26 Opens Feb. 16 Opens Feb. 25 All Rater training takes place online in the spring and grade –cluster specific T-5

2015 Raters Online Training Components Online Basic Training Course -Required for New Raters There are 2 online basic training courses:  One for raters of K–1 students  One for raters of grades 2-12 Trainings includes rating activities to give raters opportunities to practice applying the holistic rating rubrics – the PLDs. Raters receive certificate of completion regardless of how they score on activities. Online Calibration - Required for New and Returning Raters) Separate calibration activities for K–1, 2, 3–5, 6–8, 9–12  There are 3 sets of students to be rated and each set contains 10 students 70 percent  Rater needs to rate at least 70 percent of the students correctly in a set to demonstrate sufficient calibration Training Requirements should be completed by March 16 27

 Be sure raters know their assigned grade cluster of training  Grade cluster of training must correspond to grade levels of students to be assessed by rater 2015 Raters Online Training cont. 28

29  New raters must complete the Online Basic Training course & Calibration activities  New raters are raters that have never rated and did not complete the online basic training course and calibration activities in  A Returning Rater who did not successfully complete calibration in spring of 2014 will need to complete online basic training course and calibration  A Returning Rater who did not rate in spring of 2014 will need to complete online basic training course and online calibration Multilingual is offering Face-to-Face New Rater K-12 training in Spring of 2015, e-TRAIN # ML0147 (List of dates in TELPAS Supplemental Info Pack) 2015 Raters Online Training cont. 29

30  Returning raters must complete the Calibration activities  Returning raters are raters that successfully completed calibration activities in spring of 2014 (scored 70% or higher) 2015 Raters Online Training cont. Campus CTCs must monitor course completion and performance on calibration activities through the Texas TrainingCenter 30

TRAINING STEPS for RATERS  Raters who score 70% or higher on the 1st Calibration set do not need to calibrate any further, as they have successfully completed Calibration  Raters not successful on the 1st Calibration set must complete the 2nd Calibration set  Raters not successful on the 2nd Calibration set will need to receive Supplemental Training A rater must rate each student in all domains for which the student is eligible. A student is NOT permitted to have one rater for some domains and another rater for other domains. 31

Supplemental Support for Raters Raters not successful after calibration set 2 need to be provided supplemental support before attempting the 3 rd and final calibration activities  During Supplemental training, raters will receive an access code from a campus Supplemental Support Provider to complete the 3 rd calibration set  Raters will need to complete & pass the 3 rd Calibration set before the start of the TELPAS testing window (by March 16)  Campuses can decide to use raters not successful on their 3 rd Calibration set but must be provided qualified rater support (i.e. qualified rater) in accordance with test administration regulations 32

TEXAS TRAININGCENTER INFO for RATERS/VERIFIERS & CTCs 2015 TELPAS Assessment Window Opens March 16 and closes April 8

How Raters & Verifiers Access the Texas TrainingCenter Website: Login to the Texas TrainingCenter If New they must Complete Self-Registration Login 34

35 New Teachers/Raters We recommend that you ask new teachers on your campus if they have been trained as raters from another district and/or HISD campus. If so they must go online to the TX Training Center website and update their info on the My Info Tab PLEASE NOTE: Teachers who have served as raters in other districts/HISD campuses must use the same Username & Password as last year when logging into the Texas TrainingCenter website. They should not create new Username and/or Password

Texas TrainingCenter Access for TELPAS  Upon successful login you will see the My Home screen  To access the TELPAS Training Center, click on TELPAS 2015 Refer to Appendix D- TELPAS Rater’s User Guide for Online Holistic Rating Training (found on pages of the TELPAS Rater Manual)

TELPAS - TX TrainingCenter Homepage for Rater/Verifier Verifiers will have to click on the Other Training tab to access Assembling and Verifying Grades 2-12 Writing Collections Course 37

TELPAS - TX TrainingCenter Online Basic Training Course (K-1) Course modules for grades K and 1 We recommend that New raters complete Tips for Course Completion before starting Online Basic Training course This also applies to grades 2-12 Online Basic Training Course 38

39 TELPAS - TX TrainingCenter Calibration Selection  All New and Returning raters must complete Calibration  Must score 70% or higher to serve as a rater

Training Certificates and Professional Development Hours Training certificates are generated for raters who complete training courses and calibration activities  Certificate of completion issued when rater completes Online Basic Training Course for K-1 or 2-12 (Awarded five hours credit)  Certificate of successful completion issued when a rater demonstrates sufficient calibration (70% or better) on a calibration set (Awarded two hours (in all) for calibration) 40 Raters are required to print a copy of the certificate for CTC’s records

County-District Number

Questions 42