1. Florida Department of Education John L. Winn, Commissioner Test Chairpersons Training March 26, 28, and 29 Spring 2007 Comprehensive English Language Learning Assessment (CELLA)

2. Florida Department of Education John L. Winn, Commissioner

3. Florida Department of Education John L. Winn, Commissioner TRAINING OBJECTIVES Learn general information about the design and administration of CELLA and its uses Learn how to train test administrators to administer the CELLA group sessions

4. Florida Department of Education John L. Winn, Commissioner WHY ADMINISTER CELLA? CELLA measures the growth of students classified as English Language Learners (ELLs) in mastering the skills in English they will need to succeed in school CELLA provides evidence of program accountability in accordance with Title I and Title III of NCLB

5. Florida Department of Education John L. Winn, Commissioner  Monitoring student progress over time  Placement into, or exit from, English for Speakers of Other Languages (ESOL) programs  Identifying students’ strengths and weaknesses in English Results will NOT be used for  Grade level placement  Promotion or Retention decisions HOW WILL THE RESULTS FROM CELLA BE USED?

6. Florida Department of Education John L. Winn, Commissioner WHAT’S NEW FOR 2007? 2007 Test Administration Manual (TAM) Revised to eliminate duplication of information. 2007 Directions for Administration (DFA) and Scoring Guides. All levels (A-D) are included in one secure DFA. Answer sheet improved. Supplemental order form revised. Level A2 Reading/Writing cover redesigned to avoid errors in administration.

7. Florida Department of Education John L. Winn, Commissioner CELLA SCHEDULE OF ACTIVITIES January 12Student identification information for ESOL students is submitted. March 26, 28 and 29CELLA training sessions for Test Chairpersons. April 9-13CELLA testing materials are delivered to schools via Comet Delivery Services. April 16 – May 25CELLA testing window.

8. Florida Department of Education John L. Winn, Commissioner CELLA SCHEDULE OF ACTIVITIES CONTINUED April 16 - 20Recommended window for CELLA group administered sessions in all senior high schools. April 23 - 27Recommended window for CELLA group administered sessions in all elementary, middle and K-8 centers. April 30 – May 4CELLA group-administered make- up sessions. May 14 – May 25OPEN window for return of CELLA testing materials to TDC. May 29 and 30Final return of CELLA testing materials to TDC. AugustCELLA score reports provided to schools.

9. Florida Department of Education John L. Winn, Commissioner STUDENTS TO BE TESTED All students classified as ESOL at the time of CELLA testing are to be tested. All new students who respond affirmatively to the Home Language Survey must be assessed for English language proficiency using the OLPS within 20 days of entry to the district. (New) Any ESOL students who were exited from the ESOL program as of August 18, 2006 (classified as former Limited English Proficient (LEP)), must be included in the spring 2007 administration.

10. Florida Department of Education John L. Winn, Commissioner ESOL STUDENTS EXEMPTED FROM TESTING Students entering the school district on or after March 12, 2007 with affirmative responses to the Home Language survey would not be included in the Spring 2007 administration, even though the OLPS and placement may be completed prior to the end of the testing window. The 20-day requirement for assessment English language proficiency is waived for the period between March 12, 2007 and May 25.

11. Florida Department of Education John L. Winn, Commissioner OVERVIEW OF CELLA Test Levels: Level A (Grades K-2) Level B (Grades 3-5) Level C (Grades 6-8) Level D (Grades 9-12) Test Sections and Formats: Listening: Multiple Choice (MC) Speaking: Constructed Response (CR) Reading: MC Writing: MC and CR

12. Florida Department of Education John L. Winn, Commissioner TEST DOCUMENT CONFIGURATION ON GRADE LEVEL – ALL SECTIONS Grade LevelTest Materials Kindergarten and Grades 1 & 2Level A Student Test Book Grades 3, 4, and 5Level B Listening & Speaking Test Book Level B Reading & Writing Test Book Level B, C & D Answer Sheet Grades 6, 7, and 8Level C Listening & Speaking Test Book Level C Reading & Writing Test Book Level B, C & D Answer Sheet Grades 9, 10, 11 and 12Level D Listening & Speaking Test Book Level D Reading & Writing Test Book Level B, C & D Answer Sheet

13. Florida Department of Education John L. Winn, Commissioner TEST BOOKLET CONFIGURATION ON GRADE LEVEL – ALL SECTIONS Level A: Grade K - 2 Level B: Grades 3 - 5 Level C: Grades 6 - 8 Level D: Grades 9 - 12

14. Florida Department of Education John L. Winn, Commissioner CELLA TEST SECURITY All CELLA testing materials are to be secured. Test administrators must account for ALL test materials assigned to them. Test administrators must sign the Florida CELLA Administration and Security Agreement

15. Florida Department of Education John L. Winn, Commissioner DETERMINING TEST LEVELS TO BE USED Listening and Speaking: ESOL Levels 1-4 MUST be administered on grade level to ALL ESOL students in grades K-12 Reading and Writing: ESOL Levels 3-4 On grade level for ALL ESOL students in grades K-12 Exception: a small number Special Education (SPED) students Reading and Writing: ESOL Levels 1-2 Grades 3-12, test at 1 lower level.

16. Florida Department of Education John L. Winn, Commissioner DETERMINING LEVELS TO BE USED CONTINED Example: An ESOL Level 1 student in grade 5 will take Level B, Listening and Speaking and record all answers in the Level B, C, and D Answer Sheet. The student must take the Level A Reading and Writing test, recording all responses in the Level A Reading and Writing test book. and

17. Florida Department of Education John L. Winn, Commissioner CELLA TEST LEVELS FUNCTIONAL LEVEL TESTING Grade LevelESOL LevelReading/Writing Level Speaking/Listening Level K-2ALLAA 3-5 1-2A B 3-4B 6-8 1-2B C 3-4C 9-12 1-2C D 3-4D

18. Florida Department of Education John L. Winn, Commissioner LOCATOR TEST Will ONLY be used for some SPED students in ESOL Levels 3 and 4 Testing the Reading & Writing sections at the student’s functional level Allows ESOL Level 3 and 4 SPED students in grades 3-12 to take a lower level if their literacy skills are at a more basic level The Locator Test can be used to determine which level is appropriate

19. Florida Department of Education John L. Winn, Commissioner LOCATOR TEST CONTINUED Only for some SPED students in ESOL Levels 3 and 4 Directions for Administration Locator Test Booklet

20. Florida Department of Education John L. Winn, Commissioner CONTACT INFORMATION For specific questions concerning the locator test and your SPED students ESOL Levels 3 or 4, please contact the Division of Special Education, at 305 274-8889.

21. Florida Department of Education John L. Winn, Commissioner CELLA ITEM TYPES LISTENING AND SPEAKING Listening: Listen & Match Picture Description Short Talks Extended Listening Speaking: Oral Vocabulary Speech Functions Personal Opinion Story Retelling Graph Interpretation

22. Florida Department of Education John L. Winn, Commissioner CELLA ITEM TYPES READING Vocabulary: Synonym Antonym Idiom Root & Affix Comprehension: Main Idea Detail Inference/Prediction Reference Rhetorical Elements Vocabulary in Context

23. Florida Department of Education John L. Winn, Commissioner Multiple Choice: Grammar, structure & written expression Paragraph choices Recognizing errors CELLA ITEM TYPES WRITING Constructed Response: Writing sentences Writing paragraphs

24. Florida Department of Education John L. Winn, Commissioner CELLA LEVEL A GRADES K-2

25. Florida Department of Education John L. Winn, Commissioner LEVEL A MATERIALS Two Test Book Forms: Level A Student Test Book, including the Core and the Extension (orange in color): Grades K-2 students Level A Reading/Writing Book (green in color): Grades 3-5 ESOL levels 1-2 for functional level testing only Level A Listening and Speaking CD Directions for Administration and Scoring Guide Book Level A section begins on page 5

26. Florida Department of Education John L. Winn, Commissioner ADMINISTERING LEVEL A All sessions should be individually administered to students in kindergarten. One-on-One (Speaking) is administered individually at all grade levels Grades 1 and 2 may take Listening, Reading and Writing in small groups. Grade 2 will take the “Extension Section” which includes additional items in Reading and Writing.

27. Florida Department of Education John L. Winn, Commissioner CELLA Sessions Level A Grades K-2 GradeListeningReadingWriting One-on-One (Speaking) K 15 Questions (approx. 15 minutes) Individually Administered CD required 15 Questions (approx. 15 minutes) Individually Administered 7 Questions (approx.15 minutes) Individually Administered 21 Questions (approx.15 minutes) Individually Administered 1 st 15 questions (approx. 5 minutes) Administered in small groups CD required 15 questions (approx. 15 minutes) Administered in small groups 7 questions (approx. 15 minutes) Administered in small groups 21 Questions (approx. 15 minutes) Individually administered 2 nd 15 questions (approx. 15 minutes) Administered in small groups CD required 25 questions (approx. 35 minutes) Administered in small groups 16 questions (approx. 30 minutes) Administered in small groups 21 Questions (approx. 15 minutes) Individually administered

28. Florida Department of Education John L. Winn, Commissioner LEVEL A LISTENING The Listening section is divided into three parts and is paced by a script that can be delivered in 2 ways:  Recorded Delivery: playing the CD  Administrator Delivery: reading the script aloud Approximate testing time is 15 minutes.

29. Florida Department of Education John L. Winn, Commissioner Level A Reading Core Level A items (1 – 15) are delivered by script and read aloud by the test administrator. Approximate testing time is 15 minutes. Extension Level A items (16 – 5)administered in Grade 2 only contain reading comprehension passages that are completed by the student independently. Approximate testing time for both the Core and Extension is 30 minutes.

30. Florida Department of Education John L. Winn, Commissioner Level A Writing Core Level A items (1-7) will take approximately 15 minutes to complete. Extension Level A items (8-16) administered in Grade 2 only contains editing tasks and prompts to write sentences and paragraphs. Approximate testing time for both the Core and the Extension is 30 minutes.

31. Florida Department of Education John L. Winn, Commissioner When to use Level A Reading/Writing Test Booklet ESOL level students 1 and 2 in grades 3-5 will a need a Level A Reading and Writing Test Book These students will also need a Level B Listening and Speaking Test Book and a Level B-D Answer Sheet

32. Florida Department of Education John L. Winn, Commissioner Level B-D for Grades 3-12 Individually Administered: Speaking Group Administered: Listening Reading Writing

33. Florida Department of Education John L. Winn, Commissioner MATERIALS: LEVEL B-D B-D Answer Sheet Directions for Administration and Scoring Guide Book Listening/Speaking Test Booklets for B, C, and D Reading/Writing Test booklets for B, C, and D Listening CDs for B, C, and D

34. Florida Department of Education John L. Winn, Commissioner CELLA SESSIONS LEVELS B-D GRADES 3-12 LevelsListeningReading*Writing* One-on-One (Speaking) B Grades 3-5 22 Questions (approx. 25 minutes) CD required 26 Questions (approx. 45 minutes) Administered in groups 25 Questions (approx. 70 minutes) Administered in groups 14 Questions (approx.15 minutes) Individually Administered C Grades 6-8 22 questions (approx. 25 minutes) Administered in groups CD required 26 questions (approx. 45 minutes) Administered in groups 25 questions (approx. 70 minutes) Administered in groups 13 Questions (approx. 15 minutes) Individually administered D Grades 9-12 22 questions (approx. 25 minutes) Administered in groups CD required 26 questions (approx. 45 minutes) Administered in groups 25 questions (approx. 70 minutes) Administered in groups 13 Questions (approx. 15 minutes) Individually administered * DROP DOWN ONE LEVEL FOR ESOL LEVELS 1-2

35. Florida Department of Education John L. Winn, Commissioner ADMINISTERING LISTENING AT LEVELS B-D Grade Levels: 3-5 (B) 6-8 (C) 9-12 (D) Test design is identical across levels for Listening Listening is all multiple-choice

36. Florida Department of Education John L. Winn, Commissioner LEVEL B-D LISTENING Divided into four parts Script contains all of the test items to which students must respond. Script can be delivered in two ways:  Recorded Delivery: playing the CD  Administrator Delivery: reading the script aloud Approximate testing time is 25 minutes.

37. Florida Department of Education John L. Winn, Commissioner LEVEL B-D READING Divided into two parts:  Part one: Students answer discrete vocabulary questions.  Part two: Students read passages and answer questions about each passage. Approximate testing time for the Reading section is 45 minutes.

38. Florida Department of Education John L. Winn, Commissioner LEVEL B-D WRITING Divided into four parts  Part one and Part two contain multiple-choice questions  Parts three and four require students to write sentences and paragraphs, respectively Approximate testing time for the Writing sections is 70 minutes

39. Florida Department of Education John L. Winn, Commissioner IMPORTANT REMINDER Students in grades 3-5 who are ESOL 1 and 2 use two answer documents: Level B Listening/Speaking answers will be recorded on the level B, C, and D Answer Sheet. BOX #22 of the answer sheet must be bubbled YES. Level A Reading/Writing answers will be recorded directly in the test book. Labels ‘link’ the two answer documents

40. Florida Department of Education John L. Winn, Commissioner IMPORTANT TEST ADMINISTRATION DETAILS Do not allow the students to use any extra paper or scratch paper. Only answers written in the spaces provided will be scored. All responses must be recorded with a No.2 pencil. If a student makes an error, ensure that they have erased it completely (do not use correction fluid). Thesauruses, dictionaries, or similar tools are not permitted.

41. Florida Department of Education John L. Winn, Commissioner Student Demographic Information

42. Florida Department of Education John L. Winn, Commissioner Sample of a Pre-ID Label

43. Florida Department of Education John L. Winn, Commissioner Student Pre-ID Labels Students entering after January 12, 2007, will not have pre-id labels. Each student will have 3 pre-id labels –Used to ‘link’ multiple answer documents if necessary The following information must be correct for a label to be used: Name, (First and Last) Date of Birth Grade School District

44. Florida Department of Education John L. Winn, Commissioner Incorrect or No Pre-ID Labels If a student does not have a label, OR If any of the printed information is incorrect, so that the label cannot be used, THEN All demographic information must be bubbled in on the answer document. Page 20-22 of the Test Administration Manual provides information on bubbling in the demographics information. All fields must be filled out.

45. Florida Department of Education John L. Winn, Commissioner LINKING LABELS Required for: ESOL level 1 and 2 students in grades 3-5; Taking the Level A Reading and Writing; and Level B Speaking and listening, and Did not receive a Pre-ID label. Linking labels ensure the accurate match of the student’s two answer documents If such a student DOES have Pre-Id labels, use those instead.

46. Florida Department of Education John L. Winn, Commissioner SPECIAL ADMINISTRATIONS The Division of Special Education, 305 274- 8889, will provide assistance with questions concerning: –Special accommodations and test administrations issues regarding (Braille, large-print, deaf, and hard-of-hearing) Reminder: No Braille version of Level A Test Books. CELLA will not be administered to these students

47. Florida Department of Education John L. Winn, Commissioner DAMAGED OR SOILED ANSWER DOCUMENTS  School Coordinator transcribes the information from the damaged answer document onto a new document.  Mark the damaged documents with a large ’X’. Return damaged answer documents with the brown “Not To Be Scored” boxes.  Bundle the new transcribed answer document with the other “To Be Scored” materials for that grade.

48. Florida Department of Education John L. Winn, Commissioner Soiled Answer Documents For soiled materials, call Student Assessment and Educational Testing at 305 995-7520. Provide the serial number, then destroy the soiled document.

49. Florida Department of Education John L. Winn, Commissioner Test Administration Irregularities Examples which may require invalidation upon completion of a full investigation: –Student(s) caught cheating –Student(s) very disruptive –Fire alarm or similar event occurs during the testing session –Student becomes ill and is unable to finish –Student is removed by a parent prior to the end of the allotted time for testing –Administration time limited (No CELLA sessions have time limits) Each circumstance should be treated individually. –Call Student Assessment and Educational Testing, (SAET) and report any such irregularities –If the incident involves a test security violation, a written memorandum to SAET will also be required.

50. Florida Department of Education John L. Winn, Commissioner 2007 Florida CELLA Test Irregularities Report Form Appendix A This form should be used to report any security violations, misconduct, or other incidents. Place all completed original forms inside on top of the first white box.

51. Florida Department of Education John L. Winn, Commissioner SCHOOL COORDINATOR ROLES MANAGE MATERIALS Receipt of Materials Keep all boxes in which materials arrived. Request additional materials from TDC as soon as possible. Remove the shipping notice from Box 1. Verify the quantity of each item received. Track Materials Ensure an internal tracking system is used to track all test materials  Directions for Administration and Scoring Guide  Secure Test booklets and answer sheets  CDs Count and verify materials distributed to and received from test administrators Always store all testing materials in a secure locked location.

52. Florida Department of Education John L. Winn, Commissioner SCHOOL COORDINATOR ROLES PREPARE FOR ADMINISTRATION Train Test Administrators for Group Administration –Ensure the appropriate number of test administrators and proctors are available –Ensure that test administrators understand their roles and are prepared prior to testing Coordinate individual administration with contracted employees

53. Florida Department of Education John L. Winn, Commissioner SCHOOL COORDINATOR ROLES DURING TESTING Testing Environment –Rooms used for testing should provide the following: Good lighting Comfortable temperature Proper ventilation Freedom from noise and interruption “Do Not Disturb --- Testing in Progress” sign on the door Supervision of Test Administration and Test Security –Monitor group and individual administration

54. Florida Department of Education John L. Winn, Commissioner Test Administrator Roles & Responsibilities Prior to testing Must appropriately account for and protect the security of the test materials. Test administrators can use the CELLA security log or a school developed security log. Need to become familiar with the Directions for Administration and Scoring Guide. Must maintain a record of exemptions, absences and invalidations.

55. Florida Department of Education John L. Winn, Commissioner Test Administrator Roles & Responsibilities Continued During the Test Administration Post “Do Not Disturb --- Testing in Progress” sign on the door. Must make sure students are on task. After Testing Be sure to report any problems to the school’s test chairperson and complete a Florida CELLA Irregularity Report if necessary.

56. Florida Department of Education John L. Winn, Commissioner RETURN OF CELLA MATERIALS Please refer to the return instructions provided in the training packet ONLY. To Be Scored Bundle answer documents by grade level. Bundle documents by type (test books separate from answer sheets within grade) in grades 3-5 if applicable. Place a Grade Header on the top of each grade. Secure bundles with paper bands. Place a School Header at the top of all grades in Box #1. Place originals of all forms on top of the School Headers.

57. Florida Department of Education John L. Winn, Commissioner

58. Florida Department of Education John L. Winn, Commissioner NEW RETURN PROCEDURES CELLA materials will be picked up at the school sites. Fill out the 2007 Florida CELLA School Coordinator Materials Return Form Fax copies to ETS at 1-866-387-2598 and Student Assessment and Educational Testing at 305 995-7522 Call Eagle Logistics at 1-800-888-4949 for pick-up

59. Florida Department of Education John L. Winn, Commissioner

60. Florida Department of Education John L. Winn, Commissioner NEW RETURN PROCEDURES Package materials according to the instructions in your packet. However... Do not return materials to TDC as instructed in your packet. Disregard return instructions in the CELLA manual.

61. Florida Department of Education John L. Winn, Commissioner RETURN OF CELLA MATERIALS CONTINUED Not To Be Scored Organize materials in the following order: –All Florida CELLA School Coordinator’s or Test Administrator’s Suggestion Forms, –All CDs, –Test Administration Manuals, –Directions for Administration and Scoring Guide, –Unused Level A answer books, –Test Booklets (Levels B, C, and D), –Unused answer sheets, –Unused linking labels or pre-id labels, –Damaged materials (answer sheets or test booklets), –Invalidations (answer sheets or test booklets), and –Absences (answer sheets or test booklets).

62. Florida Department of Education John L. Winn, Commissioner RETURN OF CELLA MATERIALS CONTINUED Wrap like materials with paper bands. Return all To Be Scored and Not To Be Scored materials to TDC Open Window: May 14 – 25 Final Return: May 29 - 30

63. Florida Department of Education John L. Winn, Commissioner District Level Training Contact Information CELLA ProgramDr. Joanne Urrutia, Administrative Director, Division of Bilingual Education and World Languages, 305 995-1945 Individual administrations of One – on – One or Speaking Sessions Ms. Beatriz Pereira, Executive Director, Division of Bilingual Education and World Languages, 305 995- 7430 Group Administered Sessions Ms. Mayda Cabeza, Director I, Student Assessment and Educational Testing, 305 995-7520 mcabeza@dadeschools.netmcabeza@dadeschools.net Test MaterialsMs. Magaly Hernandez, Supervisor I, Test Distribution Center, 305 995-3743 13135 SW 26 Street, Miami Fl. 33175 Hours of Operation: 7:30a.m. – 3:30p.m. Special Accommodations for SPED students Ms. Rosalia Gallo, Instructional Supervisor, Division of Special Education, 305 274-8889 or rgallo@dadeschools.net rgallo@dadeschools.net