1. Teaching Reading: Elementary Education Capacity Committee Meeting July 8, 2013 Kathy Pruner Client Relations Director Eric Steinhauer Principal Assessment Designer Copyright © 2013 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. ETS10083A

2. A Reading Test for Ohio Testing Ohio Candidates Test Development and Validity Evidence Test Content and Research Base Review of Ohio Passing Score | 2 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441 Today’s Agenda

3. Ohio RFP for a Reading Test Test selected: Praxis Teaching Reading: Elementary Education Candidates: Ohio third grade teachers seeking to meet requirements of ORC 3313.608 Fourth Grade Reading Capabilities (aka Third Grade Reading Guarantee) –Effective July 1, 2014 - earned a passing score on a rigorous test of principles of scientifically research-based reading instruction Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.

4. Teaching Reading: Elementary Education 4 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441 Designed to measure critical knowledge and skills that elementary teachers will use to support reading development 2 ½ hours testing time Delivered on computer –Includes questions in two formats: 90 selected response (S/R) – 75% of the test 3 constructed response (C/R) - 25% of the test –Innovative items with audio stimuli and video stimuli, etc.

5. Teaching Reading: Elementary Education Content Categories 5 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441 I. Assessment and Diagnostic Teaching of Reading 27% II. Reading Development A. Phonemic Awareness and Oral Language Development B. Phonics and Alphabetic Principle C. Word-Analysis Skills and Vocabulary Development D. Development of Reading Fluency and Reading Comprehension E. Reading Comprehension Strategies Across Text Types 46% III. Writing in Support of Reading A. Interdependence of Reading and Writing Development B. Reading and Writing as Tools for Inquiry and Research 27%

6. Teaching Reading: Elementary Education Key Dates 6 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441 Multi-state standard setting November 2012 Registration beginsJuly 2013 Free test preparation materials available to candidates July 2013 First administrationOctober 2013

7. Testing Ohio Candidates Copyright © 2013 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. ETS10083A

8. Ohio’s Praxis Website 8 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

9. Registration and Score Reporting Registration completed through Praxis website and available 24/7 at http://www.ets.org/praxis/register/ http://www.ets.org/praxis/register/ Test fee is $139 Candidates select school district as score recipient during test registration process Scores are reported to school district 15 business days following last day of testing window 9 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

10. Computer Testing Windows for 2013-2014 October: 10/7/2013 – 10/19/2013 December: 12/9/2013 – 12/21/2013 January: 1/13/2014 – 1/25/2014 February: 2/3/2014 – 2/15/2014 April: 4/7/2014 – 4/19/2014 May: 5/12/2014 – 5/24/2014 July: 7/14/2014 – 7/25/2014 August: 8/4/2014 – 8/16/2014 10 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

11. Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. Test Centers for Ohio Candidates

12. Test Development and Validity Evidence Copyright © 2013 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. ETS10083A

13. 13 The whole process for teacher tests 1.Job Analysis 2.Creation of Test Specifications 3.Item Creation & Test Assembly 4.Test Administration 5.Item Analysis and Evaluation 6.Scoring Candidate’s total score is: 170 Decision: PASS Minimum passing score is: 162 2.Agencies/states set a “cut score” 1.Standard Setting Study Big picture

14. 14 The whole process for teacher tests 1.Job Analysis 2.Creation of Test Specifications 3.Item Creation & Test Assembly 4.Test Administration 5.Item Analysis and Evaluation 6.Scoring Candidate’s total score is: 170 Decision: PASS Minimum passing score is: 162 2.Agencies/states set a “cut score” 1.Standard Setting Study Big picture

15. Creating a Rigorous, Research-based Assessment 15 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441 Job Analysis Report

16. Creating a Rigorous, Research-based Assessment 16 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441 Following a process of Evidence-Centered Design (ECD), the NAC translated the knowledge and skill statements into evidence statements

17. Creating a Rigorous, Research-based Assessment 17 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

18. 18 The whole process for teacher tests 1.Job Analysis 2.Creation of Test Specifications 3.Item Creation & Test Assembly 4.Test Administration 5.Item Analysis and Evaluation 6.Scoring Candidate’s total score is: 170 Decision: PASS Minimum passing score is: 162 2.Agencies/states set a “cut score” 1.Standard Setting Study Big picture

19. Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. Standard Setting Not Yet Qualified Qualified (Still Not Qualified) Target Candidate (Just Qualified) Passing Score Low Score High Score

20. Standard Setting Process 20 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

21. Standard Setting Technical Report 21 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

22. Test Content and Research Base Copyright © 2013 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. ETS10083A

23. Teaching Reading: Elementary Education Calls for candidates to demonstrate –Knowledge of how to use diagnostic reading data to differentiate instruction –Knowledge of instructional strategies to support the development of different literacy skills 23 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

24. Teaching Reading: Elementary Education –Application of knowledge in situations calling for instructional decision-making Analyzing student assessment data Planning instruction to meet specific student needs Demonstrating an understanding of instructional strategies 24 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

25. Teaching Reading: Elementary Education 2010 International Reading Association Common Core State Standards –Print Concepts –Phonological Awareness –Phonics and Word Recognition –Fluency –Comprehension –Writing 25 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

26. Technology-enabled Response Formats 26 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441 Click and drag words from the fifth-grade word wall to answer the questions that follow. Provide two pairs of homophones from the word wall.

27. Teaching Reading: Elementary Education 27 Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441

28. The test categories and content are grounded in scientific research Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. Report of the National Reading Panel Teaching Children to Read

29. What is the National Reading Panel? Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. 1997, initiated by Congress Partnership between the Secretary of Education and the NICHD Task: Determine the effectiveness of various approaches to teaching children to read. Evaluate readiness for implementation by teachers.

30. The Process Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS. Analyzed the 1998 National Research Council report 1998 - Series of regional hearings attended by teachers, parents, scientists, students and policymakers A rigorous methodology-measureable outcome, experimental design, refereed

31. The Topics Chosen by the Reading Panel Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.

32. What were the findings of the National Reading Panel? Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.

33. A Few Findings from the National Reading Panel: Children should be explicitly and systematically taught to manipulate phonemes with letters. Focus on 1 or 2 types of phoneme manipulation rather than multiple types. Repetition and multiple exposures to vocabulary items are important. Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.

34. Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.

35. Common Themes in Scientifically-Based Reading Research Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.

36. “A critical element for preventing reading difficulties in young children is the teacher. Central to achieving the goal of primary prevention of reading difficulties is the teacher's knowledge base and experience…” Preventing Reading Difficulties in Young Children p. 329 Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.

37. Adopting a Passing Score for Ohio A policy decision to achieve Ohio’s Goals…

38. Reviewing the Multistate Process Two independent panels 28 educators Two-day process for each panel Research-based methodology Two rounds for judgments

39. Review of Recommendations 39 (+1 CSEM) Score Scale = 100-200. Multistate panels’ decision was 71 raw score points out of a possible 107; equivalent to 162 scaled score. Ohio ESB decision – set 162 as passing score

40. Ohio Passing Score Decision Ohio ESB voted on June 18, 2013 to adopt 162 as passing score and review Ohio performance data after one year. Passing scores can always be revisited to assure it is serving your purposes

41. Contact Information Kathy Pruner – kpruner@ets.org CRD for Ohio 609-683-2694 Eric Steinhauer – esteinhauer@ets.org Principal Assessment Designerkpruner@ets.orgesteinhauer@ets.org Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING. are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.