Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading July 24, 2008

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 2 Welcome and How We Got Here Introductions Planning Team Renee Cameto, SRI International Sue Bechard, Measured Progress Pat Almond, SRI International Consultant Martha Thurlow, NCEO, U of Minnesota Cara Laitusis, Educational Testing Service (ETS) Anne Chartrand, SERRC Jan Sheinker, SES Sheinker Educational Services. Kate Nagle, SRI International Kavita Seerantan, SRI International Participants

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading If we knew what we were doing, it wouldn’t be called Research. A. Einstein

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 4 Purpose of the Symposium Focus on assessment of reading for AA-MAS Engage in professional discourse about the application of the “tools of the trade” to a new area of research. Explore strategies for implementing cognitive interviews with students with disabilities. Explore strategies for investigating test and item manipulations that make assessments more accessible and valid. Provide support for researchers in these areas.

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 5 Non-purposes Discuss issues related to policy (e.g., eligibility guidelines). Discuss the “2% conundrum”. Determine the one right strategy or method. Create a list of current projects. Produce definitive conclusions.

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 6 Participants will….. Build on what we know Share relevant experiences and practices Identify what we don’t know and what we want to know Develop a synthesis of the status of the art

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 7 Expected outcomes for today Identify common experiences, challenges, and lessons learned Identify key issues and possible solution related to each topic Consider this a “launch event” for white papers Develop an outline for white papers Plan for paper production Identify potential authors for the white papers

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 8 Outcomes as a result of today Inform current grants and the broader field about research strategies related to key 2% issues Move the field forward with greater understanding of the challenges, important lessons learned, and advice to other researchers. Publish white papers (suggest journals and dissemination possibilities)

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 9 White Paper Definition (Wikipedia) A white paper is a report or guide that often addresses problems and how to solve them. White papers are used to educate readers and help people make decisions. They are used in politics and in business. The white papers published by corporations are usually available from their websites.

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 10 Audience: researchers White papers should focus on the needs of readers, rather than the specific solution. Length: pages

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 11 Organization of a White Paper Executive summary Introduction / Summary Quickly identify the main points Provide definitions of words used for specific purposes Background / Methodological Problems Provide readers with general background information of the issue in order to help them make their decisions based on the understanding of facts. Provide evidence. Point out problems from your readers' perspective. Do not pose problems for which you cannot provide possible solutions.

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 12 Organization of a White Paper (continued) Array of Solutions Propose solutions List steps or procedures, if applicable Conclusion References Appendices, if applicable

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 13 Other Considerations “Parking Lot” We’ll keep a list of topics of importance that come up in our discussions but are not part of today’s agenda Reference List for the White Paper Papers, articles, reports that are germane to our topics Mention them today, we’ll keep a running list Send us other references if you think of them after today

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 14 White Paper Logistics All participants recognized in the white paper Looking for a lead author and contributors for each topic Stipends/honorariums For lead authors - $1500 For contributors - $700 Reviewers – External review panel Production and publishing by SRI and Measured Progress

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 15 White Paper Timeline Section writers submit in 3-4 weeks by Labor Day Lead author compiles by end of October SRI/MP send to reviewers in early November Draft by Thanksgiving. To editors by early December Final version ready for distribution by end of December

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 16 TimeTask/TopicOrganizer(s) 8:00-8:30Breakfast 8:30–9:00Welcome and IntroductionsSue Bechard Renee Cameto 9:00–10:30Lessons from NARAP:Martha Thurlow Cara Laitusis 10:30–10:45Break 10:45–12:00Work Group A: Cognitive LabsAnne Chartrand Work Group B: Test and Item ManipulationsJan Sheinker 12:00–12:45Lunch 12:45–3:00Work Group A: Cognitive LabsAnne Chartrand Work Group B: Test and Item ManipulationsJan Sheinker 3:00–3:15Break 3:15–4:00Large group report-out and cross sharing Develop white paper plans Conclusions Wrap Up Pat Almond Sue Bechard Renee Cameto 4:00Adjourn Agenda

Invitational Research Symposium Alternate Assessments Based on Modified Achievement Standards in Reading 17 Assignments Work Group Assignments Cognitive Lab Work Group – past the food Test and Item Manipulation – stay in room Audio Taping