June 21, 2011 CCSSO-NCSA Stretching NAEP – But in Which Directions? 6/21/11CCSSO-NCSA

Stretching NAEP … Moderator David Driscoll, Chair, National Assessment Governing Board Panelists Lou Fabrizio, Director of Accountability Policy & Communications NC Dept. of Public Instruction Steven Paine, VP Strategic Planning and Business Development, CTB/McGraw Hill W. James Popham, Professor Emeritus, UCLA Cornelia Orr, Executive Director, NAGB CCSSO-NCSA 2 6/21/11

Discussing Ideas for Stretching NAEP Session Format Presentation of Ideas (20 min.) Small Group Discussions (30 min.) 1.Discussion suggestions presented 2.Identify other “stretch” possibilities Large Group Discussion (30 min.) CCSSO-NCSA 3 6/21/11

Making a Difference NAEP as part of the National Effort to:  Improve Student Achievement  Close Achievement Gaps Using NAEP tools and audiences examples  12 th Graders Taking NAEP Test Seriously  Parents Understanding Proficiency CCSSO-NCSA 4 6/21/11

Ex. Ideas for Stretching NAEP Find appropriate ways to inform parents about NAEP and the urgency of addressing the achievement gap Make NAEP results and NAEP resources—such as test items, data, and frameworks—accessible and useful to teachers Provide feedback to students who participate in NAEP about how they perform Provide NAEP items for diagnostic assessments Make information on NAEP more accessible by widespread audiences CCSSO-NCSA 5 6/21/11

Your Ideas Motivation of students – giving feedback Let districts who want to be involved participate Motivate locals by sharing information with them Document relationship with Common Motivation partnership with parents and PTOs (NAEP Parent Institute-certification or promoters of NAEP) Use/promote use of NAEP tools, Real Estate ? Use results at the school level CCSSO-NCSA 6 6/21/11

Your Ideas School-level reporting What is happening in the field Linking to CC Assessments Use of Computer adaptive testing (better estimates) Opportunity to partner with parents (better communication and information) Why 12 th grade, why not 10 th grade to make the use of the data more useable locally CCSSO-NCSA 7 6/21/11

Your Ideas Giving better results at the school level Give other things to schools, not just results (ex. Prof. development) Making reports easier for parents to understand Common Core – why do we need NAEP? Give oversampled student results Making NAEP more relevant today – connections to the Common Core CCSSO-NCSA 8 6/21/11

Your Ideas Sprinkle NAEP items in State Assessment 11 th grade Other grade – end of 9 or 10 Below state NAEP expanded opportunities Work with consortia to adopt scale for achievement PSA RE: importance of NAEP NAEP Tool more accessible for schools Reporters – something down and dirty “how to use NAEP data” CCSSO-NCSA 9 6/21/11

Your Ideas Inclusion policy – move toward more consistency Provide models for state assessments about how innovations can move forward More embedded in Common Core Motivation in 12 th grade – schools don’t have an accurate idea about NAEP Communicate with parents and the public about what NAEP is, ex., podcasts CCSSO-NCSA 10 6/21/11

Your Ideas Value of NAEP data to the field staff (don’t know how data can be used and can’t sell it) and schools Feedback to schools – would be useful and national in schools Continue to help states strengthen tests and curriculum NAEP continues to be relevant even in the Common Core era CCSSO-NCSA 11 6/21/11

Your Ideas NAEP continue to point out variable rigor on proficient Open new frontiers in assessment, ex. Online assessment R&D, pioneer, make mistakes, Advantages of NAEP sampling, techniques, assessing SWD Emphasize descriptive information (not accountability) Keep agenda of other content areas CCSSO-NCSA 12 6/21/11

Your Ideas Difference of preparedness vs. readiness think about careers Getting back to basics – leadership in psychometrics Linking – increasing links to other assessment (SAT, etc.), increasing opportunities for student linking 4 th to 8 th, mini diagnostic tool using released items Feedback to students teachers and schools CCSSO-NCSA 13 6/21/11

Your Ideas NAEP linking classroom instructional practice in the classroom to scores Public document – lessons learned and common misconceptions Common Core Repository info for/from the Consortia and alignment Connecting state level data to NAEP data Connect Question tool to Consortia Definition of Preparedness CCSSO-NCSA 14 6/21/11

Your Ideas Don’t do any of the ideas. Use the bully pulpit of NAEP to argue for best psychometric practices to reduce sampling error (pilot testing practices) and maintain high reliability on produced test. Continue to focus on what NAEP does well. Study bumps in the scores to determine contributing factors. CCSSO-NCSA 15 6/21/11

Contact Information Cornelia Orr, Executive Director National Assessment Governing Board CCSSO-NCSA 16 6/21/11