The Colorado Excellence Gap Dr. Jonathan A. Plucker CAGT Annual Conference October 11, 2011 1.

Slides:



Advertisements
Similar presentations
Jamesville-DeWitt School Report Card Presented to the Board of Education May 10, 2010.
Advertisements

The Kentucky Excellence Gap Dr. Jonathan A. Plucker 32 nd Annual KAGE Conference February 6,
Leaders Impacting the GGap Dr. Jonathan A. Plucker CAGT Leadership Breakfast October 11,
Achievement of Hmong Students in Saint Paul Public Schools Hmong Youth Educational Services Banquet – June 2006 Tom Watkins Director of Research, Evaluation.
Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
NYC ACHIEVEMENT GAINS COMPARED TO OTHER LARGE CITIES SINCE 2003 Changes in NAEP scores Leonie Haimson & Elli Marcus Class Size Matters January.
School Report Cards 2004– The Bottom Line More schools are making Adequate Yearly Progress. Fewer students show serious academic problems (Level.
Achievement Gaps in the SEDL Region: What Data Tell Us Closing the Achievement Gap: School Resources and Beyond SEDL Policy Forum 2004 September 27-28,
TM Confidential and Proprietary. Copyright © 2007 by Educational Testing Service. 1.
Shelda Hale, Title III, ELL and Immigrant Education Kentucky Department of Education.
Robert L. Linn CRESST, University of Colorado at Boulder Paper presented at a symposium sponsored by the National Association of Test Directors entitled.
Mark DeCandia Kentucky NAEP State Coordinator
Office for Education Policy: “Making Evidence Matter” Marc Holley Nate Jensen Brent Riffel Gary W. Ritter, Director.
March 2010 what the school readiness data mean for Harford County’s children ©
NYC ACHIEVEMENT GAINS COMPARED TO OTHER LARGE CITIES SINCE 2003 Changes in NAEP scores Class Size Matters August
The Problem… The Global Picture: PISA Scores Science: USA is 20 th Place; behind all tested regions of China Reading: USA is 14 th Place; behind 2/3.
The State of Education in Indiana Jonathan A. Plucker, Ph.D. Indiana Association of Colleges for Teacher Education March 31, 2006.
NAEP and International Assessments August 28, 2013 DAC Annual Meeting.
Shattering Expectations: Breaking the Glass Ceiling of Achievement National Achievement Trends and AP Access Iris Maria Chavez, The Education Trust June.
Maryland School Assessment (MSA) 2010 Results Leslie Wilson, Assistant State Superintendent Division of Accountability and Assessment July 20, 2010 State.
© 2010 THE EDUCATION TRUST Raising Achievement and Closing Gaps Between Groups: Roles for Federal Policy.
The Role of Education in 21 st Century Competitiveness Dr. Jonathan A. Plucker March 24, st Annual Conference for Innovative Education 1.
Perspectives on Impact Evaluation Cairo, Egypt March 29 – April 2, 2009 Presented by: Wayne M. Harding. Ed.M., Ph.D., Director of Projects, Social Science.
Excellence Gap Research in the U.S.: A 20-year Perspective Dr. Jonathan A. Plucker February 18, 2012 AAAS Annual Meeting Vancouver, British Columbia 1.
Standards The Achievement Gap The Debate Continues.
Children Entering School Ready to Learn The Maryland School Readiness Report what the school readiness data mean for Maryland’s children.
Telling the Successes of Public Education July, 2014.
CALIFORNIA DEPARTMENT OF EDUCATION Jack O’Connell, State Superintendent of Public Instruction Results of the 2005 National Assessment of Educational Progress.
March 7, 2013 Texas Education Agency | Office of Assessment and Accountability Division of Performance Reporting Accountability Policy Advisory Committee.
1 Is the Achievement Gap in Indiana Narrowing? September 19,
Mark DeCandia Kentucky NAEP State Coordinator
NAEP 2011 Mathematics and Reading Results NAEP State Coordinator Mark DeCandia.
Academic Excellence Indicator System Report For San Antonio ISD Public Meeting January 23, 2006 Board Report January 23, 2006 Department of Accountability,
The Excellence Gap: A New Lens for Education Policy and Advocacy Dr. Jonathan A. Plucker March 18, 2012 Belin-Blank Center/NAGC Acceleration Summit 1.
AARRGGHH!! Data Analysis! Just Do It For Me & Tell Me What It Says! Laura Boudreaux Pitre Merry Jane Bourgeois WORKING DRAFT 5/24/06.
The Excellence Achievement Gap: State-Level Data Jonathan A. Plucker, Ph.D. Terry Spradlin, M.P.A. Amber Esping Indiana University American Psychological.
Good things that are happening for kids. Texas Students Rank #1, #2, & #3 in the nation! When comparing students by subgroups, Texas 4 th and 8 th graders.
Review of Special Education in the Commonwealth of Massachusetts: Findings and Recommendations Dr. Thomas Hehir Silvana and Christopher Pascucci Professor.
Why should you care about diversity?. 2 There are significant disparities in the education, economic well- being, and health of children in the U.S. based.
District 11 CSAP Results School Year D11 Board Presentation August 9,2006.
1 Accountability Systems.  Do RFEPs count in the EL subgroup for API?  How many “points” is a proficient score worth?  Does a passing score on the.
University of Colorado at Boulder National Center for Research on Evaluation, Standards, and Student Testing Challenges for States and Schools in the No.
1 Grade 3-8 English Language Arts Results Student Growth Tracked Over Time: 2006 – 2009 Grade-by-grade testing began in The tests and data.
2009 Grade 3-8 Math Additional Slides 1. Math Percentage of Students Statewide Scoring at Levels 3 and 4, Grades The percentage of students.
Measuring Turnaround Success October 29 th, 2015 Jeanette P. Cornier, Ph.D.
Toll Middle School Title I Parent Meeting August 27, 2015.
Ready At Five & Maryland State Department of Education.
Children Entering School Ready to Learn The Maryland School Readiness Report what the school readiness data mean for Maryland’s children.
American Education Research Association April 2004 Pete Bylsma, Director Research/Evaluation/Accountability Office of Superintendent of Public Instruction.
March 2013 Children Entering School Ready to Learn The Maryland School Readiness Report Washington County.
Allegany County March 2012 Children Entering School Ready to Learn
Anne Arundel County March 2013 Children Entering School Ready to Learn
Cecil County March 2012 Children Entering School Ready to Learn
Wicomico County Children Entering School Ready to Learn
Prince George’s County
Washington County Children Entering School Ready to Learn
Harford County Children Entering School Ready to Learn
Dorchester County March 2013 Children Entering School Ready to Learn
Baltimore County March 2012 Children Entering School Ready to Learn
Michael J. Petrilli Chester E. Finn, Jr. Thomas B. Fordham Institute
Baltimore City March 2012 Children Entering School Ready to Learn
2017 NAEP RESULTS: DC PUBLIC CHARTER SCHOOLS
Queen Anne’s County Children Entering School Ready to Learn
Garrett County Children Entering School Ready to Learn
Calvert County March 2012 Children Entering School Ready to Learn
NAEP and International Assessments
Starting Community Conversations
Worcester County March 2012 Children Entering School Ready to Learn
Talbot County Children Entering School Ready to Learn
Frederick County March 2012 Children Entering School Ready to Learn
Presentation transcript:

The Colorado Excellence Gap Dr. Jonathan A. Plucker CAGT Annual Conference October 11,

2

“Two Subways, Dad.” 3

Center for Evaluation and Education Policy (CEEP) CEEP promotes and supports rigorous program evaluation and nonpartisan policy research primarily, but not exclusively, for education, human service and non-profit organizations. In the area of K-12 education policy, CEEP’s mission is to help inform, influence and shape sound policy through effective, nonpartisan research and analysis. For more information about CEEP, go to: 4

What is the Excellence Gap? There has been a lot of focus on minimum competency achievement gaps –the overall average gaps at low to medium levels of performance between demographic groups Comparatively little attention to gaps in performance among high ability students –In a good educational system we should see both equity AND excellence –Plenty of evidence this can happen 5

Super Awesome Quote! Education systems that fail to develop the potential of students from every background can make claims to neither quality nor equality. 6

Recent Fordham Study 57% of 90 th percentile students in ES/MS math (G3-G8) stayed “high fliers” using NWEA data. As did 56% in reading. At MS/HS level, 70% were “high fliers” throughout the study in math, 52% in reading. Students moved from the 50 th -89 th percentiles into the High Flier range more often than students dropped down. Growth was similar for all achievement groups, except for slower growth in reading for the High Fliers See edexcellence.net 7

Why Should We Care? Life prospects of students from disadvantaged backgrounds Equity of the Educational System –Shouldn’t there be roughly the same percentage of high-performing students from every background? Is minimum competency really enough? International Competitiveness 8

A Widening Excellence Gap TIMSS may be a better international assessment on which to base policy, since it samples by grade and not age and is similar in many ways to NAEP. Both in absolute and relative terms, it is clear the U.S. is at a huge disadvantage. 45%! Not 45%!

Measuring the Excellence Gap Percent Scoring at the Highest Level For example … Free and Reduced Lunch (FARM) : 6% Advanced Non-Free and Reduced Lunch (Non-FARM) : 15% Advanced 15% - 6% = Excellence Gap of 9% Can also measure using scores at a given high percentile, say the student at the 90th percentile (better for statistical reasons when tracking trends) 10

Excellence Gaps Using the NAEP The National Assessment of Educational Progress (NAEP) scored on a point scale Roughly every two years by the U.S. Department of Education Performance Levels are Determined by Cut-Scores (Basic, Proficient, Advanced) –Math Grade 4: 282 –Math Grade 8: 333 –Reading Grade 4: 268 –Reading Grade 8:

2009 NAEP Math Results In both Grade 4 and 8, a much smaller percentage of low- income, minority, and English- Language learner students score at the “Advanced” level on the NAEP 12

2009 NAEP Reading Results There are also large excellence gaps in Reading for FARM, Black, Hispanic, and ELL students 13

Summary of 2009 NAEP There are large gaps in the advanced achievement of under- represented groups relative to their peers on multiple assessments Race/Ethnicity Socioeconomic Status English Language Learners These populations are growing as a share of all students These high potential students cannot “take care of themselves.” 14

TRENDS 15

% Advanced in Math Grade 4 16 NCLB BAD GOOD NOT GREAT APOCALYPTICALLY BAD EMBARRASSINGLY HORRIBLE

% Advanced in Reading Grade 8 17 NCLB BAD APOCALYPTICALLY BAD EMBARRASSINGLY HORRIBLE

Trends in Reading Grade 4 at the 90 th Percentile

Long-Term Trends in the Excellence Gap If we go back before the passage of NCLB, there isn’t much evidence that the gaps are shrinking In 2009 the numbers for ELL students were especially discouraging, giving back most if not all previous gains over the last dozen years. 19

NAEP Math Grade 4 Gap Trends 20 Roughly 2-3 grade levels.

NAEP Math Grade 8 Gap Trends 21

NAEP Reading Grade 4 Gap Trends 22

NAEP Reading Grade 8 Gap Trends 23

Worse Than It Looks In many cases there has been very little change in overall performance Some gaps have shrunk because white or non-FARM scores have declined At the present rate, it would take decades (if ever) for the gaps to close. 24

Projected Trends in Reading Grade

A Distinct Problem The Excellence Gap is not the same phenomenon as the achievement gap Although achievement gaps are somewhat larger than excellence gaps, there are also closing more quickly and consistently This is especially true for lower-income students during the NCLB era (not that we’d call the rate achievement gaps are closing fast) 26

Achievement vs. Excellence Gaps, FARM students Rising tide?

A Complicated Story Focusing on race or income in isolation can give a misleading picture –Interaction of race & income –Changes in composition For example the decline in Reading Grade 8 scores among White and FARM students since 2003 is almost entirely due to lower scores among lower-income Whites. 28

Reading G8 90 th Percentile Trends 29 Poor white students performing at similar levels to not-poor Hispanic and Black students ()

More Evidence for the Excellence Gap 30 Not “underrepresented”

What About Colorado? Like the rest of the U.S., Colorado has substantial achievement gaps among advanced students … … but better than average absolute performance 31

CO NAEP Percent Advanced in Reading Grade Good! Not so good

CSAP Grade 4 Reading

CSAP Grade 7 Reading

CSAP Grade 10 Reading

CSAP Grade 4 Math

CSAP Grade 7 Math

CSAP Grade 10 Math

CSAP Grade 4 Reading by Lunch Status

CSAP Grade 4 Math by Lunch Status

U.S. vs. Colorado Standards for Advanced Colorado has lower standards for qualifying as an advanced level of achievement. A good example is Math Grade 4 41

CO State Test vs. NAEP Percent Advanced Grade 4 Math

% Advanced Math Grade 4 State vs. NAEP 43

BUT WHAT CAN WE DO ABOUT IT? 44

What is the Federal Government Doing? 45

What are States Doing? Although some states have adopted a mandate to identify and serve gifted students and have appropriated money to do so: –Gifted education funds are very vulnerable due to the fiscal climate –Most gifted education funding and policy is still carried out at the state level, with a major effect on equity –There is no evidence that ANY state has figured out a way to address Excellence Gaps, and many states have laughably low criteria for what constitutes an Advanced student 46

% Advanced Math Grade 4 State vs. NAEP 47

Recommendation #1 Make Closing the Excellence Gap a State and National Priority –Expose people to the data –That which is not visible is by definition invisible. –Stop pretending the U.S. is “post-racial” or “beyond class distinctions” Much criticism of G/T programs is deserved. 48

Recommendation #2 Policymakers and educators should ask two questions: –How will this impact advanced students? –How will this help more students perform at advanced levels? 49

Recommendations #3 and #4 Acknowledge That Both Minimum Competency and Excellence Can be Addressed At the Same Time –Other countries acknowledge this, why can’t we? Set Realistic Goal to Shrink Gaps –We’re not getting every subgroup to 10% advanced in every content area any time soon. 50

Recommendations #5 and #6 Determine the Appropriate Mix of Federal, State, Local Policies and Interventions –Federal mandate probably not a good thing –Federal research role probably a very good thing Use things that we know work well –Grouping, acceleration, identification PD 51

Recommendations #7, #8, and #9 Include the Performance of Advanced Students in Discussions of Common Standards Address the “Low-Hanging Policy Fruit” Immediately –Early graduation and financial aid Conduct More Research on Advanced Learning and Talent Development –How to address stereotype threat? 52

Future Excellence Gap Work Second edition of report around February 2012 Special report on science excellence gaps in near future Special report on the experiences of gifted black males around August 2012 Report on NAEP excellence gaps in major urban areas around this time next year. 53

Excessively Provocative Closing Thought There is no natural advocacy group for advanced students. 54 Congressional aide example.

55

CEEP Contact Information: Jonathan Plucker, Ph.D. Director 1900 East Tenth Street Bloomington, Indiana Fax: