1 Assessment, Accountability and Adaptation April 13, 2006 copies of this presentation can be found at www.business.duq.edu/faculty/davies.

Slides:



Advertisements
Similar presentations
Creating the Map To Set the Direction. Educational Positioning System (EPS – a play on GPS)
Advertisements

Low-Cost Private Schools Knowledge Framework Research methodology template.
Now That They Stay, What Next?: Using NSSE Results to Enhance the Impact of the Undergraduate Experience.
Challenge to Lead Southern Regional Education Board Kentucky Challenge to Lead Goals for Education Kentucky is On the Move Progress Report 2008 Challenge.
Challenge to Lead Southern Regional Education Board Tennessee Challenge to Lead Goals for Education Tennessee is On the Move Progress Report 2008 Challenge.
Local Control and Accountability Plan: Performance Based Budgeting California Association of School Business Officials.
Getting Organized for the Transition to the Common Core What You Need to Know.
The story of NorthLight
1 Do I Want to Be a Teacher? ED Intrinsic Rewards in Teaching Come from within and are personally satisfying for emotional or intellectual reasons.
© Asian Institute of Chartered Bankers All rights reserved.
Responding to the Assessment Challenges of Large Classes.
College Strategic Plan by Strategic Planning and Quality Assurance Committee.
School Climate Policy Levers for Mental Health Services Kelly Vaillancourt-Strobach, Ph.D, NCSP National Association of School Psychologists Director,
Archived Information. THE AMERICAN DIPLOMA PROJECT A Partnership of Achieve, Inc.; The Education Trust; and the Thomas B. Fordham Foundation More and.
EDUCATIONAL COUNSULTANCY SERVICES
Who Decides Wage Rates?. WHO DECIDES WAGE RATES? 0 OBJECTIVES 0 Students will be able to: 0 Explain how sellers of labor and buyers of labor interact.
GUIDANCE SYSTEM OF SUPPORT COLLEGE AND CAREER READY FOR ALL Guidance and Counseling Fall 2011.
No Child Left Behind State Communication Strategies KSA-Plus Communications July 2002 Prepared with support from a grant from the U.S. Department of Education.
Presentation Outline  Introductions  Why are “price sensitivity” and “value” important?  Strategic pricing & value enhancement framework  From research.
1 “So who wants to lead a mathematics department?” Developing Future Secondary Subject Leaders for Mathematics – Collaborative Action Research Project.
Educator Preparation, Retention, and Effectiveness Ed Fuller University Council for Educational Administration and The University of Texas at Austin February.
Families as Partners in Learning Principals and teaching staff Why are partnerships important?
Delaware Student Testing Program (DSTP) Informational Meeting and Public Forum Organized by Advocates for Children’s Education (ACE) February 12, 2003.
Causes of Failure in College from the College of Alabama Center for Teaching and Learning
ADULT LEARNING A AAA INVESTMENT IN YOU! MARCH 19, 2011 The State of Adult Education in Delaware.
1 PI 34 and RtI Connecting the Dots Linda Helf Teacher, Manitowoc Public School District Chairperson, Professional Standards Council for Teachers.
Creating SMART Goals Refer to pgs in spiral conference binder.
Superintendent’s Panel on Excellence in Adult Education.
Preparing For My Child’s Parent Teacher Conference Revised 3/13/2009.
Integrated Performance Information (IPI) Project Mike Switzer Workforce Florida, Inc. Jay Pfeiffer Florida Department of.
REQUIRED ELEMENTS. Standards are the centerpiece of a strong academic program. They are your roadmap and provide the what as teachers build curriculum,
Successful Practices Network ACTEA Zone 4 Professional Development Workshop Economic Development and its Impact on CTE in the Mid-Hudson.
1 No Child Left Behind for Indian Groups 2004 Eva M. Kubinski Comprehensive Center – Region VI January 29, 2004 Home/School Coordinators’ Conference UW-Stout.
PROGRESS & & ACHIEVEMENT Pennsylvania Value-Added Assessment System (PVAAS) The Power of Derry Township School District School Board Presentation Sept.
Restore Funding $300 million in cuts since Third largest cuts in the country to student spending 47 th in per pupil expenditures Source: National.
The Players and the Goals Two types of consumers Non-smokers (eat pizza) Smokers (eat pizza and smoke) Consumers’ goal: Maximize utility.
University Park Creative Arts School Title I Annual Parent Meeting Title I 101 September 12, :00 pm.
“A Truthful Evaluation Of Yourself Gives Feedback For Growth and Success” Brenda Johnson Padgett Brenda Johnson Padgett.
Programming the New Syllabuses (incorporating the Australian Curriculum)
West Central Community School District Performance Document: Formative Evaluation Tool By John Johnson ortheast Iowa Charter School Northeast Charter School.
Help Your Child Identify Interests Explore Careers and Develop Plans for the Future.
Best Practices and New Perspectives in HR The Strategic Data Project Human Capital Diagnostic Spring GASPA | May 5, 2011.
Ours is the age which is proud of machines that think, and suspicious of men who try to  KGW Consultants Ltd.
Teaching Leah Nature of the Work Teachers act as facilitators to help students learn and apply concepts to math, science, english, and history. Teachers.
WELCOME TO BUS 302 The Gateway Experience For more information visit:
Dear Parent/Carer Welcome to the fourth newsletter from the Governing Board of Parklands Junior School. The purpose of this newsletter is to inform you.
Wisconsin Administrative Code PI 34 1 Wisconsin Department of Public Instruction - Elizabeth Burmaster, State Superintendent Support from a Professional.
ITQ Institute Strengthening Instructional Leadership in Mathematics June 5, 2014 Focus 4; Communicating with Constituents; June 2014.
Introduction to Economics: Social Issues and Economic Thinking Wendy A. Stock PowerPoint Prepared by Z. Pan CHAPTER 17 THE ECONOMICS OF EDUCATION Copyright.
THE METLIFE SURVEY OF THE AMERICAN TEACHER: CHALLENGES FOR SCHOOL LEADERSHIP Gwendolyn Thomas Kimberly Patterson Shannon Biggs.
MSIP 5 and You What it means for your student and the Kansas City Public Schools.
Types of engineering organizations 1. Engineering Environment Awareness Aims Introduce types of engineering organizations with respect to size, ownership.
Educational Excellence – Phase One Lisa Blazer & Dan Gelo Presenting.
Using Data in a School Counseling Program Miss M. Brand Pine Grove Area Elementary School.
Johnson Middle School Johnson Middle School SCHOOL PROFILE 700 Student Population Virginia Public Schools Grades Number of Classrooms:28.
Defining 21st Century Skills: A Frameworks for Norfolk Public Schools NORFOLK BOARD OF EDUCATION Fall 2009.
By 2030, at least 60 percent of Texans ages will have a certificate or degree.
Smart Goal Draft EDLS 642 O’Donnell. Parent Involvement Strengths Parents choose to attend the school and generally start with greater agreement with.
High School Graduation Requirements
Robert P. King Department of Applied Economics April 14, 2017
The Texas Affordable Baccalaureate Creating opportunity for Texans
Whatever It Takes for Student Success
Developing Decision-Making Skills
Minnesota Literacy Council
THE JOURNEY TO BECOMING
Governance and leadership roles for equality and diversity in Colleges
Title I Annual Parent Meeting
Introduction to Quality
Gifted & Talented Provision
Presentation transcript:

1 Assessment, Accountability and Adaptation April 13, 2006 copies of this presentation can be found at

2 Education is a product. Economics provides tools for adequately addressing assessment, accountability, and adaptation, but to use the tools, we must first admit that education, while occupying a place of great importance, is fundamentally a product.

3 How does the market judge products, hold producers accountable, and adapt to consumers’ needs? Assessment AccountabilityAdaptation

4 The cycle begins with the consumer who develops a mental list of important attributes and a acceptable tradeoffs. Together, these form the basis of the consumer’s assessment of the product. Assessment AccountabilityAdaptation Attributes Tradeoffs

5 Consider grocery stores… The Consumer Has a List of Important Attributes Store is located in a safe and convenient location. The produce is fresh. There is a large selection of brands. The store has a deli. Prices are reasonable. The Consumer Is Aware of Acceptable Tradeoffs Convenient location is more important than fresh produce. Lower price is more important than having a deli.

6 The consumer assesses the performance of the store by comparing the store’s attributes to the consumer’s list of important attributes and acceptable tradeoffs. Assessment Attributes Tradeoffs

7 The consumer holds the store accountable via repeat purchase. If the store’s attributes are acceptable to consumers, the store’s sales rise. If not, the store’s sales fall. Assessment Accountability Attributes Tradeoffs

8 If sales fall, the store will mimic and/or improve upon attributes of stores with rising sales. If the store’s sales rise, competing stores will mimic and/or improve upon this store’s sales. This is adaptation. Assessment AccountabilityAdaptation Attributes Tradeoffs

9 The consumer now re-assesses the store in light of the store’s new attributes and any changes in the consumer’s attributes / tradeoffs. This is outcomes assessment. Assessment AccountabilityAdaptation Attributes Tradeoffs

10 In the market place, what might cause the AAA cycle to break down? Attributes Tradeoffs Assessment Adaptation Accountability

11 Break in the Cycle #1: Consumer is unidentified Attributes Tradeoffs Assessment AccountabilityAdaptation If the consumer is unidentified, questions arise: 1.What attributes are important? 2.What tradeoffs are acceptable? With an unidentified consumer:  Appropriate assessment becomes unclear.  Source of accountability becomes unclear.  Appropriate adaptation becomes unclear.

12 Assessment AccountabilityAdaptation Break in the Cycle #2: Accountability not Possible 1.Repeat purchase – the consumer must have a need to purchase again so as to signal pleasure; 2.Mobility – the consumer must be able to purchase elsewhere so as to signal displeasure; 3.Short-run assessment – the consumer must be able to assess product quality prior to the repeat purchase decision. If accountability is not possible  Appropriate adaptation becomes unclear.  Incentive for adaptation disappears. Possibility of accountability requires: Attributes Tradeoffs

13 How does the AAA cycle play out for primary and secondary education? Assessment Adaptation Accountability Attributes Tradeoffs First: Can we identify the consumer? Second: On what is assessment based? Third: Is accountability possible? Fourth: What adaptations result?

14 First: Can We Identify the Consumer? Student? Attributes: friends, sports, extracurricular activities. Parents? Attributes: safety, education, sports, future opportunities. Colleges? Attributes: critical thinking skills, math skills, communication skills, personality, drive. Employers? Attributes: work ethic, communication skills, ability to function as part of a team. Society? Attributes: likelihood of incarceration, likelihood of becoming a welfare recipient.

15 Second: On What is Assessment Based? If Consumer = Student Assessment based on the student’s social environment. If Consumer = Parents Assessment based on parents’ satisfaction with perceived educational environment. If Consumer = Colleges Assessment based on students’ college preparation. If Consumer = Employers Assessment based on students’ job skills. If Consumer = Society Assessment based on crime and poverty measures.

16 Only three definitions of “consumer” permit accountability. Third: Is Accountability Possible?

17 How we define “the consumer” ultimately determines how education will adapt. Definition of “consumer” determines attributes and tradeoffs, which determine assessment, which determines accountability, which determines adaptation. Fourth: What Adaptations Result?

18 Assessment AccountabilityAdaptation Assessment is college preparation. Accountability is imposed via acceptance rates. Schools adapt by making students more attractive to colleges so as to boost acceptance rate. Fourth: What Adaptations Result when Consumer = Colleges?

19 Assessment AccountabilityAdaptation Assessment is college preparation. Accountability is imposed via acceptance rates. Schools adapt by making students more attractive to colleges so as to boost acceptance rate. Unintended Consequence Schools will encourage students who are technically, rather than academically, talented to go to college rather than to prepare for the job market. Fourth: What Adaptations Result when Consumer = Colleges?

20 Assessment AccountabilityAdaptation Assessment is job skills. Accountability is imposed via employment and wage rates. Schools adapt by making students more attractive to employers so as to boost employment and wage rates. Fourth: What Adaptations Result when Consumer = Employers?

21 Assessment AccountabilityAdaptation Assessment is job skills. Accountability is imposed via employment and wage rates. Schools adapt by making students more attractive to employers so as to boost employment and wage rates. Unintended Consequence Schools will encourage students who are academically, rather than technically, talented to prepare for the job market rather than to go to college. Fourth: What Adaptations Result when Consumer = Employers?

22 Assessment AccountabilityAdaptation Assessment is educational environment. Accountability is imposed via changing schools. Schools adapt by making themselves more attractive to parents so as to boost enrollment and retention. Fourth: What Adaptations Result when Consumer = Parents?

23 Assessment AccountabilityAdaptation Assessment is educational environment. Accountability is imposed via changing schools. Schools adapt by making themselves more attractive to parents so as to boost enrollment and retention. Unintended Consequence Schools will develop educational environments that conform to parents’ perceptions of quality education. Fourth: What Adaptations Result when Consumer = Parents?

24 Let’s assume that: 1.We can skip the step of identifying the consumer, and 2.Standardized Testing is the appropriate assessment tool,  What is the impact of assessment on adaptation? Can We Assess Education Without Identifying the Consumer?

25 Assessment AccountabilityAdaptation Assessment is Standardized Testing. Accountability is imposed via funding (“high-stakes testing”). Schools adapt by making students better able to pass the test so as to boost funding. Fourth: What Adaptations Result when Consumer = Undefined?

26 Assessment AccountabilityAdaptation Assessment is Standardized Testing. Schools adapt by making students better able to pass the test so as to boost funding. Unintended Consequence Schools will prepare students to pass the Standardized Test (“teaching to the test”). Accountability is imposed via funding (“high-stakes testing”). Fourth: What Adaptations Result when Consumer = Undefined?

27 Let’s assume that: 1.We can skip the step of identifying the consumer, and 2.Standardized Testing is the appropriate assessment tool,  What attributes do school districts control? Fourth: What Adaptations Result when Consumer = Undefined?

28 An oft-cited important attribute is the Student-Teacher ratio This strategic plan stresses the need for strategies aimed at keeping more teachers in the classroom. – Strategic Plan, Texas Higher Education Coordinating Board, Teacher recruitment is the key to the drive to reduce class size. – Congresswoman Eddie Bernice Johnson, (D-TX), Utah will undertake several initiatives aimed at keeping more teachers in the classroom. – Utah Governor John Huntsman (R), Growing numbers of students in our nation’s schools…mean that our need for teachers increases each year. – Meeting the Challenges of Recruitment and Retention, NEA, 2005.

29 Student-Teacher Ratio has no apparent impact on NAEP scores. Source: National Center for Education Statistics, U.S. Department of Education Each dot represents one state. Reported scores are sums of state averages for math and reading.

30 School size has no apparent impact on NAEP scores. Source: National Center for Education Statistics, U.S. Department of Education

31 Spending per Pupil has no apparent impact on NAEP scores. Source: National Center for Education Statistics, U.S. Department of Education

32 Spending per Pupil has no apparent impact on NAEP scores. Source: National Center for Education Statistics, U.S. Department of Education

33 Source: National Center for Education Statistics, U.S. Department of Education Spending per Pupil has no apparent impact on NAEP scores.

34 Median Family Income has no apparent impact on NAEP scores. Source: National Center for Education Statistics, U.S. Department of Education

35 Perhaps standardized tests are inadequate for assessing the quality of education. What about dropout rate? This measure comes closer to reflecting parent/student choice-to-purchase.

36 Student-Teacher Ratio has no apparent impact on dropout rate. Source: National Center for Education Statistics, U.S. Department of Education

37 School Size has no apparent impact on dropout rate. Source: National Center for Education Statistics, U.S. Department of Education

38 Spending per Pupil has no apparent impact on dropout rate. Source: National Center for Education Statistics, U.S. Department of Education

39 Source: National Center for Education Statistics, U.S. Department of Education Spending per Pupil has no apparent impact on dropout rate.

40 Median Family Income has no apparent impact on dropout rate. Source: National Center for Education Statistics, U.S. Department of Education

41 Does anything predict Standardized Test performance or Dropout Rate?

42 For 8 th grade, past NAEP scores predict future NAEP scores. Source: National Center for Education Statistics, U.S. Department of Education

43 Source: National Center for Education Statistics, U.S. Department of Education For 4 th grade, past NAEP scores predict future NAEP scores.

44 4 th grade NAEP scores predict 8 th grade NAEP scores. Source: National Center for Education Statistics, U.S. Department of Education

45 Conclusion Attributes that conventional wisdom suggests are appropriate have little or no impact on Standardized Test Results or Dropout Rates. But, school performance is not random – states that perform well in the future are those that have performed well in the past. Supposition As most of the attributes employed by school districts are systemic, evidence suggests that educational quality may be better influenced via individual attributes.

46 Assessment, Accountability and Adaptation April 13, 2006 copies of this presentation can be found at