Assessing Students in the 21st Century

Assessing Students in the 21st Century
Presented by Jan Stanley, State Title I Director Karen Davies, Title I Coordinator

Framework for the 21st Century Skills
P21 Framework P21 Framework P21 Framework Framework The Partnership for 21st Century Skills has developed a unified, collective vision for 21st century learning that can be used to strengthen American education. An overview of this framework, with links to more information, is included below: The Partnership for 21st Century Skills has developed a unified, collective vision for 21st century learning that can be used to strengthen American education. An overview of this framework, with links to more information, is included below: The Partnership for 21st Century Skills has developed a unified, collective vision for 21st century learning that can be used to strengthen American education. An overview of this framework, with links to more information, is included below: The Partnership for 21st Century Skills has developed a unified, collective vision for 21st century learning that can be used to strengthen American education. An overview of this framework, with links to more information, is included below: The Partnership for 21st Century Skills has developed a unified, collective vision for 21st century learning that can be used to strengthen American education. An overview of this framework, with links to more information, is included below: Framework for the 21st Century Skills As we view the framework for 21st century skill, note that assessment is the base of all components.

Common Language? Formative Assessments Summative Assessment
Assessment FOR Learning Benchmark Assessments Assessment OF Learning Formative Classroom Assessments FOR Learning

What is a balanced assessment system
What is a balanced assessment system? Assessment OF Learning Assessment FOR Learning How does Assessment OF Learning differ from Assessment FOR Learning? All assessments can generally be classified into one of two categories: Assessments of learning Assessments for learning We should be accessing to inform instructional decisions and encourage students to accept responsibility for their learning. As special education and Title I teachers move toward providing academic interventions and accept increased accountability for monitoring the progress of students achieving below mastery, an understanding of assessment is imperative. Define the word OF-attributed to; apart from; proceeding as a product of something; characterized by Define the word FOR–in the interest of; with the purpose of; suitable to; with regard to; corresponding to What a difference a word makes…. Assessment OF learning – Assessment FOR learning Rick Stiggins published an article entitled this in the winter 2006 edition of the National Staff Development Council publication. The WVDE staff also had the privilege of working with him for 2 days in January. Provide teams a copy of the article

A Balanced Assessment System
Summative Assessments Benchmark Assessments Formative Assessments OF Learning Formative Assessments/Classroom Assessments FOR Learning All three levels are important. One level cannot replace another. In discussing this, refer to chart developed by the Superintendent’s Center for 21st Century Schools. Refer to handout

A Balanced Assessment System
Ensures that all instructional decisions are based on data Meets the informational needs of following groups: State District School Classroom (teachers and students) Parents Why utilize a balanced assessment? Data driven instruction

State Summative and Local Benchmark Assessments
Who are the primary users? What are the typical uses? What is being assessed? What methods are being used? When do we assess? State Summative: Primary users include State, District and School Local Benchmark: Primary users include District, School, and Classroom teacher Typical uses: State Summative -To:-Verify individual and group mastery of standards & objectives-Measure achievement status at a point in time for purposes of reporting & accountability-Make decisions about district & school programs and resources Benchmark-To:-Verify individual and group mastery of specific objectives-Identify students who require additional support-Provide instructional feedback to teachers-Identify objectives not yet mastered (gaps) early enough to enable teachers to make adjustments in the instructional program Assess what? Summative – State standards and objectives Benchmark – Specific objectives as determined by the local curriculum map or pacing guide At the benchmark level you are assessing fewer objectives, but you are assessing more often. Assessment methods? Typically the same methods are used for the state accountability test and local benchmark assessments – selected response (multiple choice) and constructed response (short answer) Local benchmark assessments are often generated from purchased test item banks that are aligned with state standards. Assess when? Benchmark assessments are usually administered 3 or 4 times a year. You increase the frequency of summative assessments.

Assessment FOR Learning Assessment OF Learning
Assessment User Assessment FOR Learning Assessment OF Learning State Department of Education Community Which districts/schools are making adequate yearly progress? Are the students acquiring skills to prepare them for the 21st century? Superintendent District Administrators Are our chosen strategies to improve achievement producing results? How shall we allocate district resources to achieve success? Principal How shall we allocate our resources to achieve success? Is classroom instruction producing results? Those outside the classroom make assessment OF learning decisions. To summarize: One may think of assessments OF learning as summative assessments and assessments For learning as formative assessments.

Assessment OF Learning
Administered after learning has occurred Utilized to communicate statements of student learning status to those outside the classroom Used to gather evidence for a student's report card grade – final exams and projects Administered to demonstrate accountability To summarize: Types of assessments in this category: National assessments such as NAEP State assessments-WESTEST Local standardized tests College admissions tests Most often this is group data used to inform administrators and teachers the percentage of students meeting standards. School District Community These tests are usually limited to a selected response or multiple choice.

A Process During Learning
Formative Assessment A Process During Learning Who are the primary users? What are the typical uses? What is being assessed? What methods are being used? When do we assess? Primary users: Classroom teachers Typical uses: To:-Support learning-Reflect progress toward mastery of objectives-Help teachers diagnose and respond to student needs-Adjust instruction based on results-Understand which building blocks (learning targets) require additional attention-Provide descriptive feedback to students Assess what? This is a major difference in benchmark and formative assessment: Small Explicit Learning Targets: Instructional objective(s) that are broken down into component parts that enable students to build toward mastery -Knowledge required-Patterns of reasoning-Performance skills-Product development Key: Focus on one aspect of quality at a time Assess how? This is also a major difference in benchmark and formative assessment -Requires the use of many methods to provide a continuous stream of accurate evidence of students’ mastery of knowledge, reasoning, performance skills and product development. Learning Target – Method Match: Accuracy in formative classroom assessment requires matching the kinds of Learning Targets to the appropriate assessment method:-Selected Response-Constructed Response-Extended Written Response-Performance/Product (demonstrated and observed) -Personal Communication (finding out what students have learned through interacting with them) Assess when? Continuously

Assessment FOR Learning Assessment OF Learning
Assessment User Assessment FOR Learning Assessment OF Learning Student Am I improving? Where do I need help? How am I achieving in relation to my peers? Teacher What intervention does this student need? Is instruction paced at the correct rate? What are this student’s strengths? What grade has this student earned? Is this student achieving on grade level? Parents What can I do at home to support learning? Is my child learning new things? How does my child compare to others in the school/district/state? How does this school compare to others in the district/state? Notice from the prior chart that for teachers, students and parents, assessments OF learning are not enough. Assessments OF learning do not provide the day to day information needed in the classroom to impact instruction. However, assessment FOR learning has a broader meaning – it involves utilizing progress monitoring to provide descriptive rather than evaluative feedback to students and it used the results to plan instruction and interventions for specific students

Classroom Assessment FOR Learning
What is the difference between formative assessments and formative classroom assessments for learning? The only difference is the student involvement component. Formative classroom assessment FOR learning allows students to know what they are trying to achieve, where they are now and how to close the gap between the two.

Formative /Classroom Assessments For Learning
Occur during learning Encourage student motivation and learning These assessments: Are not high-stakes Are not used for accountability Are not used for report card grades “If everything is for a grade, there’s never time to practice – get better.” -Rick Stiggins

What is the Student Involvement Component?
Classroom Assessment For Learning Acknowledges the critical importance of students and teachers working as a team Ensures instructional decisions are made by students and teachers Provides continuous descriptive rather than evaluative feedback 1. Students collaborate with teachers in creating and using assessments like those they will be held accountable for later. 2. Assessments become far more than one-time events attached to the end of teaching. They become part of the learning process by keeping students posted on their progress and confident enough to continue to strive. Students collaborate with teachers in creating and using assessments like those they will be held accountable for later. 3. Provides continuous descriptive (rather than evaluative) feedback is provided strategically in amounts that students can address effectively, in amounts that do not overwhelm them. Feedback: Students need to know what they did well and how they can improve. Scores and grades are not descriptive. Students become consumers of assessment information, using evidence of their own progress to understand what comes next for them and to set goals. Students become partners in the accumulation of growth portfolios that reveal the changes in their own achievement as it is happening.

Feedback Research indicates feedback that focuses on leaning targets leads to greater academic gains than feedback that emphasizes self esteem.

Questions students should ask teachers
Learning Targets Questions students should ask teachers If I have not mastered an objective (summative/benchmark), how will I improve if I don’t know which specific learning targets are keeping me from mastery? What knowledge do I need to demonstrate the intended learning? What patterns of reasoning do I need to master? What skills are required, if any? What product development capabilities must I acquire? Summative and benchmark assessments do not provide sufficient detail to inform teachers on how to help individual students. Formative/Classroom Assessments provide evidence of student progress in mastering the foundations or components (learning targets) that underpin and lead up to the objectives. These learning targets are achieved by assisting students in unpacking the content standards and objectives.

Activity Descriptive or Evaluative Feedback?
Using the activity sheet on page 76 of assessment training materials, have participants determine if the example of feedback is descriptive or evaluative. Complete activity and discuss answers.

Descriptive VS Evaluative Feedback
Describes features of work or quality Relates to learning targets or standards of quality Identifies strengths Provides specific information on how to improve Evaluative Assigns a label to achievement Expresses a judgment Expresses disapproval Identifies weaknesses Assigned to all work, even if it is for practice See additional notes on page 77 Discuss with participants the 3 minute conference strategy on page 84 and the other 2 strategies on page 85. When providing feedback about what to do differently, teachers need to determine What is the key error? What is the probable cause for the error? How can I guide the student to avoid the error in the future?

When consistently carried out as a matter of routine within and across classrooms, evaluative feedback has been linked to profound gains in student achievement, especially for low achievers. Benjamin Bloom, "The Search for Methods of Group Instruction as Effective as One-on-One Tutoring," Educational Leadership, May 1984 Paul Black and Dylan Wiliam, "Inside the Black Box: Raising Standards Through Classroom Assessment," Phi Delta Kappan, October 1998 key words – consistently and pervasively

Teacher Responsibilities
Monitoring Student Progress

What is the expectation for a change in responsibilities for Title I and special education teachers?

Teacher Accountability
Improving Results for Students in High Need Populations A Strategic Plan Recommendation #2 Refer to booklet

Establish the Expectation
Recommendation #2 Establish a management system, within a tiered instruction and intervention model, that empowers special education and Title I teachers to assume leadership and responsibility in documenting progress and coordinating instructional interventions for individual identified students to ensure improved results for each student in reading and mathematics on an annual basis. Source – Page 5 of the Executive Summary of the Strategic Plan for Improving Results for Students in High Need Populations What is the expectation? Title I and special education provide millions of dollars of funding for districts and schools in WV. Yet, an achievement gap exists for students with disabilities and also students from poverty. Thus, the strategic plan developed by the High Needs Task Force identified the above as a priority recommendation of the plan.

Change in the Focus of Services
Special Education Teachers Accommodations and Modifications for Learning Intervention Strategies Title I Teachers Remediation of Skills Intervention Strategies Traditionally, special education teachers have recommended accommodations and/or modifications for students on their case load to general classroom teachers who had these students in class. Accommodation is the method of delivering instruction or assessment of the curriculum standards and objectives (CSOs); it does not involve changing the curriculum (CSOs). For example, many students that are identified as special education actually only have variations of difficulties in accessing the curriculum through print material. These students have the capacity to understand the CSOs through some other medium than print, and thus an accommodation was suggested. Modification is how we change the curriculum standards and objectives (CSOs) that are delivered. When appropriate, a small percentage (USDE says 2% or fewer) of students might need to have the curriculum standards and objectives (CSOs) modified in some way. Traditionally, Title I teachers provided remedial reading services generally through a “pull out” model. Remediation is the method of delivering instruction to help students overcome deficiencies. Many times this was delivered through materials that were several grade levels below the student’s grade placement and the instructional materials utilized had little or no connection to those being utilized in the classroom. Intervention is a method of providing intense, explicit instruction characterized by differentiation based on the results of progress monitoring. It is generally delivered through a tiered instructional approach that includes increasingly more intense levels of student support and increased instructional time. Successful implementation requires collaborative practice between general education, special education, Title I teachers and other professional staff.

Teacher Responsibilities for Student Accountability
Participate in completing a comprehensive analysis of assessment data Generate a list of students by grade level who are not achieving mastery Graph or chart longitudinal assessment data for “at risk students” Participate in instructional intervention teams and the development of student intervention plans Provide academic interventions and conduct progress monitoring As we review the teacher responsibilities for student accountability, please note that it is not the intend to have special education and Title I teachers assume responsibility for all students who are not achieving mastery. Rather these teachers are being encouraged to accept a leadership role within the instructional intervention team. All teachers in the school should be part of reviewing and analyzing assessment results. 2. Pre-K programs are required to complete an on line assessment – creativecurriculum.net Teachers enter information from progress checkpoints throughout the year The assessment also suggests developmentally appropriate activities based on the WV Pre-K curriculum The assessment also generates child profiles and class summaries Title I and special education teachers have received specialized training in both assessing student progress, diagnosing needs and designing and providing interventions. Provide Tier I instruction through an in class model Participate as a member of the instructional intervention team to identify appropriate interventions for students identified as achieving below mastery Provide Tier 2 and Tier 3 intervention through a “pull out” model or extended day program Review and document the results formative assessments utilized within the tiered instruction to ascertain student progress Communicate student progress to the general education teacher on a regular basis Reconvene an IEP team meeting if a student’s lack of progress indicates a change in service is needed

What are the teacher responsibilities for measuring student progress?

Assessment – Now What? Summative and benchmark assessment results have been reviewed and targeted (non proficient) students have been identified What now? From the middle of August until the end of September the teachers are reviewing data to determine which students are not meeting proficiency either with summative and/or benchmark assessment. Instructional Intervention Team

Instructional Intervention Team
What is the purpose of the team? Who are the members? What are the team responsibilities? Principal/designee identifies a small flexible instructional intervention team of members with knowledge of the student’s achievement. Who are the members: Team membership may include 2 or more of these suggested professionals. Principal/designee Title I teacher Special education teacher Technology Integration Specialist (TIS) Speech and language specialist General education teacher One or more of the following individuals dependent upon student needs – counselor, nurse, social worker, school psychologist Other Responsibilities of the team The intervention team identifies specific intervention strategies that address the following items: Description of specific instructional interventions based on results of diagnostic testing Duration of the intervention Schedule and setting for the intervention Person(s) responsible for delivery of the student intervention Measurable outcomes – goals and/or objectives Identify how instruction is differentiated Identify how technology is integrated Schedule of progress monitoring (minimum of every 2 weeks) Description of the measurement instrument and recording procedures Procedures for adjustments in interventions based on the results of the progress monitoring

Purpose of the Team The team is responsible for gathering student information concerning current performance, skill deficiencies, developing an intervention plan and using collected progress monitoring data to make adjustments to intervention plan. THIS IS NOT A STUDENT ASSISTANCE TEAM. It’s not a formal team that is identified in September and meets monthly but rather a team of individuals who work closely with the student. If you are in a RF or RTI school, you’re already doing this. WHO ARE THE TEAM MEMBERS? The group should remain small and flexible and fill a rapid responder function. Again, the members should be individuals who know the student and can monitor the progress and make instructional adjustments. Team membership may include 2 or more of these suggested professionals. Principal/designee Title I teacher Special education teacher Technology Integration Specialist (TIS) Speech and language specialist General education teacher One or more of the following individuals dependent upon student needs – counselor, nurse, social worker, school psychologist Other

Intervention Team Membership
Team membership may include 2 or more of these suggested professionals: Principal/designee Title I teacher Special education teacher Technology Integration Specialist (TIS) Speech and language specialist General education teacher One or more of the following individuals dependent upon student needs – counselor, nurse, social worker, school psychologist Other as determined by district and/or school administrators WHO ARE THE TEAM MEMBERS? The group should remain small and flexible and fill a rapid responder function. Again, the members should be individuals who know the student and can monitor the progress and make instructional adjustments.

Team Member Responsibilities
Define the deficiency using baseline data Develop an individual instructional intervention plan of action Implement the intervention plan Evaluate plotted data to adjust interventions There are 4 basic responsibilities Define deficiencies – compare the deficiencies to IEP goals Develop a plan – this plan may involve the reassignment of Title I and special education staff based on identified student needs. Adjust IEPs for students with disabilities if needed. Implement the plan and Evaluate and track progress data and adjust interventions There should be an expectation that data should be tracked to view the longitudinal progress.

Baseline Data Data Sources Summative Individual Right Response Record
Benchmark tests Formative assessments Identification of specific student academic weakness The first responsibility is analyzing the data and identifying academic weaknesses. The data you might be viewing: Summative Individual Right Response Record Benchmark results Formative assessments given within the classroom WHAT EVER DATA YOU CAN USE TO IDENTIFY THE ACADEMIC WEAKNESSES

Develop an Intervention Plan
Deficient Skills Have Been Identified Develop an Intervention Plan Implement Plan Interventions Evaluate and Adjust This slide will help you to visualize where we are going with this process This is the cycle utilized for progress monitoring: Identify the deficiencies Develop the plan Evaluate and adjust the interventions.

The Intervention Plan should include the following information:
Description of specific intervention Duration of the intervention Schedule and setting of the intervention Persons responsible for implementing the intervention Identify measurable outcomes–goals/objectives Identification of measurement instrument and documenting techniques Progress monitoring schedule This slide describes what should be included in the plan. Again, if you are in a RF or RTI school you are already using intervention plans and this may be the plan you want to modify and continue using for the additional grades within your school. Your system or school has the flexibility to design the intervention plan to meets your specific needs.

Plan has been Developed
Develop an Intervention Plan Implement Plan Interventions Evaluate and Adjust Once the plan has been developed, it is now time to implement the plan. (NEXT SLIDE)

Implement the Intervention Plan
Intervention strategies are delivered through Tier 2 or Tier 3 instruction. MONITOR PROGRESS The implementation of the intervention strategies are delivered through tier two or tier three instruction. The teacher or teachers with responsibility should maintain records of each completed session. Teachers should monitor the progress of the student’s response to the interventions.

Progress Monitoring What is it? Why do we do it? What is the purpose?
Why do it? What is the purpose?

What is Progress Monitoring?
Progress monitoring involves continuous data collection on skills that are important for the student’s success. What is it? Continuous data collection on the skills that were identified as weaknesses during the analysis.

Why Use Progress Monitoring?
Why do it? To collect frequent measures of the progress of the student To establish goals To make instructional changes

Student Success ! What is the Purpose?
The purpose for progress monitoring Bottom Line: To ensure the students are acquiring the skills necessary for academic success.

Plan has been Implemented
Develop an Intervention Plan Implement Plan Evaluate and Adjust Interventions It’s time to evaluate the collected data to evaluate and adjust interventions.

Evaluate and Adjust Interventions
The team reconvenes to assess student progress and make adjustments to the instructional intervention plan. DATA COLLECTED It’s at this time the team reconvenes to review the progress monitoring data and make necessary adjustments to the original plan. The team should answer the questions: Based to the collected data: Is what we are doing making a difference? Should we continue with what we are doing? OR What changes do we need to make to the intervention strategies?

Instructional Intervention Plan
has been Adjusted Once again, we begin the cycle of: Adjusting the intervention plan Implementing the plan Monitoring the progress Evaluating and adjusting instruction

Concluding Thoughts Research has shown that consistently applying principles of assessment FOR learning has yielded unprecedented gains in student achievement.

Concluding Thoughts Students must be taught the skills they need to be in control of their own academic success: self assessment; goal setting; reflection on personal work; recording the results of progress; and understanding and sharing the results of their progress.

Suggested Resources Publisher: Educational Testing Service - 2006
Assessment FOR Learning – An Action Guide for School Leaders S. Chappuis, R. Stiggins, J. Arter, and J. Chappuis Classroom Assessment for Student Learning –Doing It Right-Using It Well R. Stiggins, J. Arter, J. Chappuis, and S. Chappuis Publisher: Educational Testing Service

Assessing Students in the 21st Century

Similar presentations

Presentation on theme: "Assessing Students in the 21st Century"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

Assessing Students in the 21st Century

Similar presentations

Presentation on theme: "Assessing Students in the 21st Century"— Presentation transcript:

Similar presentations

About project

Feedback