Assessment Literacy Series

Slides:



Advertisements
Similar presentations
ALS Design, Build, Review: Using PDE’s Online Tools to Implement the SLO Process SAS Portal:
Advertisements

The Network of Dynamic Learning Communities C 107 F N Increasing Rigor February 5, 2011.
ALS Design, Build, Review: Using PDE’s Online Tools to Implement the SLO Process SAS Portal:
Training Module for Cooperating Teachers and Supervising Faculty
Assessment Literacy Series
STUDENT LEARNING OBJECTIVES (SLOs) “Designing” © Pennsylvania Department of Education.
Benchmark Assessment Item Bank Test Chairpersons Orientation Meeting October 8, 2007 Miami-Dade County Public Schools Best Practices When Constructing.
SLO Review Principal Meeting CLIU October Student Learning Objective REVIEW -Quality Assurance-
STUDENT LEARNING OBJECTIVES (SLOs) 1 Orientation Module.
Assessment Literacy Series 1 -Module 4- Scoring Keys and Rubrics.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Alternative Assessments FOUN 3100 Fall 2003 Sondra M. Parmer.
School Name Here 2010 NECAP Science Test Administrator Workshop.
Some Practical Steps to Test Construction
ACCOMMODATIONS MANUAL How to Select, Administer, and Evaluate Use of Accommodations for Instruction and Assessment of Students with Disabilities.
Creating a Poster from a PowerPoint Presentation Margy Ingram Learning Technology Services University of Wisconsin-Stout Margy Ingram Learning Technology.
Aligning Assessments to Ohio Social Studies Standards Teaching American History Grant Presentation.
BADGER 3-8 EXAM : Wisconsin Smarter Assessment Updates & Resources 02/20/2015.
Spring 2015 Florida Alternate Assessment Spring 2015 Florida Alternate Assessment Test Coordinator Responsibilities Lake County Schools 1.
M-STEP 2015 Principal’s & PD Facilitator’s Meeting January 8 & 13, 2015.
Assessment Literacy Series
PhD Research Seminar Series: Writing the Method Section Dr. K. A. Korb University of Jos.
STUDENT LEARNING OBJECTIVES (SLOs) 1 Heather Brown Denise Kaminski.
NCSC Testing is Underway Reminders Guidance Test Window Test Security Administration Closing Test Capturing Evidence for CR in Writing.
Information on New Regents Examinations for SCDN Presentation September 19, 2007 Steven Katz, Director Candace Shyer, Bureau Chief Office of Standards,
STUDENT LEARNING OBJECTIVES (SLOs) Orientation Module © Pennsylvania Department of Education.
NEXT GENERATION BALANCED ASSESSMENT SYSTEMS ALIGNED TO THE CCSS Stanley Rabinowitz, Ph.D. WestEd CORE Summer Design Institute June 19,
Building Effective Assessments. Agenda  Brief overview of Assess2Know content development  Assessment building pre-planning  Cognitive factors  Building.
Advances in the PARCC Mathematics Assessment August
Lecture 8A Designing and Conducting Formative Evaluations English Study Program FKIP _ UNSRI
Assessment Literacy Series 1 -Module 6- Quality Assurance & Form Reviews.
EDU 385 EDUCATION ASSESSMENT IN THE CLASSROOM
Ways for Improvement of Validity of Qualifications PHARE TVET RO2006/ Training and Advice for Further Development of the TVET.
RESEARCH METHODOLOGY. WHAT IS RESEARCH METHODOLOGY?  In this section, the researcher must state the type of research, its meaning, and how it is applicable.
Regional Interim Assessment Project (DCA) Session #1 TRICIA PROFIC, ANDREA TAMARAZIO, KIM LOUTTIT & STEVE GRASER.
Module 3: Unit 1, Session 3 MODULE 3: ASSESSMENT Adolescent Literacy – Professional Development Unit 1, Session 3.
Assessment Literacy Series 1 -Module 3- Item Specifications.
 Updates  Before the test › Training › Oaths › Test Schedule  Conducting the test › Directions › Errors  After the test › Closing out the test › ARD.
Assessment Literacy Series 1 -Module 1- Design & Purpose Statement.
Assessing The Next Generation Science Standards on Multiple Scales Dr. Christyan Mitchell 2011 Council of State Science Supervisors (CSSS) Annual Conference.
Alternate Assessment Attainment Task Overview Part 2.3 Click here to download the Administration Guide Required for completion of this training 1Overview/Attainment.
LANSING, MI APRIL 11, 2011 Title IIA(3) Technical Assistance #2.
Lecture by: Chris Ross Chapter 7: Teacher-Designed Strategies.
Assessment and Testing
The School Improvement Process LaSalle County ROE #35
2014 CRCT Proctor In-Service Mt. Zion Elementary.
Alternate Assessment Attainment Task Overview Part 2.3 Click here to download the Administration Guide (Required for completion of this training)
PLAN 8: Methods for Introducing New Material Ready, Set… Handouts from the Pick-Up table.
Performance Task Overview Introduction This training module answers the following questions: –What is a performance task? –What is a Classroom Activity?
2016 PAWS Test Administrator Training
Appropriate Testing Administration
22C:082:001 Human-Computer Interaction. Fall Copyright © 2013 Juan Pablo Hourcade. 1 Group Project Phase Four.
Activity 1 Systems of Professional Learning Module 5 Grades K–5: Focus on Deepening Implementation.
SAT ® School Day Implementation Overview November 21, 2013 Nancy Potter SAT School Day Program.
The Constructed Response Assessment The Journey Continues.
Laboratory Exercise # 10 – Microsoft Word Additional Topics Office Productivity Tools 1 Laboratory Exercise # 10 Microsoft Word Additional Topics Objectives:
Test Administrator Training Spring 2016 Online Tests February 2016.
Program Design Chapter 5 6 th Edition Raymond A. Noe Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Copyright © Springer Publishing Company, LLC. All Rights Reserved. DEVELOPING AND USING TESTS – Chapter 11 –
Review of Assessment Toolkit
Student Learning Objectives (SLOs)
Assessment Literacy Series
PSSA Parent University
Lesson Planning Sequence
Assessment Literacy Series
Overview of the Teacher Work Sample (TWS)
Smarter Balanced Assessments
Accommodations Required Content for STC and TA Training
Presentation transcript:

Assessment Literacy Series -Module 5- Operational Forms and Guides IMT Orientation Draft 02Sept11-CS

Objectives Participants will: Construct operational forms (performance measures) from developed items by: Organizing and sequencing items/tasks Constructing form Assigning item tags Aligning to the Test Specifications & Blueprint Develop teacher guidelines to administer the performance measure.

Helpful Tools Participants may wish to reference the following: Guides Handout #8 – Operational Form Example Handout #9 – Administrative Guidelines Example Templates Template #5 – Operational Form Template #6 – Administrative Guidelines Other “Stuff” Performance Task Framework-Full

Outline of Module 5 Module 5: Operational Forms & Administrative Guidelines Operational Forms Process Steps Administrative Guidelines

Operational Forms [Handout #8]

Operational Forms All developed items will now be inserted into the proper format: the Operational Form. Operational Forms contain the following components: Cover page Student information section Test-taker instructions Item directions Items/Tasks Answer options/response area Item tags

Operational Forms (cont.) An operational form is the actual performance measure that will be given to the student. The “forms” displays the sequence of items/passages/prompts the test-taker is to engage and respond to during the testing period.

Operational Forms (cont.) Test Specifications & Blueprint should be the same for the pre-test and the post-test. Some complex measures, the “operational form”, may be a single prompt or task. All items must have an item tag. Consider the necessity for charts, graphs, images, figures, etc. Avoid creating a “queuing” or sequence bias among items/tasks.

Process Steps [Template #5] Complete the cover design and demographic information necessary to reflect the performance measure developed and the context by which it will be used. Organize the items/tasks in a sequence that will maximize student engagement. Add directions to the test-taker instructions detailing the requirements for different types of items/tasks, especially for CR items/tasks. Add item tags. Screen and refine draft form to minimize “blank space”, verify picture, graph, table, and figure placement in relationship to the item/task, and ensure MC answer options do not drift from one page to the next.

QA Checklist Directions state what to do, where and how to respond, and the point value for items/tasks. Items/tasks on the operational form reflect the blueprint. Form layout minimizes “white space”, “crowding of items”, and distance from stem to response options/placement. Forms are free from unclear, small, or unnecessary images, figures, charts, or graphs.

Administrative Guidelines [Handout #9]

Administrative Guidelines Administrative Guidelines are composed of three phases: Preparing for Test Administration Conducting Test Administration Post Administration

Administrative Guidelines (cont.) Preparing for Test Administration Establish the testing window. Specify what forms are needed. Review administration steps and student directions. Review the performance measures before administration. Establish a secure testing environment. Determine the process for make-up tests.

Administrative Guidelines (cont.) Conducting Test Administration Give directions for how to distribute forms. If possible, provide a script for the test administrator to use during administration. Provide directions for start/stop times, completing student information, and beginning and ending the testing session.

Administrative Guidelines (cont.) Post Administration Provide instructions for collecting and securing forms. Provide scoring instructions. Include how results are reported. Determine overall score and/or performance status (e.g., met minimum status).

Administrative Guidelines (cont.) Administrative guidelines must provide sufficient detail so that testing conditions are comparable between classrooms and across different schools. Activities within the testing environment (before, during, and after) must be articulated in a logical sequence. Test security and handling of scored materials must be outlined.

Process Steps Use the Administrative Guidelines Template to create administrative steps for before, during, and after the test. Explain any requirements or equipment necessary, including accommodations. State any ancillary materials (e.g., calculators) needed/allowed by the test-taker. Identify the approximate time needed to take the test. Include detailed “scripts” articulating exactly what is to be communicated to the test-takers, with particular emphasis on performance tasks. Include procedures for scoring, make-up tests, and handling completed tests.

QA Checklist Guidelines explain administrative steps before, during, and after testing. Requirements for completing the performance measure items/tasks, including conditions, equipment, and material, are included. Approximate time needed to complete the overall performance measure is provided. Detailed “scripts” articulate the information to be communicated in a standardized manner.

Summary Module 5: Operational Forms & Administrative Guidelines Created operational forms (which reflected the developed blueprint) in conjunction with test administration guidelines. Next Steps Module 6: Form Reviews Given the operational form, scoring key, and administrative guidelines, evaluate the quality of the materials, with particular emphasis on items/tasks within the performance measure.