Evaluating Assessment for the NRS Evaluating Assessments for the NRS American Institutes for Research February 2005.

Slides:



Advertisements
Similar presentations
Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.
Advertisements

Support.ebsco.com Nursing Reference Center Tutorial.
Assessment types and activities
SCQF RPL Project Ruth Whittaker SCQF RPL Consultant Recognising Prior Informal Learning (RPL) within the Scottish Credit & Qualifications Framework (SCQF)
Our Journey Thus Far… June 1996 –Initial meetings began for the development of the Indiana Assessment System of Educational.
Medication Management
Protocol Development.
Assessment & Evaluation adapted from a presentation by Som Mony
ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D.
Wortham: Chapter 2 Assessing young children Why are infants and Preschoolers measured differently than older children and adults? How does the demand for.
POLK STATE COLLEGE PRIOR LEARNING ASSESSMENT PORTFOLIO DEVELOPMENT
WP4 – Task 4.4 LCA Activities
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Test of handwriting skills-revised
1 CASAS Overview Symposium on Issues and Challenges in Assessment and Accountability for Adult English Language Learners May 16, 2003 Washington DC Linda.
Local Assessment Validity Study Rayne A. Sperling Jonna M. Kulikowich Penn State Research Team.
South Carolina Adult Education ASSESSMENT POLICY UPDATE Directors’ Training – 08/22/13.
Assessment Policies 1 Implementation and Monitoring American Institutes for Research February 2005.
1 The New Adaptive Version of the Basic English Skills Test Oral Interview Dorry M. Kenyon Funded by OVAE Contract: ED-00-CO-0130 The BEST Plus.
New Hampshire Enhanced Assessment Initiative: Technical Documentation for Alternate Assessments Standard Setting Inclusive Assessment Seminar Marianne.
Lesson Thirteen Standardized Test. Yuan 2 Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized.
Achievement & Aptitude Tests Achievement tests measure “accomplishment”; learning that results from exposure to a relatively defined learning experience.
P.E.R.T. Postsecondary Education Readiness Test. TODAY’S PERT HANDOUT Evaluation Services copied only the pages that pertained to the actual administration.
1 Integrating Google Apps for Education to Business English Student Trainees’ On-the-Job Training English Reports Asst.Prof. Phunsuk Kannarik.
Technical College System of Georgia Office of Adult Education As required by the National Reporting System for Adult Education.
BY Karen Liu, Ph. D. Indiana State University August 18,
1 Interagency Committee on Government Information (ICGI) and the Web Content Standards Working Group Sheila Campbell, GSA / FirstGov Records Administration.
Accommodations in Oregon Oregon Department of Education Fall Conference 2009 Staff and Panel Presentation Dianna Carrizales ODE Mike Boyles Pam Prosise.
EDU 385 Education Assessment in the Classroom
A Brief History of the NRS American Institutes for Research February 2005.
Framework for High- Quality English Language Proficiency Standards and Assessments P r e pa r e d b y t h e Assessment and Accountability Comprehensive.
The European Credit system The European Credit system for Vocational Education and Training (ECVET)
CCSSO Criteria for High-Quality Assessments Technical Issues and Practical Application of Assessment Quality Criteria.
The NRS Project NRS Activities Enhancing Performance Through Accountability American Institutes for Research February 2005.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 7 Selecting, Administering,
Technical Assistance Paper Program Year Miami-Dade County Public Schools Adult ESOL Program presents: ADULT ESOL Technical Assistance Paper
The Value of Data The Vital Importance of Accountability American Institutes for Research February 2005.
Michigan Educational Assessment Program MEAP. Fall Purpose The Michigan Educational Assessment Program (MEAP) is Michigan’s general assessment.
Workshops to support the implementation of the new languages syllabuses in Years 7-10.
CAROLE GALLAGHER, PHD. CCSSO NATIONAL CONFERENCE ON STUDENT ASSESSMENT JUNE 26, 2015 Reporting Assessment Results in Times of Change:
Dispelling DAPA Myths Brian M. Touchette November 15, 2007 Center for Disabilities Studies University of Delaware & Delaware Department.
1 Chapter 1 Introduction to Accounting Information Systems Chapter 17 System Selection and System Design.
NRS JEOPARDY! The Adult Education Community’s Favorite Quiz Show.
Selecting Evidence Based Practices Oregon’s initial attempts to derive a process Implementation Conversations 11/10.
Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.
Revised AQTF Standards for Registered Training Organisations Strengthening our commitment to quality - COAG February August 2006.
Distance Learning and Accreditation Heather G. Hartman, Ph.D. Brenau University Online Studies and SACS Liaison.
Adult Education Assessment Policy Effective July 1 st, 2011.
Measuring the Power of Learning.™ California Assessment of Student Performance and Progress (CAASPP) Accessibility and Accommodations December 16, 2015.
Appropriate Testing Administration
Colorado Accommodation Manual Part I Section I Guidance Section II Five-Step Process Welcome! Colorado Department of Education Exceptional Student Services.
Types of test Test Types Based on Its Purposes. Placement Test The purpose is this test to place a student according to his/her language ability within.
Ready, Set, Start! Using CASAS in Your Even Start Program Ready, Set, Start! Using CASAS in Your Even Start Program Presenter: Martha Gustafson Date: June.
Test evaluation (group of 4; oral presentation, mins) *Purpose: Apply the principles learned in your reading and class lectures to evaluate an existing.
Lesson Thirteen Standardized Test. Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized Test.
Group 1 Pages
2017 Grade 3 Reading Student Portfolio
Global Inventory of Statistical Standards
MUHC Innovation Model.
Assessment and Feedback – Module 1
Bishkek, March 10th, 2017 Ole Espen Rakkestad, NOKUT
Steps for development and evaluation of an instrument - Revision
Standard Setting for NGSS
Grade 3 Midyear Promotion (GTMYP)
Grade 3 Midyear Promotion (GTMYP)
Grade 3 Midyear Promotion (GTMYP)
Grade 3 Reading Student Portfolio
CLOSING As we have conducted focus groups, webinars, road shows, and even at our launch event in Austin we have heard from many educators across the state.
Technical Assistance Webinar
Presentation transcript:

Evaluating Assessment for the NRS Evaluating Assessments for the NRS American Institutes for Research February 2005

Evaluating Assessment for the NRS 2 Student Assessment Process Adapted from D.M. Kenyon and C. Van Duzer, Valid, Reliable, and Appropriate Assessments for Adult English Language Learners, November Administrator Underlying competencies Performance Student Task Task qualities and conditions Underlying K/S/A Scale/CriteriaRater Underlying competencies Scale/criteria [NRS levels] and scoring conditions Score/Measure

Evaluating Assessment for the NRS 3 Need for Standardized Assessment Review Process Promotes compatibility of assessment information across states Standard process and criteria for determining use to measure educational gain Without it, inconsistent approval of assessments across states

Evaluating Assessment for the NRS 4 Assessment Review Process Required review procedure for states and at federal level All assessments to be reviewed Plan to formally regulate requirements, to take effect in 2006 Guided by Higher Education Ability to Benefit approach To be published in new NRS Implementation Guidelines (draft in handouts)

Evaluating Assessment for the NRS 5 Assessment Review Process (2) Step 1: Application—State or test publisher requests review and submits: Source materials (e.g., manuals, report) Reports with psychometric evidence (e.g., validity, reliability) Step 2: Rating on Psychometric Criteria Using NRS criteria on test requirements

Evaluating Assessment for the NRS 6 Assessment Review Process (3) Step 3: Formal Review Panel of 2 or 3 experts independently reviews assessment and makes recommendation Step 4: Documentation Formal report and recommendation to OVAE

Evaluating Assessment for the NRS 7 Questions, Discussion Questions?

Evaluating Assessment for the NRS 8 NRS Assessment Database Access to an online assessment database through Database will contain assessments that are appropriate for use in adult education programs Assessments will be approved for inclusion in the database by ED Additional assessments may be added after review and approval by ED

Evaluating Assessment for the NRS 9 Content Database will include 4 main sections: List of tests included in the database List of features to be included Results pages (for search and comparison functions) Definitions of terms

Evaluating Assessment for the NRS 10 Assessments by Name/Title

Evaluating Assessment for the NRS 11 Features to Be Included Title of Test (Acronym) Narrative Summary—short statement Test Use and Purpose Intended Population Purpose (e.g., Placement, Diagnostic, Progress, Achievement/Proficiency)

Evaluating Assessment for the NRS 12 Features to Be Included (cont’d.) Test Specifications and Features Test Content (skills measured) Range of Skill Levels Items and Subtests Alternate Test Forms Required/Recommended Training for Test Administrators Test Administration Procedures Scoring and Reporting Time Needed for Assessment

Evaluating Assessment for the NRS 13 Features to Be Included (cont’d.) Ordering Information/Availability Publisher/Company/Source for Obtaining the Test Versions, Publication Date(s) Product Web Site Additional Evaluator Comments

Evaluating Assessment for the NRS 14 Functions Two search methods: Search for an assessment by name Search for an assessment according to specific features

Evaluating Assessment for the NRS 15 Search Results by Test Name/Title

Evaluating Assessment for the NRS 16 Comparison Function Compare up to three different assessments across features in a side-by-side table format

Evaluating Assessment for the NRS 17 Comparison Chart of Two Tests

Evaluating Assessment for the NRS 18 NRS Assessment Database Questions? Comments/Feedback