The REEP Pre and Post Writing Assessment (RWA)

Slides:



Advertisements
Similar presentations
Using the TESOL Program Standards for Program Review Developed by the Center for Adult English Language Acquisition - CAELA Presenter: Phil Anderson
Advertisements

ABE Policy, Accountability & the NRS Summer Institute 2011.
1 Strengthening Teaching and Learning: Educational Leadership and Professional Standards SABES Directors’ Institute July 2011.
$200 $300 $400 Final Jeopardy $100 $200 $300 $400 $500 $100 $200 $300 $400 $500 $100 $200 $300 $400 $500 $100 Truth or LiesMixed Bag The Big ThreeNRS.
Community Literacy Summit March 19, 2007 Daphne Greenberg, PhD Georgia State University Palomar Hotel, Washington, DC.
A Training Case Study Community Literacy Summit Washington, D.C. March 19, 2007 Douglas Marriott, Outreach Director “Challenges in Measuring.
Action Research Opportunity Or Research Based Action.
1 CASAS Overview Symposium on Issues and Challenges in Assessment and Accountability for Adult English Language Learners May 16, 2003 Washington DC Linda.
South Carolina Adult Education ASSESSMENT POLICY UPDATE Directors’ Training – 08/22/13.
Assessment Policies 1 Implementation and Monitoring American Institutes for Research February 2005.
1 The New Adaptive Version of the Basic English Skills Test Oral Interview Dorry M. Kenyon Funded by OVAE Contract: ED-00-CO-0130 The BEST Plus.
 I would like to thank my dear teachers who have taken all the trouble to come to this remote place in upper Egypt.
Pollard Memorial Library Adult Literacy Program. The Program  The Pollard Memorial Library’s Adult Literacy Program began in  It is affiliated.
Using statistics in small-scale language education research Jean Turner © Taylor & Francis 2014.
STANDARDIZATION It’s Not a Bad Word!. Before Standardization Between 4 Adult Schools, CBET Classes and Offsite Classes, ALL ESL classes had different.
January  Our original research question(s) began as: ◦ For students meeting the criteria for NRS inclusion who were pre and post-tested, what appears,
PROGRAMMATIC MONITORING Adult Education & Literacy.
EL Civics – Citizenship Preparation Overview Louann Gigante, CASAS Program Specialist
FY11 Professional Development Expenditures And Learner Pre-post Test Score Gains Kathy Ira Director of the Maryland Literacy Resource Center and Professional.
BEST Plus and BEST Literacy Directors’ Training Feb. 14, 2013Columbia, SC.
Assessment Policy. Reporting Student Data in AERIS All student data must be entered into AERIS by the 15 th and approved by the 22 nd of each month for.
The National Reporting System: Foundations Technical College System of Georgia Office of Adult Education.
WORD ~ ESL 2023 E. Fulton St. Grand Rapids, MI (616) 454 – 4874
Family, School, and Community Partnerships: A Model for Pre-service Teacher Education Presentation at Center for Research, Evaluation & Advancement of.
Collecting Quantitative Data Creswell Chapter 6. Who Will You Study? Identify unit of analysis Specify population Describe sampling approach  Class =
Technical College System of Georgia Office of Adult Education As required by the National Reporting System for Adult Education.
EL-Civics Application Remember! If in a consortium: –Must complete Budget Detail page for each consortium member EL-Civics Application.
McLendon and Polis1 An Administrator’s Guide to Assessment: A Menu of Assessment Options for MAERS and Instructional Guidance.
LITERACY COACHES IN STATE OPERATED PROGRAMS MERILEE FOX DIRECTOR OF STATE OPERATED PROGRAMS VIRGINIA DEPARTMENT OF EDUCATION.
Teaching With Technology Enjoy the tune It will be over soon To continue to view A mouse click will do.
Understanding the NRS Rosemary Matt NYS Director of Accountability.
DATA RETREAT PRINCIPAL’S MID-YEAR REPORT Vandercook Lake Middle School Principal: Renee Rudloff Subject Area: Reading & Writing.
Enhancing Education Through Technology (Ed Tech) Title IID Competitive Grants Michigan Department of Education Information Briefing July 17 and.
1 An Introduction to the SIOP Model Sheltered Instruction Observation Protocol.
A PACKAGE FOR LEARNING NEGATIONS IN TAMIL Dr. G. Singaravelu Reader, UGC-Academic Staff College & B.Ed Co-ordinator Bharathiar University, Coimbatore,
Technical Assistance Paper Program Year Miami-Dade County Public Schools Adult ESOL Program presents: ADULT ESOL Technical Assistance Paper
Changes for PY 2006 and Beyond Changes to NRS Reporting PY 2006 and Beyond American Institutes for Research February 2005.
Student Growth within the Teacher Professional Growth and Effectiveness System (TPGES) Overview 1.
Evaluating Assessment for the NRS Evaluating Assessments for the NRS American Institutes for Research February 2005.
NRS JEOPARDY! The Adult Education Community’s Favorite Quiz Show.
Using Data Effectively ABE Directors’ Meeting October 9th and 10th, 2002.
Evaluating Impacts of MSP Grants Ellen Bobronnikov January 6, 2009 Common Issues and Potential Solutions.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.
Adult Education Assessment Policy Effective July 1 st, 2011.
Let’s Play Jeopardy! AET/535 WIA TITLE II ACCOUNTABILITY With your hosts: Jennifer Vaughn and Mark Reha.
Presentations of Action Research Planning for written summaries and sharing for Jan 2004.
Performance Standards for Community Adult Learning Centers Donna Cornellier, MASSACHUSETTS DEPARTMENT OF EDUCATION.
UPDATE ON EDUCATOR EVALUATIONS IN MICHIGAN Directors and Representatives of Teacher Education Programs April 22, 2016.
Purpose of Teacher Evaluation and Observation Minnesota Teacher Evaluation Requirements Develop, improve and support qualified teachers and effective.
Understanding the NRS Rosemary Matt NYS Director of Accountability.
1 CASAS Assessment Valid and Reliable Measures for ABE, ASE and ESL Programs to Meet Students' Needs and Federal Reporting Requirements East Coast Summit.
Assessing Workforce Essential Skills: Preparing Learners for Success in the Workplace CASAS National Summer Institute 2005 June 16, 2005 Diane K. Whitley,
Writing Assessment for the Classroom Overview Presented at the 2004 CASAS National Summer Institute.
Understanding the National Reporting System Rosemary Matt NYS Director of Accountability NRS.
ADULT EDUCATION AND FAMILY LITERACY ACT (AEFL) 2014 Workforce Innovation and Opportunity Act (WIOA) – Title II 1.
Ready, Set, Start! Using CASAS in Your Even Start Program Ready, Set, Start! Using CASAS in Your Even Start Program Presenter: Martha Gustafson Date: June.
CaMSP Science Assessment Webinar Public Works, Inc. Sharing Lessons Learned in the Development and Use of Science Assessments for CaMSP Teachers and Students.
TOPSpro Special Topics V: Meeting Federal Accountability Requirements.
CASAS Assessment Update February 2004
ABE Policy & Accountability
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
“Listening and Speaking with the CCRS”
Adult Education and Literacy in Texas
Interview Responses: Job Satisfaction
“Listening and Speaking with the CCRS”
Priority Data Strategies for FY2015 Finger Lakes RAEN
Partnering for Success: Using Research to Improve the Lowest Performing Schools June 26, 2018 Massachusetts Department of Elementary and Secondary Education.
The first test of validity
Natsuki Aka Okinawa International University Japan
Qualities of a good data gathering procedures
Presentation transcript:

The REEP Pre and Post Writing Assessment (RWA) Suzanne Grant Director Arlington Education and Employment Program (REEP) Arlington Public Schools, Arlington, Virginia

REEP PRE AND POST WRITING ASSESSMENT Performance-based writing test Measure writing gains for adult ESOL learners (SPL 2+/NRS Beginning ESL+) Consists of: REEP Writing Rubric (6 levels of performance measured against 5 dimensions: Content & Vocabulary, Development & Organization, Structure, Mechanics, Voice) Performance Tasks/Prompts, including warm-up activities. Scored using the Rubric. Two forms of the test.

REEP Arlington Education and Employment Program Adult ESOL Program Target population: adult immigrants and refugees who live and work in Arlington Nine levels of instruction Provide 9,000 class slots per year in: Intensive ESOL Non-intensive ESOL Family English Workplace Literacy

The Journey 1995: Virginia Alternative Assessment Grant: Need to improve placement of students into 9 levels Development of REEP Writing Rubric and placement test prompt 1997-2002: What Works Literacy Partnership Purpose: to determine the effectiveness of the REEP Writing Rubric to measure writing Research and Development of: timed pre and post-test prompts warm-up activities standardized test administration procedures and training standardized scoring procedures and training

Research Results A carefully designed and validated instrument with sufficiently high reliability. Gains can be effectively and reliably measured within a 12-week period of 100 hours. Scoring and training procedures lead to high interrater reliability. Forms A and B are equivalent.

Further studies 2002: CASAS Study: Comparing REEP Rubric with CASAS Writing Rubric Strong evidence for the validity of both instruments and that based on the observed correlations, the two assessments are interchangeable. 2002-present: Commonwealth of Massachusetts, Department of Education: Adoption of RWA for adult ESOL programs effectiveness of the instrument in a variety of program settings additional prompt development July 2003- Virginia adopts RWA for adult ESOL programs

Lessons Learned AND Home-grown performance-based assessment can: be an effective instrument for measuring learner gains AND lead to positive changes within a program Staff Development Program Improvement Students’ Attitude