Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.

Slides:



Advertisements
Similar presentations
Formative assessment is one of the elements of an ECE assessment system that should be aligned with appropriate curriculum and instructional goals/practices.
Advertisements

Assessing Academic Rigor to Ensure Grade-Level Proficiency September 29, 2009 Moderator: Diana Rogers, Regional Coordinator Presenter: Cindy Wheeler, HSTW/MMGW.
April 6, 2011 DRAFT Educator Evaluation Project. Teacher Education and Licensure DRAFT The ultimate goal of all educator evaluation should be… TO IMPROVE.
What is a Good Test Validity: Does test measure what it is supposed to measure? Reliability: Are the results consistent? Objectivity: Can two or more.
Assessment Policy Overview Dwayne Holford Coordinator, Academic Affairs.
Senate Bill 1720 Developmental Education Division of Florida Colleges May 2013.
Engaging Faculty in Using Data to Increase Student Success Dr. Karen Stout, President Leon Hill, Director of Institutional Research David Whalen, Instructor.
Susan Malone Mercer University.  “The unit has taken effective steps to eliminate bias in assessments and is working to establish the fairness, accuracy,
2010 OSEP Leadership Mega Conference Collaboration to Achieve Success from Cradle to Career College and Career Ready Standards Kentucky’s State of Affairs.
History Problem Opportunity Plan. History Started with State Academic Senate’s quest to increase English and math graduation competencies Academic Senate,
Context for El Paso’s K-16 Partnership K-12 Enrollment in twelve El Paso area school districts:167,269 Ethnic breakdown of student enrollment: Hispanic:88.1%
An Outcomes-based Assessment Model for General Education Amy Driscoll WASC EDUCATIONAL SEMINAR February 1, 2008.
Educational Outcomes: The Role of Competencies and The Importance of Assessment.
Update from the UNC General Education Council [presented to the UNC Board of Governors’ Educational Planning, Programs, and Policies Committee on February.
The High School – College Disconnect G. Donald Allen Department of Mathematics Texas A&M University presented to: The Coastal Bend Mathematics Collaborative,
The Academic Assessment Process
ASSESSMENT SYSTEMS FOR TSPC ACCREDITATION Assessment and Work Sample Conference January 13, 2012 Hilda Rosselli, Western Oregon University.
A Project Sponsored by the McCormick Foundation Lisa Hood, LINC Project Director Center for the Study of Education Policy Illinois State University Presentation.
Understanding Validity for Teachers
Module 1: PERA Illinois Administrative Code Part 50
1. What is it we want our students to learn?
Accountability Assessment Parents & Community Preparing College, Career, & Culturally Ready Graduates Standards Support 1.
March 2014 COMMUNITY COLLEGE RESEARCH CENTER Rethinking 12th Grade: Preparing All Students for College Before College Presentation to College Access Affinity.
Developmental Education: Job One October 21, :00 p.m. (CST)
 Description  The unit has a conceptual framework that defines how our programs prepare candidates to be well-rounded educators. Every course in the.
College-Ready Determination Policy and Performance Level Descriptors July
Student Learning targets
The Board of Governors Motion on Assessment: An Update Mark Wade Lieu Academic Senate for California Community Colleges.
Adolescent Literacy – Professional Development
Aligning the P-16 Curriculum to Improve Science Teacher Preparation Michael Odell, Ph.D. John Ophus, Ph.D. Teresa Kennedy, Ph.D. Jason Abbitt, Ph.D. Kristian.
Measuring Dispositions Dr. Sallie Averitt Miller, Associate Dean Office for Assessment and Accreditation Columbus State University GaPSC Regional Assessment.
Technology Standards in Teacher Education Proficiencies and Assessment Ellen Hoffman Eastern Michigan University MDE Workshop October 10, 2003.
Understanding the Role of Post-Secondary Coaches in High Schools Lynne Haeffele, Ph.D. Center for the Study of Education Policy Illinois State University.
School Counseling Program Freshman Focus Series: College Prep and Planning.
Minnesota’s School Readiness Study 1 Developmental Assessment at Kindergarten Entrance.
Early Assessment Program California State University Dr. Beverly Young, Assistant Vice Chancellor.
Comprehensive Educator Effectiveness: New Guidance and Models Presentation for the Virginia Association of School Superintendents Annual Conference Patty.
Council for Exceptional Children/Division of Early Childhood Conference October 2010 Kim Carlson, Asst. Director/619 Coordinator Ohio Department of Education.
1 BASIC SKILLS INITIATIVE A statewide effort to bring focus and funding to foster student success in a student’s path from developmental education to college-level.
Community College Survey of Student Engagement (CCSSE) Benchmarks of Effective Educational Practice Summary Report Background: The Community College Survey.
 Penn College evaluates students' skills to ensure that they have the entry-level skills necessary for their majors and college-level coursework.  The.
Standard Two: Understanding the Assessment System and its Relationship to the Conceptual Framework and the Other Standards Robert Lawrence, Ph.D., Director.
Implementing an Ability Based Education System Colleen Keyes Dean of Academic Affairs Dr. David England Director of Institutional Effectiveness.
Oregon State University, 1 11/25/2015 Details and implications for Oregon State University.
Quality Jeanne M. Burns, Ph.D. Louisiana Board of Regents Qualitative State Research Team Kristin Gansle Louisiana State University and A&M College Value-Added.
Assessing Teacher Effectiveness Charlotte Danielson
Continuous Improvement. Focus of the Review: Continuous Improvement The unit will engage in continuous improvement between on-site visits. Submit annual.
Learning Goals at St. John Fisher College Peter J. Gray, Ph.D. Director of Academic Assessment United States Naval Academy May 2004.
Columbus State University C ollege of Education and Health Professions PSC Program Review February 14-17, 2010.
What Your Program Needs to Know about Learning Outcomes Assessment at UGA.
Policy Definitions, Achievement Level Descriptors, and Math Achievement Standards.
Placement Work Group Meeting FRIDAY, OCTOBER 23, :00AM – 3:00PM 1.
SLOAC The Skyline Way1 Presented by: Skyline College SLOAC Committee.
Working together to strengthen student learning: faculty inquiry in action California Statewide Academic Senate April 18, 2008.
Career Counseling: A Holistic Approach
Smarter Balanced & Higher Education Cheryl Blanco Smarter Balanced Colorado Remedial Education Policy Review Task Force August 24, 2012.
HIGHER EDUCATION IN THE USA. Three categories of institutions.
QCC General Education Assessment Task Force March 21 and 22, 2016 Faculty Forum on General Education Outcomes.
Required Skills for Assessment Balance and Quality: 10 Competencies for Educational Leaders Assessment for Learning: An Action Guide for School Leaders.
COMMON CORE STATE STANDARDS INITIATIVE BASIC CONCEPTS Martha Delapava Havens, Associate Director - Elementary Pacific Union Conference, Westlake Village,
Overview of Types of Measures Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness.
Operation Inform Tests and Testing The State University of New York
Christopher Jacobson Frederick Community College Cindy Nicodemus Howard Community College.
State Testing for SPED Students: (Georgia Alternative Assessment vs. Regular State Testing with Accommodations)
Outcomes By the end of our sessions, participants will have…  an understanding of how VAL-ED is used as a data point in developing professional development.
Phyllis Lynch, PhD Director, Instruction, Assessment and Curriculum
Assessment of Student Course Competency Readiness: Ensuring proper placement of students Andrew LaManque, Associate Vice President of Instruction, Foothill.
2015 PARCC Results for R.I: Work to do, focus on teaching and learning
kctcs action plan.
Presented by: Skyline College SLOAC Committee Fall 2007
Presentation transcript:

Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College

Dr. Edward A. Morante EdD – 1974 Counseling Psychology, Teachers College, Columbia University Master’s Thesis: Multivariate analysis of the success of a placement process at a school for disabled students Research Assistant for Dr. Robert Thorndike, noted professor of testing and measurement 35 years in higher education 13 years Director of Counseling at the university level 8 years as Director of the Basic Skills Assessment Program, New Jersey Department of Higher Education, which developed the first state wide placement test in the US, the first state wide assessment of Developmental Education programs in that state, assessing learning outcomes at two and four-year colleges including the first state wide assessment of sophomore learning outcomes 14 years in a Southern California community college as a counselor, Dean of Educational Research, Resources and Technology; Dean of Student Services and Resources; and Academic Senate President

Dr. Edward A. Morante Distinguished Faculty – National Center for Developmental Education’s Kellogg Institute for 23 years, presenting on placement and assessment Member of the Assessment Council of Western Governors University for 10 years where he helped develop an elaborate system of student assessment needed for degree attainment National TRIO trainer for 10 years on assessment, placement, and evaluation Achieving the Dream data coach from the beginning Consultant, presenter, grant writer, program evaluator for 25 years, including head of the team that evaluated Florida’s statewide placement test (CLAST) and member of the team that evaluated the Texas statewide placement test

Today’s Agenda Definition & Purpose Important factors Placement tests vs. SAT & ACT Best practices Predictive validity of placement tests Evaluating placement instruments and policies

Definition A placement test is a basic skills achievement test that measures skills proficiency (e.g., in reading, writing and/or mathematics).

Purpose To assist entering college students in the selection of beginning courses

Important Factors Reliability: Essential for score consistency; Calculated reliability coefficients should approach or exceed.90

Important Factors Reliability Validity: Essential for measuring what the test is supposed to measure; content / skills / behaviors … college entrance = reading writing math

Important Factors Reliability Validity Criterion-referenced, with standards & proficiencies developed by faculty

Important Factors Reliability Validity Criterion-referenced Power test, where students demonstrate skills within a reasonable time. “Speededness” should be avoided.

Important Factors Reliability Validity Criterion-referenced Power test Decreased opportunity to guess

Important Factors Reliability Validity Criterion-referenced Power test Decreased opportunity to guess Alternate form for contingencies

Important Factors Reliability Validity Criterion-referenced Power test Decreased opportunity to guess Alternate form for contingencies Cost

Important Factors Reliability Validity Criterion-referenced Power test Decreased opportunity to guess Alternate form for contingencies Cost No bias

SAT / ACT vs. placement tests SAT / ACT Select most likely to succeed Predict success Higher order skills No developmental level questions Placement Instruments Assess basic skills Ready to enter college classes? Assess developmental levels

SAT/ ACT uses for placement Multiple variables High scores Academic achievement Should not override placement test results

Best Practice - timing Administer after college admittance and before orientation and registration Preparation for placement testing?

Best Practice - Process Do not make a placement based upon the results of one score of one test (avoid error variance by using multiple variables)

Best Practice - Process Test all entering students Collect available background info Analyze these multiple data Integrate information using multiple variables Make decisions about placement for each student for each basic skills content area

Best - Multiple Variables Placement test and components SAT / ACT High School rank, GPA, course work Motivation Maturity Family & Work Support ….How can this be done quickly & efficiently?

Best - Multiple Variables ….How can this be done quickly & efficiently? Work with the metrics of the test - Gordon

Predictive validity Predictive validity is an inappropriate methodology for evaluating an achievement test such as a placement test. (recent CCRC report) Assess skills Assess proficiencies

Assessing A test should be evaluated in the context of both the test itself and how it is used. -Messick

Assessing Faculty examination of the content Sampling of skills Alignment w/ HS?

Assessing Placement Processes: Is the process followed? Who has override power? Rigid or flexible?

Assessing Placement Processes: How many changes are made by students after placement?

Assessing Are students placed appropriately? Ask the experts...

Assessing Are students placed appropriately? Ask the experts... Faculty!

Assessing Faculty Assessment of Student Placement Survey All faculty who teach all levels of developmental classes + All faculty who teach first level college ENGL & Math 4-6 Weeks – ask to individually rate the appropriateness of each student’s placement Entry proficiencies, not motivation, etc.

Assessing Faculty Assessment of Student Placement Survey Ratings system: Appropriately placed Should be placed in a lower level Should be placed in a higher level Results compiled with an expected outcome of 80%

Last thought Assessment and placement are only the beginning of the process. Student learning is the goal, and it is much more difficult to accomplish!

Questions?

Placement Testing with Dr. Edward A. Morante Faculty to Faculty Webinar Series