Validity with the CAAP Assessment. Validity for what purpose? Placement/Progress Accountability/Accreditation.

Slides:

Advertisements

Similar presentations

Advertisements

USING THE CLA TO INFORM CAMPUS PLANNING Anne L. Hafner Campus WASC Faculty Coordinator Winter 2008.

Kin 304 Regression Linear Regression Least Sum of Squares

Bloomington Public Schools K-12 Pathways Based in part on NWEA (2012) study of RIT scales and ACT College Readiness Benchmarks, TIES equating with MCA.

CAAP Fall Report On Freshmen/Sophomores OIRA February 2007.

General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.

MEASURING COLLEGE VALUE-ADDED: A DELICATE INSTRUMENT Richard J. Shavelson SK Partners & Stanford University AERA Ben Domingue University of Colorado Boulder.

Upper Darby School District Growth Data

Item Analysis What makes a question good??? Answer options?

What’s in the works for General Education Assessment? Dan McCollum, Ph.D. Associate Director of Academic Assessment.

NCATE Institutional Orientation Session on PROGRAM REVIEW Moving Away from Input- based Programs Toward Performance-based Programs Emerson J. Elliott,

Parent, Student, and Teacher Perceptions of School Climate: Investigations Across Organizational Levels Christine DiStefano Diane M. Monrad R. John May.

Norms & Norming Raw score: straightforward, unmodified accounting of performance Norms: test performance data of a particular group of test takers that.

REGISTER FOR THE SAT & ACT JUNIOR REGISTRATION DRIVE.

Where You Go, What You Do, What You Know? Understanding the Influences of Campus Experiences on the Academic Achievement and Self-Concept of Black Undergraduates.

Course Assessment - Question Paper  The purpose of the Question Paper is to assess breadth and depth of knowledge and understanding from across the.

Propensity Score Matching

IMPACT OF NWP ON TEACHERS’ CLASSROOM PRACTICE: Results of a teacher survey Inverness Research Associates NWP annual meeting 2001.

Classroom Assessment and Grading

MULTIPLE MEASURES What are they… Why are they… What do we do… How will we know… Dr. Scott P. Myers KLFA Wednesday, August 28, 2013.

MPI Mission Perception Inventory Institutional Characteristics and Student Perception of Mission: What Makes a Difference? Ellen Boylan, Ph.D. ● Marywood.

Do Psychosocial and Study Skill Factors Predict College Outcomes? A Meta-Analysis Steven B. Robbins, Kristy Lauver, Huy Le and Daniel Davis, Ronelle Langley,

The Voluntary System of Accountability (VSA SM ).

Benchmarking with National and International Assessments Larry V. Hedges Northwestern University This paper is intended to promote the exchange of ideas.

Review and Validation of ISAT Performance Levels for 2006 and Beyond MetriTech, Inc. Champaign, IL MetriTech, Inc. Champaign, IL.

CCSSO Criteria for High-Quality Assessments Technical Issues and Practical Application of Assessment Quality Criteria.

Employing Empirical Data in Judgmental Processes Wayne J. Camara National Conference on Student Assessment, San Diego, CA June 23, 2015.

Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

1 Self-Regulation and Ability Predictors of Academic Success during College Anastasia Kitsantas, Faye Huie, and Adam Winsler George Mason University.

Formal Assessment Week 6 & 7. Formal Assessment Formal assessment is typical in the form of paper-pencil assessment or computer based. These tests are.

College Preparatory Course Certification Pilot May 5th,

Race to the Top Assessment Program General & Technical Discussion Lizanne DeStefano University of Illinois.

MEAP / MME New Cut Scores Gill Elementary February 2012.

Establishing educational standards and monitoring student performance Directions for methodological improvements in international assessments.

A Comparison of General v. Specific Measures of Achievement Goal Orientation Lisa Baranik, Kenneth Barron, Sara Finney, and Donna Sundre Motivation Research.

Deborah Fontaine Dr. Susan Lang ENGL5365 August 2, 2010.

The Self-Compassion Scale (SCS) is the primary measure of self- compassion in both social/personality psychology and clinical research (Neff, 2003). It.

Welcome to MMS MAP DATA INFO NIGHT 2015.

Chapter 10 Copyright © Allyn & Bacon 2008 This multimedia product and its contents are protected under copyright law. The following are prohibited by law:

FIFTH ANNUAL 50-STATE PROGRESS REPORT on the Alignment of High School Policies with the Demands of College and Careers 2010 Closing the Expectations Gap.

Pilot Study of the CAAP Critical Thinking Test April 27, 2005 Lanette Raymond Research Associate, Suffolk County Community College.

Louisiana State University at Alexandria. Background Students Introductory Biology for majors 2 laboratory sections of ~ 25 students combined into 1 lecture.

+ Marking New Learning Milestones within Henry County Schools Parent Presentation January 20 and 21, :00am and 7:00pm.

Part II – Chapters 6 and beyond…. Reliability, Validity, & Grading.

Standards-Based Tests A measure of student achievement in which a student’s score is compared to a standard of performance.

G RADUATION R EQUIREMENTS AND THE N EW G RADUATION T ESTS N OVEMBER 4, 2014 Freshmen Parent/Student Night.

Assessing Intelligence. Test Construction Standardization – defining the meaning of scores by comparing to a pretested “standard group”. Reliability –

Measuring College Value-Added: A Delicate Instrument

Participants & Procedure

Further Validation of the Personal Growth Initiative Scale – II: Gender Measurement Invariance Harmon, K. A., Shigemoto, Y., Borowa, D., Robitschek, C.,

Assessing Intelligence

ARDHIAN SUSENO CHOIRUL RISA PRADANA P.

Kin 304 Regression Linear Regression Least Sum of Squares

STAAR EOC Testing Lone oak high school.

BPK 304W Regression Linear Regression Least Sum of Squares

UPWARD BOUND 2015 Welcome Parents to Sr. SAT Math.

And How Does It Impact Me?

CAAP Fall Report On Freshmen/Sophomores

کارگاه حجم نمونه با نرم افزار G*Power

Assessing Standards at the Right Level of Difficulty

Exploring Assessment Options NC Teaching Standard 4

And How Does It Impact Me?

Understanding Statistical Inferences

Complex Correlational Relationships

Closing the Expectations Gap

Massachusetts Institute of Technology

Academic Excellence 2020 vision Continuing the Legacy!

Bell Ringer 10/21/2014 Yesterday we talked about formative (during instruction) and summative (after instruction) assessments. Name three examples of formative.

Bonus Slide!!! Things to “Carefully Consider”

First Hour - How can one measure intelligence?

Presentation transcript:

Validity with the CAAP Assessment

Validity for what purpose? Placement/Progress Accountability/Accreditation

Validity measures of what type? Absolute score based Normative

Possible validity models Correlations with accepted measures of skills Prediction of accepted measures of skills Change across time

Placement/Progress models Based on some measure of future success (e.g. graduation, upper level GPA) Regression model based

7 Achievement first two years Progress first two years Graduation in 6 years Achievement beyond 2 nd year Progress beyond 2 nd year Value-Added College Readiness High School Prep Model: Value-Added – All Students CFI =.95 RMSEA =.08

Accountability/Accreditation Tend to be normative Comparison group of like institutions Adjustment for covariates Longitudinal/Cross sectional

Example of longitudinal study Pascarella, Bohr, Nora and Terenzini, (1995) Journal of Higher Education

Example of cross sectional model 1. VSA 2. ACT Linkage report

Linkage model Uses ACT scores as a covariate Develops conditional distribution of CAAP scores given ACT score, based on a large sample Compares institutional distribution with comparison distribution (based on deciles)

What’s next? Assessments of a different type (non multiple choice) Standardization of alternative measures (alternative assessment types, portfolios, college GPA)

Example of what is possible Bassiri and Schulz (2003) Constructing a universal scale of high school course difficulty

International dreams Is there a PISA or a Bologna in our future? 1.Is college knowledge the same across the globe? 2.Are the populations in college the same?