Oklahoma Association for Institutional Research & Planning Spring Conference April 1, 2005 National Assessment of College-Level Learning Debra L. Stuart (405)

Measuring Up and the National Assessment Pilot Project

Learning Measuring Up: Graded Categories Preparation: How adequately are students being prepared for education and training beyond high school? Participation: Do state residents enroll in education and training beyond high school? Affordability: How affordable is higher education for students and their families? Completion: Do students make progress toward the complete certificates and degrees in a timely manner? Benefits: What benefits does the state receive as a result of having a more highly-educated population? Learning: What is known about student learning as a result of education and training beyond high school?

Measuring Up 2004

National College-Level Learning Assessment Pilot Project on College-Level Learning on College-Level Learning Sponsored by the Pew Charitable Trusts Margaret Miller, Project Director

Learning

on College-Level Learning on College-Level Learning Key Questions What do all of the state ’ s college-educated citizens know and what can they do that contributes to the social good? What kind of educational capital do they represent? and/or

Key Questions How well do the state’s public and private colleges and universities collectively contribute to that educational capital? What do those whom they educate know and what can they do?

Measuring College-Level Learning Measuring Up 2002: Kentucky pilot Measuring Up 2004: five-state trial (IL, KY, NV, OK, SC) Measuring Up 2006: grade states

Direct Measures Graduate exam and licensure pass rates ACT WorkKeys in math, reading, locating info., listening, business writing CAE Collegiate Learning Assessment with GRE writing sample National Assessment of Adult Literacy

Indirect Measures National Survey of Student Engagement (NSSE) & Community College Survey of Student Engagement (CCSSE) Peterson ’ s Collegiate Results Survey

Institutional Participation Contact alumni in Summer 2003 Administer assessments in Fall 2003 Use results as desired No institution-level data will be reported Statewide sample of public and private No direct costs to institutions

Learning OKLAHOMA 2004 Grade Five states, including Oklahoma, receive a “plus” grade for their efforts to assess and measure Learning at a statewide level through their participation in a national pilot project. +

Learning NATIONAL SNAPSHOT

Learning GRADING LEARNING The pilot project measured the states in terms of: Literacy levels of the state’s residents What are the abilities of the college-educated? Graduates’ readiness for advanced practice How well do colleges and universities enable students to contribute to the workforce? Performance of college graduates How effectively can college graduates communicate and solve problems?

Learning OKLAHOMA Results Oklahoma has been active in attempting to improve the quality of higher education. However, the state performs below the national average on most measures of student learning.

Learning OKLAHOMA Results Literacy levels of residents are slightly below the national average. Higher-than-average proportions of college graduates appear prepared to enter licensed technical careers.

Learning OKLAHOMA Results Lower-than-average proportions of college graduates are prepared for traditional graduate study. College graduates demonstrate average performance in problem-solving skills and below-average performance in written communication.

Learning Next Steps National publication in Fall 2005 Distribute summary data Expand use of WorkKeys Continue to collect same data (e.g. licensure and certification)

Learning Next Steps Study student motivation issues Explore common general education competencies Address writing deficiencies Collaborate with other states