L EAVE A T RAIL Assessing Portfolios: The Data, The Experts, The Advantages 2011 AAEEBL World Summit

“Do not go where the path may lead; go instead where there is no path and leave a trail.” - Ralph Waldo Emerson

H ANDOUT U PDATE

R OWANNA C ARPENTER Portland State University

Freshman Inquiry Portfolio Assessment Rowanna Carpenter, PhD Portland State University

6 Context University Studies 4 level inquiry-based interdisciplinary general education program Four goals: Inquiry and Critical Thinking Communication Diversity of Human Experience Ethical and Social Responsibility Portfolios used in Freshman Inquiry (FRINQ) Year-long theme-based interdisciplinary course

FRINQ Assessment Plan FallWinterSpring Summer Formative: Prior Learning Assessment (All FRINQ sections) Summative: Early-year assessment Formative: Early Term Assessment (optional) Summative: Mid-year assessment Formative: Early Term Assessment (optional) Summative: End-of-year assessment Summative: Portfolio Review

Freshman Portfolio Review o Review ~200 portfolios (30 per theme) o Out of ~1400 enrolled freshmen o Randomly selected from students who gave consent o Spend one day per goal reviewing portfolios (2 goals per year) o Morning calibration session o Review portfolios the rest of the day o Use University Studies computer labs o 2 readers per portfolio o Invite and pay faculty from across campus to participate o Open invitation to participate posted in weekly newsletter during Spring term

Results – Team Development

Excerpt from Annual Report “Each faculty team received a summary report of their aggregate end-of-year evaluations as well as the portfolio review. They were asked to review the data as a team before the fall retreat and come prepared to discuss one aspect of their team that was successful and one issue they’d like support on from the program.”

2007 Program-Level Writing Assessment Results

NPercent Evidence Related to Writing: Personal Narrative Analytical Writing Creative Writing Reflection on the Writing Process Assignment Instructions Outside References Integrated into Writing Evidence of a First Draft178.4 In text citations Appropriate use of grammar throughout

“Part of the discrepancy appears to derive from the portfolio assignment itself... In writing, the portfolio asks students to include final copies of their best work, while in the rubric students are evaluated based on their use of drafts and the inclusion of assignment instructions.” “In order to better understand the writing goal and how to address it in the classroom, the goal statement will be distributed to the faculty, the portfolio results will be discussed and then strategies for incorporating more prewriting and revision steps into the curriculum will be reviewed. Moreover, the Writing Center, in collaboration with Prof. Joel Bettridge has put together a writing handbook for students in frinq which offers strategies for understanding writing as a recursive process and an instructor’s manual will be distributed at the retreat.”

Percent Evidence Related to Writing: Personal Narrative Analytical Writing Creative Writing Reflection on the Writing Process Assignment Instructions Outside References Integrated into Writing Evidence of a First Draft8.427 In text citations Appropriate use of grammar throughout

Writing Improvement Over Time

What Works?? Learning-centered approach to assessment Faculty-driven process Assignment Rubric Campus-wide participation in assessment Contributes to transparency for University Studies Data is useful for and contributes to program improvement One of several assessment mechanisms for the program

G AIL R ING Clemson University

N ANCY P AWLYSHYN Mercy College

Q UESTIONS ? Terrel RhodesWende Garrison