1. EILS_NSF Program Assessment Strategies for obtaining meaningful & comparable results

2. Discussion: Understanding Assessment Needs Student learning outcomes vs. evaluation of program implementation Added twist: obtaining “comparable results”

3. NSF_TUES Guidelines Methods likely only to have local impact discouraged; encourage “broad based” Developing or testing newly developed approaches encouraged Collect and synthesize information about student understanding, reasoning, practical skills, interests, attitudes or other valued outcomes. “Testing effectiveness of new materials and instructional approaches”

4. Program Implementation vs. Student Learning Outcomes How/Was the course taught Students served, demographics etc. Novelty, course context Institutional Stability, Changes, Connections What did they learn? What can they do (that they couldn’t do before)? Skill set? Concepts? Perspectives? Practice? What do results say about instruction and course implementation? Comparative Cases?

5. Student Learning Outcomes Different Measures Important to know and do Worth being familiar with Enduring understanding developing skill sets Assessment Types Traditional/ Known-Answer quizzes & tests, selected response constructed response Performance Tasks, Portfolios Open ended responses Demonstration, proof of concept Authentic practice Scoring strategies

6. UCSC/SEED Methods Student self-report surveys (attitudes, satisfaction, existing & new understandings) Focus Group Interviews (supplemental to surveys) External/participant reviews (mentor feedback, satisfaction) Individual Lab assessments: Pre -post questionnaires (key concepts) Pre -post problem sets (“back of the envelope reasoning”) Pre-post concept mapping (LCA) Diagnostic Learning Activities Also tracking student demographics, enrollment, majors, interest, course progressions

7. Proposal for new and innovative assessment strategies Pre - post format but integrated within in- class activities or homework Online, performance-based Emphasis on quantitative reasoning, data interpretation and problem solving skills

8. UCSC/SEED Results cont. Indicator Categories

9. UCSC/SEED Results cont. Carbon Footprint subcategory (Radiation, Eco-toxicity, Pollution Lithosphere into Biosphere, Carbon Emissions, & Greenhouse Gases) = largest point spread Social Justice & equity = low totals and low point spread