Science General Education Assessment Assessment Development Status Update Assessment Day May 4th, 2018

Recap Consensus: Our Goals of the Assessment Development Incorporate modifications to the assessment format Generate a faculty feedback report that conveys value to faculty instruction Generate a student feedback report that communicates feedback on performance indicators of scientific reasoning

Scenario Development Criteria Primary learning outcome is scientific reasoning Relatable Minimal technical terminology 7 questions 5 possible multiple-choice answers

Scenario Development Progress Topic: Type 2 diabetes – Dietary influences (i.e., sugar- sweetened beverages, coffee consumption) Scientific reasoning indicators: Identify the objective and hypothesis Analyze the experimental format: Independent/Dependent variables Identify controls Determine replication Generate conclusions Evaluating sources

Scenario Development Progress Format: Seven questions with five answer choices Short text description of background and experimental details 2-4 data sets 2-4 references (For evaluation of sources) Pre/post-test format Logistics: Pre-test – Week 3 Base line relative to previous assessment cycle data Post-test – Week ~9

Assessment Logistics Assessment Implementation Faculty/Student Feedback Week 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

Scenarios Breakout Goals Scenario evaluation Need ideas on questions for source evaluation Similar (stand alone) or different themes Provide copy and make notes, group everyone, what are the positives, issues – how can we improve (“How might we address…”)

Scenario Break-out

Faculty Feedback Report Develop a faculty feedback report format that will inform faculty of student results (from their own classes) Breakdown of student strengths/areas of improvement needed according to the skills measured Pre/post-assessment report

Faculty Feedback Report Progress Personalized report for faculty includes: Correct number of questions answered by students Breakdown question/skill assessed into categories by class, campus, and division Completion time Include automatic logout and/or prevent multiple attempts: Include in assessment instructions Logistics – pre/post assessments ✓ ✓ ✓

Student Feedback Report Develop emailed reporting mechanism to the student Work with IR to develop an automatically-generated report Sent once assessment cycle completed Informs on areas of strength or improvement needed and possibly their score Answers not provided Include the IR email address for students to give feedback

Student Feedback Report Automated pre-developed responses for incorrect answers (Skill missed-feedback) Positive feedback for skills from correct answers Highlight how this skill is useful beyond the classroom Relate feedback to a different example to not give away answers of the current scenario Audio or video may be added, but embedded link recommended for addition of these features ✓-Static text features may be added ✓-Routing to another link/survey

Improvement Plan Intervention between pre and post-assessment - Daeri What activity do we want to use as the intervention? Report out group ideas Consensus on the intervention Ideate/Brainstorming

Improvement Plan Break-out