EILS_NSF Program Assessment Strategies for obtaining meaningful & comparable results.

Slides:

Advertisements

Similar presentations

Understanding by Design Day 3 Roosevelt Complex Secondary Science Training.

Advertisements

Pre and Post Assessments A quick and easy way to assess your Student Learning Outcomes.

Frameworks for Assessment of Student Learning: Questions of Concept, Practice, and Detail Christine Siegel, Ph.D. Associate Professor of School Psychology.

Copyright © Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark.

BEST PRACTICES IN INFORMATION LITERACY ASSESSMENT Yvonne Mery, Vicki Mills, Jill Newby, University of Arizona Libraries February 11, 2009.

Assessment in the MYP CENTURY MIDDLE SCHOOL. What is Assessment? Assessment is integral to all teaching and learning. MYP assessment requires teachers.

Nancy Farnan, San Diego State University, Penni Hudis, ConnectEd: The California Center for College and Career,

(IN)FORMATIVE ASSESSMENT August Are You… ASSESSMENT SAVVY? Skilled in gathering accurate information about students learning? Using it effectively.

The mere imparting of information is not education. Above all things, the effort must result in helping a person think and do for himself/herself. Carter.

CHAPTER 3 ~~~~~ INFORMAL ASSESSMENT: SELECTING, SCORING, REPORTING.

Authentic Assessment Abdelmoneim A. Hassan. Welcome Authentic Assessment Qatar University Workshop.

Edit the text with your own short phrases. To change the sample image, select the picture and delete it. Now click the Pictures icon in the placeholder.

Selecting Your Evaluation Tools Chapter Five. Introduction  Collecting information  Program considerations  Feasibility  Acceptability  Credibility.

Assessing the Engaged Student: Using Evaluation Tools to Reexamine and Strengthen Civic Engagement Programs Ethan A. Kolek, Associate Director of Institutional.

Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)

Assessment Assessment Planning Assessment Improvements Assessment Data Dialogue & Reflection.

July 28, 2011 Nancy Nation & Mirna Whidden.  What do you associate with the word assessment??

AET/515 Spanish 101 Instructional Plan SofiaDiaz

ASSESSMENT& EVALUATION Assessment is an integral part of teaching. Observation is your key assessment tool in the primary and junior grades.

Welcome… The attendee will understand assessment basics with a focus on creating learning activities and identifying assessment expectations. Apply the.

Evaluation 101 Everything You Need to Know to Get Started Evaluating Informal Science Education Media Everything You Need to Know to Get Started Evaluating.

TIMELESS LEARNING POLICY & PRACTICE. JD HOYE President National Academy Foundation.

Developing an Effective Evaluation to Check for Understanding Susan E. Schultz, Ph.D. Evaluation Consultant PARK Teachers.

ASSESSMENT Formative, Summative, and Performance-Based

Blended Learning JENNIFER DRAGOO. Out with Hybrid…

STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013.

Sheila Roberts Department of Geology Bowling Green State University.

Authentic Assessment Principles & Methods

Writing Across the Curriculum (WAC) at Sojourner Douglass College Faculty and Staff Session One Saturday, November 9, 2013.

Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,

Classroom Assessment A Practical Guide for Educators by Craig A

Gerald Kruse and David Drews Juniata College Huntingdon, PA

Elizabeth Godfrey 1.  Periodic assessment of results Appropriateness, effectiveness, efficiency, impact, sustainability  Identifies intended and unintended.

Four Basic Principles to Follow: Test what was taught. Test what was taught. Test in a way that reflects way in which it was taught. Test in a way that.

Using Electronic Portfolios to Assess Learning at IUPUI. Trudy Banta, et. al. Indiana University-Purdue University Indianapolis 2007.

College of Science and Engineering Evaluation of the Learning and Teaching Strategy: The Way Forward? Velda McCune Centre for Teaching, Learning and Assessment.

Assessment Workshop College of San Mateo February 2006.

Foundations of Assessment I Understanding the Assessment Process.

Threshold Concepts & Assessment Ahmed Alwan, American University of Sharjah Threshold Concepts For Information Literacy: The Good, the Bad and the Ugly.

An examination of diverse forms of literacy, media and tools to be infused into a new online course: EDF 6855: Equitable Educational Opportunity and Life.

Curriculum Report Card Implementation Presentations

The Assessment of Teaching with Technology Dan Talley Dakota State University June 4, 2004.

Evelyn Wassel, Ed.D. Summer  Skilled in gathering accurate information about students learning?  Using it effectively to promote further learning?

Exploring Evidence.

Program Evaluation.

Session 4 Performance-Based Assessment

Research Problem In one sentence, describe the problem that is the focus of your classroom research project about student learning: The traditional approach.

Mehmet Dali Öztürk, Ph.D. 3CSN and ELI Collaborate: Data Collection Workshop September 6, 2013.

Quick Write Reflection How will you implement the Engineering Design Process with your students in your classes?

Internal Assessment Report: A qualitative report on the implementation of district performance assessments and an update on the AIM initiative Presentation.

Developing an Effective Evaluation to Check for Understanding Part 2 Susan E. Schultz, Ph.D. Evaluation Consultant PARK Teachers.

B.A. (English Language) UNIVERSITI PUTRA MALAYSIA

Identifying Assessments

Research Problem The role of the instructor in online courses depends on course design. Traditional instructor responsibilities include class management,

Testing methods that require students to create and answer or develop a product that demonstrates knowledge or skills.

The purpose of evaluation is not to prove, but to improve.

Funded by a grant from the National Science Foundation, GSE/EXT: STEM Equity Pipeline Project, Grant No. HRD © 2009 National Alliance for Partnerships.

M & E System for MI’s Training Program & Guidelines for MI’s Completion Report Presented by Monitoring and Evaluation Officer Mekong Institute January.

Associate Professor Cathy Gunn The University of Auckland, NZ Learning analytics down under.

Chapter 6 Assessing Science Learning Updated Spring 2012 – D. Fulton.

Using Data in a School Counseling Program Miss M. Brand Pine Grove Area Elementary School.

Assessment and Evaluation of CAREER Educational Components Center for Teaching Advancement and Assessment Research.

EVALUATING A MIDDLE SCHOOL MATH M.ED. PROFESSIONAL DEVELOPMENT PROGRAM. Knowledge, Pedagogy, Practice or Student Achievement:

D2L Refresher Upload content into the Content section in a D2L course

ASSESSMENT OF STUDENT LEARNING

Jenny Lyn Tee Estrada-Firman Reporter

Layers of Evaluation & Meaningfulness of Results

Revising the large lecture class

Assessing Experiential Learning Outcomes with Technology

TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1

Presentation transcript:

EILS_NSF Program Assessment Strategies for obtaining meaningful & comparable results

Discussion: Understanding Assessment Needs Student learning outcomes vs. evaluation of program implementation Added twist: obtaining “comparable results”

NSF_TUES Guidelines Methods likely only to have local impact discouraged; encourage “broad based” Developing or testing newly developed approaches encouraged Collect and synthesize information about student understanding, reasoning, practical skills, interests, attitudes or other valued outcomes. “Testing effectiveness of new materials and instructional approaches”

Program Implementation vs. Student Learning Outcomes How/Was the course taught Students served, demographics etc. Novelty, course context Institutional Stability, Changes, Connections What did they learn? What can they do (that they couldn’t do before)? Skill set? Concepts? Perspectives? Practice? What do results say about instruction and course implementation? Comparative Cases?

Student Learning Outcomes Different Measures Important to know and do Worth being familiar with Enduring understanding developing skill sets Assessment Types Traditional/ Known-Answer quizzes & tests, selected response constructed response Performance Tasks, Portfolios Open ended responses Demonstration, proof of concept Authentic practice Scoring strategies

UCSC/SEED Methods Student self-report surveys (attitudes, satisfaction, existing & new understandings) Focus Group Interviews (supplemental to surveys) External/participant reviews (mentor feedback, satisfaction) Individual Lab assessments: Pre -post questionnaires (key concepts) Pre -post problem sets (“back of the envelope reasoning”) Pre-post concept mapping (LCA) Diagnostic Learning Activities Also tracking student demographics, enrollment, majors, interest, course progressions

Proposal for new and innovative assessment strategies Pre - post format but integrated within in- class activities or homework Online, performance-based Emphasis on quantitative reasoning, data interpretation and problem solving skills

UCSC/SEED Results cont. Indicator Categories

UCSC/SEED Results cont. Carbon Footprint subcategory (Radiation, Eco-toxicity, Pollution Lithosphere into Biosphere, Carbon Emissions, & Greenhouse Gases) = largest point spread Social Justice & equity = low totals and low point spread