Ellen Iverson and David Steer Testing Process and Assessment Components May 2013.

Slides:



Advertisements
Similar presentations
GENERAL EDUCATION ASSESSMENT Nathan Lindsay January 22-23,
Advertisements

Let’s Take a Look Back Reviewing your PD Plan. Guskey’s Three Phases of Evaluation Need to image from Summer Institute 1 The flow chart??
Quality Enhancement Plan: Year Four Implementation.
PROFESSIONAL AND PROGRAMMATIC DEVELOPMENT Collaborative Assessment of Student Products.
The Massachusetts Model System for Educator Evaluation Training Module 5: Gathering Evidence August
4/16/07 Assessment of the Core – Social Inquiry Charlyne L. Walker Director of Educational Research and Evaluation, Arts and Sciences.
SEM Planning Model.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geosciences.
Assessing Financial Education: A Practitioner’s Guide December 2010.
Introduction of SERC Resources and Content Management System Ellen Iverson Science Education Resource Center Carleton College February 2013.
David Steer Department of Geosciences The University of Akron Learning objectives and assessments Oct 2013.
Overhaul of a Graduate Program in Arts Administration Master of Arts in Arts Administration – Initiated in 2003 – Low-residency—one weekend per month (over.
Overhaul of a Graduate Program in Arts Administration Master of Arts in Arts Administration –Initiated in 2003 –Low-residency—one weekend per month (over.
Achieving the Dream Status Report Mentor Visit February 5-6, 2009.
The College of Saint Rose School of Education Department of Literacy and Special Education Teacher Candidate Assessment.
CHERRY DANIELSON ELLEN IVERSON ASSESSING STUDENT LEARNING AS A RESULT OF CIVIC ENGAGEMENT PROJECTS December 12, 2013.
InTeGrate Assessment David Steer, University of Akron Ellen Iverson, Carleton College May 2012.
Evaluation and Website Overview Ellen Iverson Cathy Manduca.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geociences.
Geoscience Learning for a Sustainable Future: InTeGrate Hurricane Hazards Module Lisa A. Gilbert, Williams-Mystic and Williams College Joan Ramage, Lehigh.
This work is supported by the National Science Foundation’s Transforming Undergraduate Education in STEM program within the Directorate for Education and.
Developing materials for InTeGrate: A Big Picture View David Steer, The University of Akron Ellen Iverson, Science Education Resource Center.
David Steer Department of Geosciences The University of Akron Learning objectives and assessments May 2013.
InTeGrate: Interdisciplinary Teaching of Geoscience for a Sustainable Future An NSF STEP Center in the Geoscience Cathy Manduca, Sean Fox, Ellen Iverson,
Integrating Ethics into Graduate Training in the Environmental Sciences Michelle Stickler Education Specialist The Pennsylvania State University Funded.
Presented to GETSI by Ellen Iverson, SERC, Carleton College Developed as InTeGrate talk by David Steer Department of Geosciences The University of Akron.
This work is supported by the National Science Foundation’s Transforming Undergraduate Education in STEM program within the Directorate for Education and.
Race to the Top Assessment Program: Public Hearing on High School Assessments November 13, 2009 Boston, MA Presenter: Lauress L. Wise, HumRRO Aab-sad-nov08item09.
Assessment of Service Learning Projects Not necessarily the “answer” but some questions and suggestions David Mogk Dept. of Earth Sciences Montana State.
1. To what extent does the Correctional Education Association College of the Air (CEA/COA): a. Increase rates of participation in postsecondary and.
Research Problem In one sentence, describe the problem that is the focus of your classroom research project about student learning: The traditional approach.
Post Secondary Transition CANAR, NOVEMBER 12, 2015.
Assessment and evaluation results overview
Ellen Iverson and David Steer Testing Process and Data Collection October 2013.
Become a Qualified Teacher. Initial Teacher Training Programmes Further Education Teachers with Qualified Teacher Learning and Skills (QTLS) status are.
Presented to GETSI by Ellen Iverson, SERC, Carleton College Developed as InTeGrate talk by David Steer Department of Geosciences The University of Akron.
Research Problem In one sentence, describe the problem that is the focus of your classroom research project about student learning: How can students learn.
Research Problem The role of the instructor in online courses depends on course design. Traditional instructor responsibilities include class management,
2/2/2016 Authentic Assessment in TVET Yufei Gao. Definition In the context of this presentation and my research: Authentic assessment in TVET : focuses.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geociences.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geosciences.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geosciences.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geosciences.
InTeGrate-ing Geoscience Learning in Undergraduate Education Cathy Manduca, Sean Fox, Ellen Iverson, Carleton College; David Blockstein, NCSE; Tim Bralower,
Research Problem Context: A recently redesigned Classroom-based Undergraduate Research Experience (CURE) - 3 rd year immunology lab - Uses guided inquiry.
Fostering Sustained Impact: Lessons Learned from Geoscience Faculty Workshops Ellen Roscoe Iverson, Cathryn A. Manduca, Science Education Resource Center,
MT ENGAGE Student Learning Outcomes and Assessment April 27, 2015.
Assessment and Evaluation Feedback to Teams Summer 2015.
+ Montgomery College Program Assessment Orientation Spring 2013.
Ellen Iverson Testing Process and Data Collection February 2014.
Intro to GETSI-Field Development Model & Guiding Principles
How to Make Meaning from your Data:
A five-year community effort to improve Earth literacy and build a workforce prepared to tackle environmental and resource issues InTeGrate supports integrated.
Data Collection InTeGrate HBCU Research Team Materials Testers
Testing Process and Data Collection
IRB webinar InTeGrate HBCU Research Team materials testers
Testing Process and Data Collection
Assessment and Evaluation Feedback to Teams
Quick Picture of a Module: A Big Picture View
InTeGrate Materials Development
An NSF STEP Center in the Geoscience
Assessment and Evaluation Feedback to Teams
InTeGrate supports integrated interdisciplinary learning about resource and environmental issues across the undergraduate curriculum to create a sustainable.
A five-year community effort to improve geoscience literacy and build a workforce prepared to tackle environmental and resource issues InTeGrate supports.
Evaluating Community-Based Learning In the Classroom
A five-year community effort to improve Earth literacy and build a workforce prepared to tackle environmental and resource issues InTeGrate supports integrated.
A five-year community effort to improve Earth literacy and build a workforce prepared to tackle environmental and resource issues InTeGrate supports integrated.
A five-year community effort to improve geoscience literacy and build a workforce prepared to tackle environmental and resource issues InTeGrate supports.
Geoscience program and individual action planning Short (~5-7 minute) interviews – Evaluation & Research team member 2:00-3:15 Work on your institution’s.
Presentation transcript:

Ellen Iverson and David Steer Testing Process and Assessment Components May 2013

What you need to know about IRB What does the project need to know about your course What you need to collect for the project Testing Process and Assessment What do you need to do after you pass the Materials Review?

Make contact with your IRB early (Checkpoint 1) Know that it is institution dependent Give project list of which students do not consent Carleton College has EXEMPT status Carleton letter IRB application for Carleton Consent forms examples bers/currdev/documents/index.html IRB: What you need to know

Have two possibilities: Implied consent Signed consent Give students option to opt out at beginning of term Upload or send to project: Who opted out (by student ID) May need TA to proctor Provide this data to project at beginning of term IRB: What you need to know What about consent?

What Project Needs for Course Webteam will help you complete the Course Set up Form

What is Collected for Project What other data are collected?

Measures the student learning for your intended goals Provides an independent review of these measures across team Provides means to measure aspects of geoscience literacies Gives measures of attitudes, motivations, aspirations What is Collected for Project How will data help you and help the project?

The external evaluation team will evaluate the project’s effectiveness at : “expanding the number of students who enroll….” achieving “…enhanced learning…” achieving “… significant progress towards addressing the national challenge” of environmental sustainability [The evaluation team will consider students’ ability and motivation to use insights from geosciences to address grand challenges of sustainability.] Assessment team will: Focus on understanding the impact of new materials and courses on student learning. Work with module and course developers to make sure that all materials are aligned with the project goals and are designed on the basis of research on learning Focus on measuring the impact of materials on student learning. What is Collected for Project How will data help you and help the project?

Faculty reflections following: Materials rubric Testing Materials revision Student identifier with roster Pre- & Post-course Geoscience Literacy Assessment (GLE 8 MC questions) Two post course short essay questions Pre- & post-course attitudinal survey (related to project evaluation) Summative assessments for your module/course Student engagement measure What is Collected for Project What other data are collected?

Online: Faculty reflections Pre- & post-course attitudinal survey (related to project evaluation) Securely administered (most likely paper): Pre- & Post-course Geoscience Literacy Assessment (GLE 8 MC questions) with student ID Two post course short essay questions with student ID Uploaded to project: Student identifier with roster Student engagement measure Summative assessments for module/course with student ID GLE Pre/post GLE essay How Data is Collected?

How is Data Collected

Testing Process and Assessment What questions do you have about testing and data collection?