1. Testing Process and Data Collection
Monica Bruckner
Ellen Iverson
SERC

2. By the end of this presentation, you should be able to:
Find more information as you need it:
web resources,
webteam liaison,
assessment consultant,
team leads
Know timing of Piloting w/r/t authoring and rubric review
Understand what data will be collected and why

3. Pilot Materials, Make changes
Identify Course & Module Learning Goals
Identify learning objectives for individual lessons
Determine how to assess and measure student success on goals and objectives
Design teaching resources and materials to match assessments
Plan Instructional Strategies to implement teaching resources
Pilot Materials, Make changes

4. Classroom Pilot & Data Collection
Classroom pilots are conducted individually, but depend on passing rubric as a team
It is really important to start thinking about the pilot early enough
Start IRB at checkpoint 1
*IRB approval

5. Goal is demonstrate that a student has learned and benefited from InTeGrate materials
Difficult to measure directly, collect a set of information

6. Pre- & Post-course Geoscience Literacy Assessment (GLE 8 MC questions)
2 from each literacy document
4 Single answer and 4 “select all that apply”
Two post course short essay questions (interdisciplinary & systems thinking)

7. Important for adoption
Measuring the level of understanding when learning related to that course/module goal is completed
Important for adoption
David S comment: You want another faculty to look at your student work and say “Wow, my students can’t do that” – this can be the most compelling

8. Pre- & post-course motivation and career interest survey (related to project evaluation)

9. Faculty Reflection Surveys
Course Information
Demographic data
Faculty Reflection Surveys
Checkpoint 4 (after development)
Notes while teaching (individual reporting page)
Post-Pilot
After Revisions
Notes will help you document and remember how your own teaching has changed with these materials, as well as how you specifically implemented - interdiscpli

10. Conducted and setup through SERC using course set-up form

12. IRB: What you Need to Know
Make contact with your IRB early (Checkpoint 1)
Know that IRB procedures vary by institution
Give project list of which students do not consent
Carleton College has EXEMPT status
You will need Carleton letter
Consent form examples are posted
Ask for help!

13. IRB: What you need to know
What about consent?
Give students option to opt out at beginning of term
Implied consent
Signed consent

14. Data Collection Where can you find help?

15. By the end of this presentation, you should be able to:
Find more information as you need it:
web resources,
webteam liaison,
assessment consultant,
team leads
Know timing of Piloting w/r/t authoring and rubric review
Understand what data will be collected and why

16. What questions do you have about testing and data collection?
Testing Process and Assessment
What questions do you have about testing and data collection?