1. Ellen Iverson and David Steer Testing Process and Assessment Components May 2013

2. What you need to know about IRB What does the project need to know about your course What you need to collect for the project Testing Process and Assessment What do you need to do after you pass the Materials Review?

3. Make contact with your IRB early (Checkpoint 1) Know that it is institution dependent Give project list of which students do not consent Carleton College has EXEMPT status Carleton letter IRB application for Carleton Consent forms examples http://serc.carleton.edu/integrate/info_team_mem bers/currdev/documents/index.html IRB: What you need to know

4. Have two possibilities: Implied consent Signed consent Give students option to opt out at beginning of term Upload or send to project: Who opted out (by student ID) May need TA to proctor Provide this data to project at beginning of term IRB: What you need to know What about consent?

5. What Project Needs for Course http://serc.carleton.edu/integrate/info_team_members/currdev/documents/course_form.html Webteam will help you complete the Course Set up Form

6. What is Collected for Project http://serc.carleton.edu/integrate/info_team_members/currdev/course_status.html What other data are collected?

7. Measures the student learning for your intended goals Provides an independent review of these measures across team Provides means to measure aspects of geoscience literacies Gives measures of attitudes, motivations, aspirations What is Collected for Project How will data help you and help the project?

8. The external evaluation team will evaluate the project’s effectiveness at : “expanding the number of students who enroll….” achieving “…enhanced learning…” achieving “… significant progress towards addressing the national challenge” of environmental sustainability [The evaluation team will consider students’ ability and motivation to use insights from geosciences to address grand challenges of sustainability.] Assessment team will: Focus on understanding the impact of new materials and courses on student learning. Work with module and course developers to make sure that all materials are aligned with the project goals and are designed on the basis of research on learning Focus on measuring the impact of materials on student learning. What is Collected for Project How will data help you and help the project?

9. Faculty reflections following: Materials rubric Testing Materials revision Student identifier with roster Pre- & Post-course Geoscience Literacy Assessment (GLE 8 MC questions) Two post course short essay questions Pre- & post-course attitudinal survey (related to project evaluation) Summative assessments for your module/course Student engagement measure What is Collected for Project What other data are collected? http://serc.carleton.edu/integrate/info_team_members/currdev/course_status.html

10. Online: Faculty reflections Pre- & post-course attitudinal survey (related to project evaluation) Securely administered (most likely paper): Pre- & Post-course Geoscience Literacy Assessment (GLE 8 MC questions) with student ID Two post course short essay questions with student ID Uploaded to project: Student identifier with roster Student engagement measure Summative assessments for module/course with student ID GLE Pre/post GLE essay How Data is Collected?

11. How is Data Collected

12. Testing Process and Assessment What questions do you have about testing and data collection?