Data Collection InTeGrate HBCU Research Team Materials Testers Ellen Iverson Monica Bruckner SERC

By the end of this presentation, you should be able to: Find more information as you need it: Project Team: Leadership and SERC contacts Web resources Know where to find project information needed for data collection Understand what data will be collected and why

Web Support, Data Collection, and Analysis Project Team Project Leadership Richard Gragg richard.gragg@famu.edu Felicia Davis iask@bellsouth.net Cathy Manduca cmanduca@carleton.edu Ellen Iverson eiverson@carleton.edu Web Support, Data Collection, and Analysis Webinar Leader Monica Bruckner Website, course set up & data collection support mbruckne@carleton.edu Kristin O’Connell Data collection support koconnell@carleton.edu Kathryn Sheriff Data collection ksheriff@carleton.edu Hannah Scherer Webinar presenter hscherer@vt.edu

Post Course Essay questions Goal is demonstrate that a student has learned and benefited from InTeGrate materials Difficult to measure directly, collect a set of information

Data Collection: First 1-2 Weeks of the Course Pre measures: Online survey: motivation and career interest survey Paper scantron format: Geoscience Literacy Assessment (GLE 8 MC questions) http://serc.carleton.edu/integrate/info_team_members/hbcu_testers_team/data_collection.html

Data Collection: In the Final 1-2 Weeks of the Course Post measures: Online survey: motivation and career interest survey Paper scantron format: Geoscience Literacy Assessment (GLE 8 MC questions) Two post course short essay questions (interdisciplinary & systems thinking) http://serc.carleton.edu/integrate/info_team_members/hbcu_testers_team/data_collection.html

Data Collection: Post-Course Faculty Reflection Post measure: Share your Experience: Instructor Story

Data Collection Instruction pages provide guidance. Linked from the webinar event page: http://serc.carleton.edu/integrate/info_team_members/hbcu_testers_team/data_collection.html

Getting Started: Data Collection Step 1: Fill out the course set up form Submitting this form creates your course page, survey URLs, and provides the project personnel with info they need about your course https://serc.carleton.edu/integrate/info_team_members/hbcu_testers_team/course_form.html

Getting Started: Data Collection Step 1: Fill out the course set up form Your name and institution information Course name, enrolled number of students, course level and type Course start/end date Instructions for students to identify their ID number IRB information Anticipated schedule when you plan to give students surveys/assessments Will you be uploading or sending photocopy via USPS, FedEx, etc **You can edit this information from your resulting course page if it changes!

After submitting the form, you’ll see this message (and get an email with the same info) Bookmark this page! (You can also find it on your acct page)

The Course Status Page One-stop place for information about your course and the status of all of the data collection. https://serc.carleton.edu/integrate/info_team_members/currdev/status_page.html

The Course Status Page Some of the things you will use this page for: Upload your roster of student names Verify that students completed surveys (and used the correct student ID) Find the url for your attitudinal survey Upload data https://serc.carleton.edu/integrate/info_team_members/currdev/status_page.html

Uploading your roster early helps us track completion rates for your surveys It can help identify unknown student IDs. Can upload revised roster at any time (e.g. if students add or drop course) All student IDs are encrypted in our system, so student anonymity is protected

Paste in your roster and use the drop down menu to identify which students have/have not completed the attitudinal surveys. Useful tool for prompting students to complete these.

Student IDs are encrypted when they enter our system If a student turns in work that doesn’t match an ID on your roster, it’ll show up in this list. You can correct it if and only if you can ID that student (e.g. they put in an extra zero) Once corrected, we cannot make further changes to the ID

Providing your Data to the Project There are two ways to provide your data to the project: Scan and upload it to your course page (preferred) Mail a photocopy of the materials to the SERC office at Carleton College, including a cover sheet with a clear description of what they are (e.g. what course they relate to, what data are included). Packages should be sent with a tracking number regardless of shipment method (USPS, FedEx, etc.). Please forward this tracking number to MJ Davenport so that we know when to expect the package (mdavenport (at) carleton (dot) edu): Science Education Resource Center 200 Division Street, Suite 210 Northfield, MN 55057 Attn: MJ Davenport

Give files descriptive names AND check box, if applicable Ensure names are redacted (except signed consent forms) and that all data is readable and labeled with student IDs Upload ungraded student work. If already graded, cover final grade if possible. How to upload files

Red dates – date has passed Green dates – we got what we needed Key: Red dates – date has passed Green dates – we got what we needed “new” – file uploaded “accepted” – data ready for processing on our end “copied” – data copied and ready for review by assessment team Take home – much of this depends on our importing the data; it may not be updated immediately, but if several weeks have passed and you have a concern, let us know The Course Status Page How SERC (and you) can keep track of your data collection What files look like when uploaded

Instructor Story After the course-- Share your experience Tell us about your course How did you use the module? What went well/needed modification? What did you modify? How’d it go overall? This page will be shared to the public site so others can get ideas for adapting materials to their own course.

By the end of this presentation, you should be able to: Find more information as you need it: Project Team: Leadership and SERC contacts Web resources Know where to find project information needed for data collection Understand what data will be collected and why

What questions do you have about data collection?