1. Preparing for Data Analysis Some tips and tricks for getting your data organized so that you can do the “fun stuff”!

2. Preparing Qualitative Data

3. Qualitative: Accuracy and Member checking Have your interviews transcribed Read the transcripts to make sure they are accurate Share with your participants to make sure that they agree with the transcript

4. Qualitative: Organizing your data Name your files descriptively For example: ProgramLead_Interview_IslandWood ProgramLead_Interview_BEETLES Instructor_FocusGroup_Section1.1 Instructor_FocusGroup_Section2.1 Store them in one place! Load into a program like Atlas.ti

5. Qualitative: Coding your data Read through your transcripts in their entirety to get a “sense” of the data as a whole. Decide if you will be working from an existing set of codes or if you will develop codes as you go. Or, you may choose to start from a pre- determined set of codes and then add as you go. Keep track of your code definitions in a “codebook”. Example: “place-based” = “references to place-base learning Example: “goal: team skills” = “references to a goal for coming to the program being to build team skills

6. Qualitative: Coding your data Read through your transcripts one by one and start to assign codes to pieces of text If you are using a software program like ATLAS.ti the software will keep track of your codes, codebook and coded text. You can group codes into “themes” that connect ideas

7. Playing with ATLAS.TI For this exercise, we will be playing with the K12 curriculum evaluation transcripts, found on the Google Drive under Go to http://atlasti.com/ and download the Trial Versionhttp://atlasti.com/ (Go to “Product” and click on “Free Trial Version”) Download and install the software, then Create a new “Project” Click on “Document” and then “Import Documents”. Upload all 10 documents from this folder: K12 Curriculum Eval TranscriptsK12 Curriculum Eval Transcripts

8. Playing with ATLAS.TI Start with any transcript you’d like and read through until you see an idea you’d like to code Select the text, then click on “Add code”. Create or assign a code that fits the text. If you are creating a new code, type the definition in the “Memo” box. Once you have a few codes that could be grouped into a theme or broader category (for example: philosophy or goals), go to “Code Group Manager” and add a code group. Under “Analysis”, Look at code co-occurence, codes by document or

9. Preparing Quantitative Data

10. Digitize or download your data Enter paper-survey data into a spreadsheet file like Excel or Google Sheets Download data from Qualtrics, Survey Monkey, etc. if you have used an online survey tool

11. Quantitative: Cleaning and Organizing your data Group pre and post data, if relevant. Make sure that pre and post surveys are on one line if using SPSS. Eliminate cases if they are not complete For example, lacking pre or post, lacking sufficient data, incomplete Eliminate data that is not needed For example, timestamp, IP address, etc. Glance through data to see if there are any obvious errors

12. Quantitative: Cleaning and Organizing your data Score open-ended questions if they are going to be quantified Example: open-ended questions that will be assigned a score Re-code any “reverse coded” items Assign code-names to columns to indicate the construct they are linked to. Example: Science Identity questions = PreSciID1, PreSciID2, PreSciID3 etc. Example: Energy Literacy questions = PreEL1, PreEL2, etc.

13. Prepare to analyze! Import your data into an analysis tool like SPSS or R Start with simple descriptive statistics – number, frequency Glance through to make sure you have no weird values – correct them if you find them (if you can) or decide if you need to eliminate the data Define numeric codes for categorical data (e.g. school name, instructor name, gender) Calculate any cumulative or summative variables (e.g. Science Identity as a sum or mean of 10 science identity questions)

14. Analyze! Conduct your statistical tests and report the results!

15. Playing around with Quantitative Analysis Go to the MOSS Grad Google Drive and find the datasheet called “MOSS Surveys 2015-16”. Download the data as an Excel file Check the data sheet and review for issues discussed on previous slides Import data into an analysis program and conduct a few tests (descriptive, t-tests, your choice)