S052/Shopping Presentation – Slide #1 © Willett, Harvard University Graduate School of Education S052: Applied Data Analysis Shopping Presentation: Six Easy Pieces Technology? Mission … should you decide to accept it? Things to make and do, before class begins? Things to make and do, before class begins? Work required of you? Audience? Topics covered? S-052 Applied Data Analysis S-052 Applied Data Analysis Mission … should you decide to accept it? Things to make and do, before class begins? Things to make and do, before class begins? Technology? Work required of you? Audience? Topics covered?

S052/Shopping Presentation – Slide #2 © Willett, Harvard University Graduate School of Education the antithesis of the course mission For insight into the antithesis of the course mission, ask yourself... What do these two well-known poems have in common? the antithesis of the course mission For insight into the antithesis of the course mission, ask yourself... What do these two well-known poems have in common? S052: Applied Data Analysis Shopping Session: Mission, Should You Decide to Accept It? Alums of S-052 must swear on a Table of  2 -Statistics, during the course Potato Sacrament, that they will avoid the Data-Analysis of Deliberate Obscurity, at all costs The scientists are in terror and the European mind stops Wyndham Lewis taking blindness rather than have his mind stop Night under wind mid garofani the petals are almost still. Ezra Pound, 19?? from Canto CXV The scientists are in terror and the European mind stops Wyndham Lewis taking blindness rather than have his mind stop Night under wind mid garofani the petals are almost still. Ezra Pound, 19?? from Canto CXV The multivariate test of differences was statistically significant The variables that loaded most heavily on the first canonical discriminant function were GHb and HMBG Between-group structure coefficients were.95 and.91 respectively. Author’s name withheld, 1990 from American Educational Research Journal, 27(3) The multivariate test of differences was statistically significant The variables that loaded most heavily on the first canonical discriminant function were GHb and HMBG Between-group structure coefficients were.95 and.91 respectively. Author’s name withheld, 1990 from American Educational Research Journal, 27(3)

S052/Shopping Presentation – Slide #3 © Willett, Harvard University Graduate School of Education S052: Applied Data Analysis Shopping Session: How Is the Mission Achieved? Learn new skills actively Learn new skills actively:  Learn by “doing,” acquire skills by applying new methods to real data in order to address real questions.  Learn as part of an active community whose members have differing levels of expertise, who model and display responsible behavior, and who offer mutual feedback and support. Focus on what humans do best Focus on what humans do best:  Plan data-analyses to address research questions appropriately and explicitly.  Guide the computer through the legwork, making sure it completes the work correctly.  Check that the constraints under which the work must be conducted have been met.  Parse, interpret and communicate the products for members of your own, and neighboring, communities. Learn new skills actively Learn new skills actively:  Learn by “doing,” acquire skills by applying new methods to real data in order to address real questions.  Learn as part of an active community whose members have differing levels of expertise, who model and display responsible behavior, and who offer mutual feedback and support. Focus on what humans do best Focus on what humans do best:  Plan data-analyses to address research questions appropriately and explicitly.  Guide the computer through the legwork, making sure it completes the work correctly.  Check that the constraints under which the work must be conducted have been met.  Parse, interpret and communicate the products for members of your own, and neighboring, communities. by “Cognitive Apprenticeship” More details can be found in the “Course Objectives & Content” handout, on the course website.

S052/Shopping Presentation – Slide #4 © Willett, Harvard University Graduate School of Education S052: Applied Data Analysis Shopping Session: Who Are the Audience? The audience is you!!! The good news is … that S-052 extends directly the work of S-030!! The audience is you!!! The good news is … that S-052 extends directly the work of S-030!! Welcome S030, Class of 2007!! The bad news is that … If you didn’t complete S-030 in preparation for S-052, then you must satisfy me that your preparation meets the “S-030 Standard.” The key question is … Do you have a “practical working knowledge of multiple regression analysis, including the use and interpretation of statistical interactions”? Make sure that you … Complete the cross-registrant biography sheet and return it to me, documenting your prior statistical training clearly. The bad news is that … If you didn’t complete S-030 in preparation for S-052, then you must satisfy me that your preparation meets the “S-030 Standard.” The key question is … Do you have a “practical working knowledge of multiple regression analysis, including the use and interpretation of statistical interactions”? Make sure that you … Complete the cross-registrant biography sheet and return it to me, documenting your prior statistical training clearly. More details in the “Course Objectives & Content” handout, on the course website. More details in the “Course Objectives & Content” handout, on the course website.

S052/Shopping Presentation – Slide #5 © Willett, Harvard University Graduate School of Education S052: Applied Data Analysis Shopping Session: Topics Included in the Course Curriculum? More details can be found in the “Course Objectives and Content” handout on the course webpage. Multiple Regression Analysis (MRA) Multiple Regression Analysis (MRA) Do your residuals meet the required assumptions? Test for residual normality Use influence statistics to detect atypical datapoints If your residuals are not independent, replace OLS by GLS regression analysis Use Individual growth modeling Specify a Multi-level Model If your sole predictor is continuous, MRA is identical to correlational analysis If your sole predictor is dichotomous, MRA is identical to a t-test If your several predictors are categorical, MRA is identical to ANOVA If time is a predictor, you need discrete-time survival analysis… If your outcome is categorical, you need to use… Binomial logistic regression analysis (dichotomou s outcome) Multinomial logistic regression analysis (polytomous outcome) If you have more predictors than you can deal with, Create taxonomies of fitted models and compare them. Form composites of the indicators of any common construct. Conduct a Principal Components Analysis Use Cluster Analysis Use non-linear regression analysis. Transform the outcome or predictor If your outcome vs. predictor relationship is non- linear, How do you deal with missing data?

S052/Shopping Presentation – Slide #6 © Willett, Harvard University Graduate School of Education S052: Applied Data Analysis S052: Applied Data Analysis Shopping Session: What Work Is Required Of Registered Students? Attend, and participate, in all classes Attend, and participate, in all classes:  Digitized Video of each class available for review. Complete all assigned preparatory reading in advance of class Complete all assigned preparatory reading in advance of class:  Read the Class Handouts, especially pages flagged for close scrutiny.  Available on website, aheade of class. Complete all assigned post-class readings Complete all assigned post-class readings:  Occasional appendices to Class Handouts.  Occasional additional readings (website, Harvard PIN). Complete all Data-Analytic Memoranda (DAMs) Complete all Data-Analytic Memoranda (DAMs):  Seven DAMs over semester (see Schedule).  Each contains structured data analysis w/ interpretation.  Collaborate with a partner.  Readings from required text embedded within each memo. Complete final examination Complete final examination:  Covers all course content, including readings.  Based on pre-supplied “evidentiary materials.”  Individual effort, take-home, open-book, time-limited. Attend, and participate, in all classes Attend, and participate, in all classes:  Digitized Video of each class available for review. Complete all assigned preparatory reading in advance of class Complete all assigned preparatory reading in advance of class:  Read the Class Handouts, especially pages flagged for close scrutiny.  Available on website, aheade of class. Complete all assigned post-class readings Complete all assigned post-class readings:  Occasional appendices to Class Handouts.  Occasional additional readings (website, Harvard PIN). Complete all Data-Analytic Memoranda (DAMs) Complete all Data-Analytic Memoranda (DAMs):  Seven DAMs over semester (see Schedule).  Each contains structured data analysis w/ interpretation.  Collaborate with a partner.  Readings from required text embedded within each memo. Complete final examination Complete final examination:  Covers all course content, including readings.  Based on pre-supplied “evidentiary materials.”  Individual effort, take-home, open-book, time-limited. More details can be found in the “Frequently Asked Questions” and the “Topic and Assignment Schedule” handouts on the course webpage. More details can be found in the “Frequently Asked Questions” and the “Topic and Assignment Schedule” handouts on the course webpage. Attend, be alert and participate fully in every class...

S052/Shopping Presentation – Slide #7 © Willett, Harvard University Graduate School of Education S052: Applied Data Analysis Shopping Session: Will We Make Use of Computers, Software & The Web? Important facts about using Information Technology in the course… Course website Course website contains: Course website  All course materials, including curriculum and schedule, frequently-asked questions, professor presentations, student handouts, etc.  Digitized Video of each class.  All Data-Analytic Memos and the Final Examination.  All Reference Materials & additional readings, except for readings from the required text (you need Harvard PIN).  Useful Links to the WWW. Data-analytic software used in the course:  I assume that you are familiar with PC-SAS.  Free on HGSE workstations (in LTC, around school).  Can be licensed cheaply from Harvard.  If you use your own system, you are responsible for transferring the materials error-free and making sure appropriate statistical software is available. Preferred method of communication in the course:  Course bag and Forums. Course website Course website contains: Course website  All course materials, including curriculum and schedule, frequently-asked questions, professor presentations, student handouts, etc.  Digitized Video of each class.  All Data-Analytic Memos and the Final Examination.  All Reference Materials & additional readings, except for readings from the required text (you need Harvard PIN).  Useful Links to the WWW. Data-analytic software used in the course:  I assume that you are familiar with PC-SAS.  Free on HGSE workstations (in LTC, around school).  Can be licensed cheaply from Harvard.  If you use your own system, you are responsible for transferring the materials error-free and making sure appropriate statistical software is available. Preferred method of communication in the course:  Course bag and Forums. More details can be found in the “Frequently Asked Questions” handout on the course webpage. More details can be found in the “Frequently Asked Questions” handout on the course webpage.

S052/Shopping Presentation – Slide #8 © Willett, Harvard University Graduate School of Education S052: Applied Data Analysis Shopping Session: Things To Make And Do Before Class Begins? Register for the course:  No auditors allowed.  I will sign cross-registrant forms for those who have completed S-030 immediately; for others I will sign when I am satisfied you have met the requirements.  All cross-registrants should complete and submit the cross- registrants biography form, to me. Get a functioning Harvard PIN and Password. Check you have functioning HGSE computer access:  Cross-registrants will automatically receive a computer account once our registrar receives their registration. Check out the Course Website: Course WebsiteCourse Website  Today: Print “Course Objectives and Content,” Frequently-Asked Questions,” & “Topic and Assignment Schedule” handouts. Read before the first class, they are our learning contract.  24 hours before the first class: Check course website for announcements about the Class Handouts you will need to print out & bring to 1 st class. Print them out & read them over before coming to class. Register for the course:  No auditors allowed.  I will sign cross-registrant forms for those who have completed S-030 immediately; for others I will sign when I am satisfied you have met the requirements.  All cross-registrants should complete and submit the cross- registrants biography form, to me. Get a functioning Harvard PIN and Password. Check you have functioning HGSE computer access:  Cross-registrants will automatically receive a computer account once our registrar receives their registration. Check out the Course Website: Course WebsiteCourse Website  Today: Print “Course Objectives and Content,” Frequently-Asked Questions,” & “Topic and Assignment Schedule” handouts. Read before the first class, they are our learning contract.  24 hours before the first class: Check course website for announcements about the Class Handouts you will need to print out & bring to 1 st class. Print them out & read them over before coming to class. Before classes start, please … … do something exciting!!