1. A Quick Guide to Empirical Research Collaborative Construction of a CSCL Theory EME 6403 Fall 2008 – Team 1

2. What is Empirical Research? According to the American Heritage Dictionary of the English Language, it is –Relying on or derived from observation or experiment –Verifiable or provable by means of observation or experiment –Guided by practical experience and not theory, especially in medicine In sum, it is –Based on observed and measured phenomena –Derives knowledge from actual experience

3. Characteristics of Empirical Research Problem formulation –Clear statement of purpose and scope of study –Description of question, problem or issue studied and its context –Description of approach Study design and logic –Specific description of design (e.g., data collection, data identification –Clarity of logic of inquiry (e.g., how parts of study relate)

4. Characteristics of Empirical Research (cont.) Sources of evidence described –Units of study and means of selection (e.g., sites, groups, persons) –Collection of data or materials (e.g., time, duration, protocols, surveys Measurement and classification (process of data selection or translation for analysis and reporting of outcomes)

5. Characteristics of Empirical Research (cont.) Analysis and interpretation –Procedures for analysis detailed –Analytic techniques specified and described –Statement of intended or unintended results –Support of claims or conclusions made clear How research problem was addressed How conclusions support or challenge previous work(s) Implications of study

6. Characteristics of Empirical Research (cont.) Generalization – (implications beyond the specifics studied) –Author must make clear Specifics of study participants, contexts, activities, data collections, manipulations Intended scope of generalization Logic by which findings should apply within the scope of generalization

7. Key Characteristics of an Empirical Study Research question clearly articulated Methodology described thoroughly Definition of group or phenomena under study Description of process used to study group or phenomena Ask yourself “Could I recreate this study and test these results using the information provided in this paper?”. Some information taken from “Standards for Reporting on Empirical Social Science Research in AERA Publications” at http://www.aera.net/publications/Default.aspx?menu_id=30&id=52 http://www.aera.net/publications/Default.aspx?menu_id=30&id=52