Action Research March 12, 2012 Data Collection

Qualities of Data Collection  Generalizability – not necessary; goal is to improve school or classroom  Validity – the data measures or represents what it is meant to  Reliability – accuracy of instruments for measurement

Questions to Ask  Do the instruments and methods we plan to use measure what they claim they do?  Do they measure the phenomena we are studying?  Are we collecting enough data?

Establishing Validity  Utilize peer to peer coaching  Engage in persistent and prolonged observations  Record data accurately  Member checks -- check in with respondents to discuss interpretation of data  Provide thick descriptions – describe setting, participants, interventions, and research methods in detail

Establishing Validity  Do a negative case analysis – explore diversity of interpretations  Identify any researcher bias  Confirmability -- create an audit trail  Present results to key audiences  Engage in reflective planning

Quantitative Designs  Measures the extent to which how well something is done  Experimental: independent variable manipulated while other variables are controlled  Causal comparative: attempt to discover ther cause of issue  Correlational: examines 2 variables to see if a relationship exists  Survey: discover a group’s status with regard to certain variables

Qualitative Designs  Describes the qualities of certain aspects of phenomenon  Ethnographic: collection of data on may variables in a naturalistic setting  Naturalistic: observations in a natural setting  Participant observer: researcher becomes participant in the research  Case study: in depth investigation used to determine the relationship between variables and certain behaviors  Content analysis: analysis of written or verbal content of documents

Methods of Data Collection  Artifacts  Student generated: tests, written assignment, performances, portfolios, artwork, projects, journals, self-assessment, peer-review  Teacher generated: lesson plans, journals, self assessment, peer review  Archived: reports, school records, documents

Methods of Data Collection  Observational Data  Field notes, observation records, logs, narratives, checklists, tally sheets, videotapes, photographs, audiotapes, organizational maps/charts, behavioral scales, time on task analysis  Inquiry Data  Interviews, focus groups, conferencing, surveys, questionnaires, attitude scales

Suggestions for Surveys & Questionnaires  Ensure that survey questions are aligned with research questions  Pilot test the survey  Keep survey brief and to the point  Do not ask questions unrelated to your survey

Triangulation  Multiple forms of data are collected and analyzed  Use at least three ways to look at phenomena to identify themes or characteristics of the situation

Ethics  Confidentiality: privacy is protected by ensuring confidentiality of information  Permissions: permission is obtained to carry out the research from people in positions of responsibility  Informed consent: participants are informed of the nature of the study and provide formal consent to be included