How to do an observation Segment 29 & 30 - PSYCHSCI

Types of Observations Structured Observation Semistructured Observation Observations in experiments Unstructured observation such as an ethnography (observational study of cultural practices) Self-observations such as diaries

Gathering information within an observation Use structured observation grids to narrow what you are looking for (related to the aim) – Orange book p.46 What behaviors are considered aggressive for a preschool child? Are those behaviors different by gender? Three types of sampling for the grids Time sampling: sample at pre-determined times Event sampling: record only a specific set of events (details of prom dancing) Point sampling: observe one participant’s behavior, then move on to the next participant

Gathering information within an observation Data-gathering devices Video Still camera Audio Hand-written notes (coding on the spot) Creating a code system (increases inter-rater reliability) Create codes for most all common activities (Coolican p )

Reliability in observations Inter-rater reliability (multiple researchers observing the same thing) decreases researcher bias Inter-rater reliability can be measured with a correlation coefficient

Participant v. non-participant observations Participant advantages High ecological validity Reduces participant expectancy (covert) Increases reliability & validity (covert) Participant Disadvantages Ethical concerns (covert) May not blend in enough to avoid participant expectancy Non-participant disadvantages Easy informed consent & low ethical concerns

Naturalistic observations Advantages Ecological validity is high Very detailed accounts Disadvantages Ethical dilemmas if covert Time-consuming, which reduces the # of participants

Covert v. Overt observations Advantages of Covert Less participant expectancy Disadvantages of Covert Ethical issues with deception Advantages of Overt Less ethical issues Best if long-term to make participants comfortable Disadvantages of Overt Increases participant expectancy

Setting up and carrying out an Observation Step 1 – choose goal(s) Exploratory goals Descriptive goals Evaluative goals Step 2 – learn about the topic with a thorough study of appropriate literature Step 3 – defocus (empty your mind of pre-conceived notions) Reduces researcher bias Allows for self-knowledge to increase reflexivity (personal knowledge? Bias?)

Setting up and carrying out an Observation Step 4 – research site Choose and set up based on three factors 1.Choose site/participants who will give richest data 2.(for ethnography) unfamiliar site w/o prior expertise increases credibility 3.Safe and physically accessable Step 5 - Decide on researcher role Participant? Covert? Naturalistic?

Setting up and carrying out an Observation Step 6 – gaining access to participants Gatekeepers (authorities who can provide access) are useful Informants (people that can translate information or behaviors) are vital These people might have bias!!!!!! Step 7 – climb the access ladder It takes time to get people to open up Step 8 – build rapport People must feel like sharing

Setting up and carrying out an Observation Step 9 – create thick descriptions (detailed accounts of setting and context as well as what happened) Reduces observer bias Embrace serendipity (que sera sera, what will be, will be!) Rigorous noted increase credibility Separate your facts and inferences Write the notes ASAP to avoid memory decay Write analytical memos when you make choices while in the observation Make maps and diagrams to visually explain setting Make a reflexive journal to note personal bias and feelings

Setting up and carrying out an Observation Step 10 – post-observation duties Discuss findings with key participants to verify Increase ethics and credibility Check & recheck interpretations with other researchers Increases inter-rater reliability Debrief participants