PSYCHOLOGY AS A SCIENCE VALIDATING NEW KNOWLEDGE

Get published Unless research is published it doesn’t help many people. Unless research is published it doesn’t help many people. Bartholomew (1982) ‘Until its results have gone through the painful process of publication, preferably in a refereed journal of high standards, scientific research is just play. Bartholomew (1982) ‘Until its results have gone through the painful process of publication, preferably in a refereed journal of high standards, scientific research is just play.

Getting published Journals Journals A permanent scientific record A permanent scientific record Psychological journals are sometimes general and sometimes specific. Psychological journals are sometimes general and sometimes specific. The published works have to be genuine The published works have to be genuine How do we make sure that they are? How do we make sure that they are?

Peer Review Researchers send a report The editor

Peer review process The editor Experts in the field

Peer review process Experts Editor with comments

Yes With suggestions no Not on your life

Peer Review Editor decides

or To reject it. To reject it.

Three main functions of peer review Allocation of research funding (and weeding out poor research) Allocation of research funding (and weeding out poor research) Publication of research in scientific journals and books (only the noteworthy) and thereby validating it. Publication of research in scientific journals and books (only the noteworthy) and thereby validating it. Assessing the research rating of university departments Assessing the research rating of university departments

Problems with validation Sometimes peer review fails to detect fraudulent research including: Sometimes peer review fails to detect fraudulent research including: Fabrication (data made up) Fabrication (data made up) Falsification (data altered) Falsification (data altered) Plagiarism (work copied) Plagiarism (work copied)

Other problems with peer review Peer review may slow the move of science down (Kuhn) because Peer review may slow the move of science down (Kuhn) because If a piece of research shows something that goes against previous research, it may be rejected even if it’s correct until If a piece of research shows something that goes against previous research, it may be rejected even if it’s correct until Lots of other research finds the same thing (which may take a long time). Lots of other research finds the same thing (which may take a long time). Changing a line of thought is referred to as a ‘paradigm shift’. Changing a line of thought is referred to as a ‘paradigm shift’.

Other problems with peer review It is very difficult to be objective It is very difficult to be objective Researchers may be influenced by their own values Researchers may be influenced by their own values Reviewers may also be influenced by their own values Reviewers may also be influenced by their own values

Other problems with peer review There is a variety of possibilities of bias such as: There is a variety of possibilities of bias such as:

cultural This could mean that research is rejected because it finds that intelligence is influenced more by environment than by genes This could mean that research is rejected because it finds that intelligence is influenced more by environment than by genes

Institutional Institutional: research is rejected if it comes from less prestigious universities. Institutional: research is rejected if it comes from less prestigious universities.

Gender Gender: research is rejected if it is by females (or finds something that favours females) Gender: research is rejected if it is by females (or finds something that favours females)

Other problems with peer review File drawer phenomenon File drawer phenomenon

A tendency to favour positive results so negative ones are filed away. A tendency to favour positive results so negative ones are filed away. What happens f 10 negative results on the same topic are all filed away and one positive one is published? What happens f 10 negative results on the same topic are all filed away and one positive one is published? The understanding and conclusions are distorted. The understanding and conclusions are distorted.

Other problems with peer review It can be difficult to find an expert in a particular field which can mean that research is overlooked. It can be difficult to find an expert in a particular field which can mean that research is overlooked.

Other problems with peer review Reviewers are human: Reviewers are human: and sometimes have their own agenda and want to further their own name. and sometimes have their own agenda and want to further their own name. Are sometimes jealous of a researcher and want to keep them down. Are sometimes jealous of a researcher and want to keep them down.