Numeracy & Quantitative Methods Laura Lake

What is a research design? - Provides a framework for collecting and analysing data. How do we choose a research design?Depends on whether we are looking to: - describe what is happening; examine why it is happening (expressing causal connections); be able to generalise to a wider population; examine these behaviours over time. Research Designs

A research strategy based on quantification in the collection and analysing of data. Can be used to generate theories but generally involved in testing theories and hypotheses. What is a quantitative research approach?

Deductive – aims to deduce meaning for particular individuals / cases based on broader principles. Can be reductionist –it may break a particular theory or problem into its many component parts and test each element separately. Objective – the phenomenon under investigation must be observable and verifiable. What is a quantitative research approach?

Deductive & inductive Deductive =Theory Observations / findings Inductive = Observations / findings Theory

Process of deductive research Theory Hypothesis Data collection Data findings Confirmation / rejection of hypothesis Revision of theory

Given deductive nature of common research approaches generally focused experimental research design. But, quantitative research design is applicable to the four main designs : Experimental Cross-sectional Longitudinal Case study (not just qualitative) Quantitative research designs

Associated with natural sciences Gold standard in research as cause and effect are established. -Exploring the effect of one variable on another, with all other variables controlled so that they do not interfere. Experimental design & social research? In social research it is difficult to manipulate the variables we are interested in such as socio-economic group. Experimental research

Classic experimental design Randomly allocate subject to either an experimental or control group Pre-test both Experiment performed on the experimental group Post-test on both Experimental research

Quasi-experimental Similar to experiments but control group compared to two treatment groups without random assignment to the three groups. Internal validity – how can we be sure that x caused y if there was some engineering of the groups? Experimental research

Experimental design examples Two groups Experiment group Pre-test observation ExperimentPost Test observation Control groupPre-test observation No experiment Post-Test observation Analysis: Compare Pre-test and post-test results. Change in the state of a liquid Temperature Dependent Variable(Y) Independent variable (X)

 Most quantitative social research uses a cross-sectional research design as opposed to experimental (difficulty with manipulating variables).  Often thought of as the classic ‘survey’ design.  However, cross-sectional can use many methods other than a survey e.g. structured observation & official statistics.  Information collected across more than one case (usually a large number of cases) at one point in time.  Aim is to collect information on variables that can be quantified to find out about the relationships between those variables. Cross-sectional

Collects data on the same subjects over time 2 or more collection points Useful for understanding social change Longitudinal

Individual Recent graduate: Course, result, 1 st employment details, place reside Wave 1 Individual (same) Further education – professional qual, current employment details, place reside Wave 2 Individual (same) Further education – professional qual, current employment details, place reside Wave 3 TIME

Often thought of as a qualitative design but can be used when looking to quantitatively describe what is going on. Looks at the complexity of a particular case rather than quantifying and understanding relationships between variables during 2 or more collection points Cases can be individuals, businesses, organisations, events, geographical areas Useful when there is little known/understood about the topic Case Study

Quantitative Data presented numerically, descriptive, explorative, causation, theory testing. Nomothetic explanations – broad, partial, based on large number of cases. Qualitative Collection of text/words/images– idiographic explanations – complete an explanation as possible (rich data), focus on fewer cases. Summary of Quants and Quals

Generalise from sample to population Replicable in other times/ places Large numbers of respondents Minimum interviewer training Respondent completion (postal surveys etc.) Ease of analysis Standardised questions Advantages to quant designs

Limited access to respondent meaning Poor internal validity Snapshot Researcher decides categories Limited value of small scale research Disadvantages to quant research design

Validity (integrity of the design) Internal: ability to deliver credible evidence to address the research question External: can we generalise the research? Reliability – whether the results of a research study are repeatable and thereby whether the measures devised within the study are consistent. Replication – is the study capable of being repeated? In addition implications for reliability – would the same results be generated again and so show a measure of consistency? Key Criteria Terminology

Bryman, A. (2008) Social Research Methods. 3 rd Ed. Oxford: Oxford University Press. David, M. and Sutton, C. (2004) Social Research :The Basics. London: Sage. ESRC Survey Measurement Programme. Online: available from Survey Resource Network Oppenheim, A. (2000) Questionnaire Design, Interviewing and Attitude Measurement. London: Continuum References

This resource was created by the University of Plymouth, Learning from WOeRk project. This project is funded by HEFCE as part of the HEA/JISC OER release programme.Learning from WOeRk This resource is licensed under the terms of the Attribution-Non-Commercial-Share Alike 2.0 UK: England & Wales license ( The resource, where specified below, contains other 3 rd party materials under their own licenses. The licenses and attributions are outlined below: 1.The name of the University of Plymouth and its logos are unregistered trade marks of the University. The University reserves all rights to these items beyond their inclusion in these CC resources. 2.The JISC logo, the and the logo of the Higher Education Academy are licensed under the terms of the Creative Commons Attribution -non-commercial-No Derivative Works 2.0 UK England & Wales license. All reproductions must comply with the terms of that license. Author Laura Lake InstituteUniversity of Plymouth Title Numeracy & Quantitative Methods Research Design in Quantitative Approaches to Research Description Overview of research design options within quantitative research. Date Created March 2011 Educational Level Level 5 Keywords UKOER LFWOERK UOPCPDRM Learning from Woerk WBL Work Based Learning CPD Continuous Professional Development Deductive, reductionist, objective, experimental, quasi-experimental, cross- sectional, longitudinal, case study. Creative Commons License Attribution-Non-Commercial-Share Alike 2.0 UK: England & Wales license Back page originally developed by the OER phase 1 C-Change project ©University of Plymouth, 2010, some rights reserved