Research Tools and Techniques The Research Process: Step 6 (Research Design for Experiments Part C) Lecture 24

Lecture Topics Covered Previously in the Last Lecture Factors Effecting the Internal Validity of Experiments

What we are going to Cover in this Lecture Types of Experimental Designs Simulations Managerial Consideration for Selecting an Experimental Design

THE RESEARCH PROCESS (1). Observation The Broad Problem Area (2). Preliminary Data Gathering Interviews and Library Search (3). Problem Definition (4). Theoretical Framework Variables Identification (5) Generation of Hypothesis (6). Scientific Research Design (7). Data Collection and Analysis (8) Deduction (9). Report Writing (10). Report Presentation (11). Managerial Decision Making

THE ELEMENTS OF RESEARCH DESIGN 2. Type of Investigation Establishing: Causal Relationship or Co-relational 1. Purpose of Study Exploratory Descriptive Hypothesis Testing Case Study 3. Extent of Researcher Interference Minimal Moderate Excessive 4. Study Setting Contrived Non-Contrived 10. Test Application Feel for Data Goodness of Data Hypotheses Testing 6.Unit of Analysis (Population to be studied) Individuals Dyads Groups Organizations Machines etc. 7. Sampling Design Probability Non-probability Sample Size (n) 8. Time Horizon One-Shot (Cross-Sectional) or Longitudinal 9. Data Collection Methods Observation Interviews Questionnaire Physical Measurement 5. Measurement & Measures Operational Definition Scaling Categorizing Coding Problem Statement

Types of Experimental Designs I. Quasi-Experimental Designs: 1. Pretest And Posttest Experimental Group Design 2. Posttests Only With Experimental And Control Groups II. True Experimental Designs: 1. Pretest And Posttest Experimental And Control Groups Designs 2. Solomon Four-group Design 3. Double Blind Studies 4. Ex-Post Facto Designs

I. QUASI-EXPERIMENTAL DESIGNS: Some studies expose an experimental group to a treatment and measure its effects. Such an experimental design is weakest of all designs, and it does not measure the true cause and effect relationship. This is because there is no comparison between groups or any recording of the status of the dependent variable as it was prior to the experimental treatment and how it changed after the treatment. In the absence of such control, the study is of little scientific value in determining the cause and effect relationship. Hence such a design is referred to as a quasi-experimental design.

1. PRETEST AND POSTTEST EXPERIMENTAL GROUP DESIGN: An experiment group (without a control group) may be given a pretest, expose to a treatment, and then given a posttest to measure the effects of the treatment. Pretest And Posttest Experimental Group Design Treatment effect = (O 2- O 1 ) = = 69 GroupPretestTreatment Posttest Experimental Group O 1 X O 2

2. POSTTESTS ONLY WITH EXPERIMENTAL AND CONTROL GROUPS: Some experimental designs are set up with an experimental and control group, the former alone being exposed to a treatment and not the later. The effects of the treatment are studied by assessing the difference in the outcomes - that is, the posttest scores of the experimental and control groups. GroupTreatment Outcome Experimental Group X O 1 Control Group O 2 Treatment effect = ( O 1 - O 2 ) = = 73

II. TRUE EXPERIMENTAL DESIGNS Experimental designs, which include both the treatment and control groups and record information both before and after the experimental group is exposed to the treatment, are known as true experimental designs.

1. Pretest And Posttest Experimental And Control Groups Designs: Treatment effect =[ (O 2- O 1 ) - (O 4- O 3 )] =[ (94 -11) - (17-12)] = = 78 Group Pretest Treatment Posttest Experimental Group O 1 X O 2 Control Group O 3 O 4

2. Solomon Four-Group Design: Group Pretest Treatment Posttest Experimental Group O 1 X O 2 Control Group O 3 O 4 Experimental Group X O 5 Control Group O 6 Treatment effect (E) could be judged by: 1. E = O 2- O 1 2. E = O 2- O 4 3. E = O 5- O 6 4. E = O 5- O 3 5. E =[ (O 2- O 1 ) - (O 4- O 3 )] If Es are similar, the cause and effect relationship is highly valid.

3. Double Blind Studies: ChlorometazolHead Ache Placebos i.e. sugar filled capsules are given to control group instead of real medicine and then effects of treatment are seen on both control and experimental groups.

4. Ex-Post Facto Designs: Performance is Evaluated of Employees Training is deliveredPerformance in real life is evaluated again after the passage of some time 1.FYesB 2. EYesA 3. FYesA 4. FYesB 5. EYesA 6. FNoF 7.FNoF 8. FNoF

SIMULATION  An alternative to lab and field experimentation currently being used in business research is simulation.  Simulation uses model-building technique to determine the effects of changes, and computer based simulation are becoming popular in business research.

 A simulation can be thought of as an experiment conducted in a specially created setting that resembles the natural environment in which activities are usually carried on. In that, the sense simulation lies somewhere between a lab and a field experiment, insofar as the environment is artificially created but not far different from “reality”.  Participants are exposed to real world experiences over a period of time, lasting anywhere from several hours to several weeks, and they can be randomly assigned to different treatment groups.

MANAGERIAL IMPLICATIONS DECISIONS POINTS FOR EMBARKING ON AN EXPERIMENTAL DESIGN Is tracing causal effects necessary Yes; and if No I V is more important than E V Generalizibility is more important than I V Both I V & E V are important Engage in a lab experiment Engage in a filed experiment First do a lab experiment then, a filed experiment Are there cost constaints? YesNo Engage in a simpler experimental design Engage in a more sophisticated design

Summary Types of Experimental Designs Simulations Managerial Consideration for Selecting an Experimental Design