RESULTS Methodological characteristics

Slides:



Advertisements
Similar presentations
CAUSAL-COMPARATIVE RESEARCH LIYANA BT AHMAD AFIP
Advertisements

Experimental Design I. Definition of Experimental Design
The World Bank Human Development Network Spanish Impact Evaluation Fund.
Research Synthesis (Meta-Analysis) Research Synthesis (Meta-Analysis) CHAPTER 1 CHAPTER 10.
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 11 Experimental and Quasi-experimental.
L1 Chapter 11 Experimental and Quasi- experimental Designs Dr. Bill Bauer.
September 26, 2012 DATA EVALUATION AND ANALYSIS IN SYSTEMATIC REVIEW.
Chapter 1: Introduction to Statistics
Research Process Research Process Step One – Conceptualize Objectives Step One – Conceptualize Objectives Step Two – Measure Objectives Step Two – Measure.
Selecting a Research Design. Research Design Refers to the outline, plan, or strategy specifying the procedure to be used in answering research questions.
Methods Overview.  Description: What happens?  Prediction: When does it happen?  Explanation: Why does it happen? ◦ Theory ◦ Causal Inferences  Intervention/Application:
CHAPTER 6, INDEXES, SCALES, AND TYPOLOGIES
Scientific Method for a controlled experiment. Observation Previous data Previous results Previous conclusions.
What is Computer Science?  Three paradigms (CACM 1/89) Theory (math): definitions, theorems, proofs, interpretations Abstraction (science): hypothesize,
Psychology 3051 Psychology 305A: Theories of Personality Lecture 1 1.
Copyright  2003 by Dr. Gallimore, Wright State University Department of Biomedical, Industrial Engineering & Human Factors Engineering Human Factors Research.
HIVQUAL Group Learning Guide – New York State DOH AIDS Institute 1 Constructing a Sample Learning Objectives  To understand the purpose of sampling during.
Evaluating Impacts of MSP Grants Ellen Bobronnikov Hilary Rhodes January 11, 2010 Common Issues and Recommendations.
The Practice of Social Research Chapter 6 – Indexes, Scales, and Typologies.
Chapter 8 – Lecture 6. Hypothesis Question Initial Idea (0ften Vague) Initial ObservationsSearch Existing Lit. Statement of the problem Operational definition.
SOCW 671: #6 Research Designs Review for 1 st Quiz.
Chapter 14 Research Synthesis (Meta-Analysis). Chapter Outline Using meta-analysis to synthesize research Tutorial example of meta-analysis.
STEP - 4 Research Design 1. The term “research design” can be defined as, The systematic study plan used to turn a research question or research questions.
Chapter 9 Scrutinizing Quantitative Research Design.
Quasi-Experiments. Quasi-Experiment Involves the comparison of pre-defined groups.
Statistics, Data, and Statistical Thinking
CHOOSING A RESEARCH DESIGN
Issues in Evaluating Educational Research
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
INTRODUCTION AND DEFINITIONS
Do Adoptees Have Lower Self Esteem?
Chapter 4 Research Methods in Clinical Psychology
Causation & Research Designs
CHAPTER 6, INDEXES, SCALES, AND TYPOLOGIES
Ch. 2 Tools of Positive Economics
The Research Design Continuum
The sample under analysis at the end of the scoring was made up of 99 participants as follows:
Impact of State Reporting Laws on Central Line– Associated Bloodstream Infection Rates in U.S. Adult Intensive Care Units Hangsheng Liu, Carolyn T. A.
Experimental Research Designs
Design (3): quasi-experimental and non-experimental designs
Observational Study vs. Experimental Design
Understanding Results
GATHER reporting guidelines
Randomized Trials: A Brief Overview
Research design I: Experimental design and quasi-experimental research
1 Chapter 1: Introduction to Statistics. 2 Variables A variable is a characteristic or condition that can change or take on different values. Most research.
Research methods of sociology
Chapter Eight: Quantitative Methods
Making Causal Inferences and Ruling out Rival Explanations
Introduction to Design
Reliability, validity, and scaling
Research Methods: Concepts and Connections First Edition
Variables and Measurement (2.1)
Quantitative Research
Impact Evaluation Methods
[title of your research project]
Hypothesis Testing, Validity &
Narrative Reviews Limitations: Subjectivity inherent:
The Nonexperimental and Quasi-Experimental Strategies
RESEARCH METHODOLOGY ON ENVIRONMENTAL HEALTH PRACTICE IN WEST AFRICA
Meta-analysis April 11, 2006.
Chapter 2 – Research Methods
Impact Evaluation Methods: Difference in difference & Matching
Statistics.
Explanation of slide: Logos, to show while the audience arrive.
Experiments: Part 2.
Experimental Design I. Definition of Experimental Design
Two Halves to Statistics
Quasi experiments and small n designs
Misc Internal Validity Scenarios External Validity Construct Validity
Presentation transcript:

RESULTS Methodological characteristics ITEM VALUE CATEGORY 0. Type of study Theoretical 1 Observational 2 Survey 3 Quasi-experimental 4 Experimental 1. Control group No 0.5 Inactive Active 2. Sample selection criteria Non Specified Specified 3. Randomization Non randomized when there is not intervention/ Pre-experimental/ Quasi without variables controlled/ Experimental with an incorrect random process Randomized when there’s not intervention/Quasi with variables controlled/Experimental

RESULTS Methodological characteristics ITEM VALUE CATEGORY 4. Design 1-2 measurements when there is not intervention/ Pre-experimental/ Experimental with one pre-post moment of measurement 0.5 3-29 measurements when there’s not intervention/ Quasi-experimental with 2-29 measurements 0.75 Temporal series 1 30 or more measurements when there is not intervention/ Discontinuity on regression/ Experimental with 2 or more moments of measurement 5. Sample N<12 12≤N≤40 N>40 6. Global attrition ≥20% 0<N<20% 0%

RESULTS Methodological characteristics ITEM VALUE CATEGORY 7. Differential attrition ≥20% 0.5 0<N<20% 1 0% 8. Exclusions after sample assignment 9. Follow-up None 0.3 < 6 months 0.6 [6-11] months ≥12 months 10. Moments of measurement After intervention/ only one measurement if there is not intervention Before and after intervention/more than one measurement if there is not intervention

RESULTS Methodological characteristics ITEM VALUE CATEGORY 11. Measurements in every moments More than one measurement doesn’t appear in every measure moments 0.5 One measurement doesn’t appear in every measure moments 1 All the measurements appear in every measure moments 12. Normalized dependent variables Auto-registration non standardized At least one is a questionnaire or auto-registration standardized At least one is objective or normalized 13. Mask in evaluator No Yes 14. Mask in participants

RESULTS Methodological characteristics ITEM VALUE CATEGORY 15. Mask in professional of intervention/ internal evaluator No 1 Yes 16. Homogeneity in process: intensity, duration and professionals Different Same 17. Construct definition None is defined conceptual and empirically 0.5 At least one is defined conceptual and/or empirically All of them are defined conceptual and empirically 18. Statistic methods to infer missing data None

RESULTS Methodological characteristics ITEM VALUE CATEGORY 19. Effect size and value Non specified 1 Specified 20. Index of quality SUM From 0 to 19 21. Statistic index calculated Concrete value 22. Significant differences between measures No Yes 23. Variability index

RESULTS Substantive characteristics ITEM VALUE CATEGORY 24. Number of participants each group Concrete Value 25. Number of groups 26. Exclusions after measurements 27. Age range 28. Average age 29. Period of study 30. Intensity of the treatment or the measurements when there is not intervention 31. Unit of measurement 32. Training area 33. Intervention field

RESULTS Extrinsic characteristics ITEM VALUE CATEGORY 34. Type of publication 1 Article in journal 2 Book 3 Thesis 4 Congress 5 Other publications 6 Non-published studies THEORETICAL MODEL 35. Author 36. Variables used 37. Evaluation proposal