Foundations for Evaluating Clinical Literature. Outline Definitions Study Design Sampling Bias Reliability and validity.

Slides:



Advertisements
Similar presentations
Introduction to Psychology
Advertisements

Study Designs in Epidemiologic
1 Case-Control Study Design Two groups are selected, one of people with the disease (cases), and the other of people with the same general characteristics.
CRITICAL APPRAISAL Dr. Cristina Ana Stoian Resident Journal Club
Biostatistics ~ Types of Studies. Research classifications Observational vs. Experimental Observational – researcher collects info on attributes or measurements.
Model and Variable Selections for Personalized Medicine Lu Tian (Northwestern University) Hajime Uno (Kitasato University) Tianxi Cai, Els Goetghebeur,
PSYC512: Research Methods PSYC512: Research Methods Lecture 16 Brian P. Dyre University of Idaho.
PSYCO 105: Individual and Social Behaviour Lecture 1: The Ways and Means of Psychology.
Introduction to Social Psychology Copyright © 2005 by The McGraw-Hill Companies, Inc. Social Psychology by David G. Myers 8 th Edition Introduction to.
Study Design and Measures of Disease Frequency Intermediate Epidemiology.
Chapter 2 Research Process Part 1: Aug 29, Research Methods Importance of scientific method Research Process – develop ideas, refine ideas, test.
Research Methods in Psychology Pertemuan 3 s.d 4 Matakuliah: L0014/Psikologi Umum Tahun: 2007.
Epi Team Challenge Detectives in the Classroom - Investigation 2-7: Epi Team Challenge Epi Team Challenge.
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
How do cancer rates in your area compare to those in other areas?
Principles of Research Writing & Design Educational Series Fundamentals of Study Design Lauren Duke, MA Program Coordinator Meharry-Vanderbilt Alliance.
That’s Not True!!!! Research Methods in Psychology.
© 2011 The McGraw-Hill Companies, Inc. Chapter 2 Psychology’s Scientific Method.
Basic Concepts of Research Basis of scientific method Making observations in systematic way Follow strict rules of evidence Critical thinking about evidence.
Chapter 5 Research Methods in the Study of Abnormal Behavior Ch 5.
Research in Psychology. Research Basics  All psychological research MUST follow the scientific method  Improves accuracy and validity of findings 
Chapter 2: The Research Enterprise in Psychology
BASIC STATISTICS: AN OXYMORON? (With a little EPI thrown in…) URVASHI VAID MD, MS AUG 2012.
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Psychology as a Science
Epidemiologic Study Designs Nancy D. Barker, MS. Epidemiologic Study Design The plan of an empirical investigation to assess an E – D relationship. Exposure.
OKU 9 Chapter 15: ORTHOPAEDIC RESEARCH Brian E. Walczak.
Variation, Validity, & Variables Lesson 3. Research Methods & Statistics n Integral relationship l Must consider both during planning n Research Methods.
Research Design for Quantitative Studies
Research Methods Key Points What is empirical research? What is the scientific method? How do psychologists conduct research? What are some important.
Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.
© 2007 The McGraw-Hill Companies, Inc. All Rights Reserved Slide 1 Research Methods In Psychology 2.
Chapter 1: The Research Enterprise in Psychology.
Study design P.Olliaro Nov04. Study designs: observational vs. experimental studies What happened?  Case-control study What’s happening?  Cross-sectional.
Lecture 6 Objective 16. Describe the elements of design of observational studies: (current) cohort studies (longitudinal studies). Discuss the advantages.
Basic Ideas and Terminology Ettore Beghi Institute for Pharmacological Research Mario Negri, Milano, Italy.
Study Designs in Epidemiologic
© 2011 The McGraw-Hill Companies, Inc. with snazzy editions by Mrs. Short Chapter 2 Psychology’s Scientific Method.
Copyright © 2010 Allyn & Bacon This multimedia product and its contents are protected under copyright law. The following are prohibited by law: any public.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
The Scientific Method in Psychology.  Descriptive Studies: naturalistic observations; case studies. Individuals observed in their environment.  Correlational.
Chapter 9 Causal Research Designs and Test Markets
METHOD in Personality Research. How do we gather data? 1. From whom??? 1. From whom??? A. Self A. Self B. Others B. Others Plus/Minus? Plus/Minus?
Wade/Tavris, (c) 2006, Prentice Hall How Psychologists Do Research Chapter 2.
EXPERIMENTAL EPIDEMIOLOGY
Review of Research Methods. Overview of the Research Process I. Develop a research question II. Develop a hypothesis III. Choose a research design IV.
Research Methods in Health Psychology Chapter 2. Science Science is not a thing in and of itself. It is a set of methods used to understand natural phenomena.
Causal relationships, bias, and research designs Professor Anthony DiGirolamo.
Unit 2 – Public Health Epidemiology Chapter 4 – Epidemiology: The Basic Science of Public Health.
Research Methods It is actually way more exciting than it sounds!!!!
Research Methods It is actually way more exciting than it sounds!!!!
Research Strategies. Why is Research Important? Answer in complete sentences in your bell work spiral. Discuss the consequences of good or poor research.
What is randomization and how does it solve the causality problem? 2.3.
 Variables – Create an operational definition of the things you will measure in your research (How will you observe and measure your variables?) 
Organization of statistical research. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and.
Introduction to Psychology Critical Thinking, Research & Ethics.
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
Exploring Social Psychology by David G. Myers 7th Edition
Types of Studies. Aim of epidemiological studies To determine distribution of disease To examine determinants of a disease To judge whether a given exposure.
From observation we can make generalizations about human nature
1 Research Methods in Child Psychopathology Carolyn R. Fallahi, Ph. D.
DESCRIPTIVE METHODS Methods that yield descriptions of behavior but not necessarily causal explanations.
4.1 Statistics Notes Should We Experiment or Should We Merely Observe?
Measures of disease frequency Simon Thornley. Measures of Effect and Disease Frequency Aims – To define and describe the uses of common epidemiological.
Chapter 2 Research Methods.
PLANNING RESEARCH.
1.2 Research Methods AP Psychology.
Introduction to Hypothesis Test – Part 2
Research Methods & Statistics
Sociological Investigation
Presentation transcript:

Foundations for Evaluating Clinical Literature

Outline Definitions Study Design Sampling Bias Reliability and validity

Research Areas Clinical Research (humans) –Diagnosis –Frequency (prevalence/incidence) –Risk factors –Prognosis –Treatment –Prevention Laboratory Research (basic) –Typically animal models –Human and animal cell cultures and biologic samples –Genetic material Translational Research –New area (relatively)

Classification of Studies Descriptive -Populations -Prevalence/incidence -Distribution (disease, risks, demographics, etc.) Observational -Individuals -Test cause-effect hypotheses -Uncontrolled assignment to study groups (naturalistic) Experimental -Individuals -Test cause-effect hypotheses -Controlled assignment to study groups Survey Case-controlCohortClinical trial

Causes and Effects X Independent variable “cause” Examples? Y Dependent variable “effect” Examples? Probabilistic causality

Study Design Laboratory experiment –Causality: chemical X --> cancer –Method: 100 mice randomized to exposed and unexposed groups (e.g. 50 each) –Follow up for some time –Measure cancer incidence rate in the two groups –Proof of causation

Study Design Experimental –Randomization --> independent variable (drug X) --> Dependent variable (outcome/endpoint Y) Analytic/observational –Independent Variable (risk factor) --> Dependent Variable (outcome)

Sampling Target Sample Intended Sample Actual Sample Study hypothesis testing Inference/generalization Potential bias (e.g. non-responder)

Measurement Two types of issues to expect: –Random (instrument sensitivity) –Systematic (instrument bias)

Reliability vs. Variability Observer Instrument Subject

Observer Reliability PositiveNegative Positiveab Negativecd Observer 2 (or 1 but diff time) Observer 1 Percent agreement = (a+d)/N Kappa = (Observed % agr - Expected % agr) / (100%-Expected % agreement)

Validity/Accuracy PresentAbsent Positivea (TP)b (FP) Negativec (FN)d (TN) Outcome condition (disease) Test Sensitivity = TP/(TP+FN) Specificity = TN/(FP+TN) PPV = TP/(TP+FP) NPV = TN/(TN+FN)

Summary Things to keep an eye out for when designing or evaluating studies: –Hypothesis –Sample (size and sampling strategy) –Bias (sampling or measurement) –Instruments (reliability and validity)