1. Scientific Research Science is an objective, logical, and systematic method of analyzing and explaining phenomena, devised to permit the accumulation of reliable knowledge. The product of science is knowledge

2. Scientific Research Premises of science are – empiricism – objectivity – falsifiability – Control What this means: – rationality and skepticism are how we learn about the universe and shape new principles – If the arguments and experiments are sound, if the theory can withstand skeptical scrutiny, if the work was undertaken within the framework of past research and provides a basis for further discovery, then it is science

3. But, why is this hard? Intrinsic — Our knowledge is imperfect in ways that makes it difficult to correct Personal — Individual scientists have biases and flaws in their approach Community — The way we organize ourselves can limit progress

4. Intrinsic

8. Facts are deceptively simple in retrospect

10. Personal

11. Why do we need help doing this? Isn't science just "advanced common sense"? – Yes, but it is advanced common sense Both lay observers and experts tend to... – See patterns in random data – Generalize from incomplete samples – See confirmation for favored ideas in ambiguous data We tend to believe... – What we already think we know – What we hear second ‐ hand – What our community believes

12. Personal failings (two S’s, four P’s, three F’s)

15. Good research methods help …

16. Community

17. Community failings Science is a human community Like any other community, we have... – Fads and fashions – Structures and traditions that interfere with progress because they don’t change with changing needs – Disagreements over goals and direction that consume time and resources – Outsize personalities that seek personal success in ways that conflict with the goals of the community Science progresses in spite of these problems and seeks to minimize their impact

18. And, let’s remember why we do it … Richard Feynman on “Beauty”