Reproducible Research

Slides:



Advertisements
Similar presentations
EAGE Saint Petersburg April 7-10, Outline State of the Madagascar project Madagascar philosophy.
Advertisements

Reproducibility as a Community Effort Lessons from the Madagascar Project Sergey Fomel Jackson School of Geosciences The University of Texas at Austin.
Research Ideas Chapter 2 Dusana Rybarova Psyc 290B May
Reproducible Research Sergey Fomel The University of Texas at Austin.
Let’s add some detail to our definition of science….
Experiences with Reproducible Research in Various Facets of Signal Processing Research Patrick Vandewalle Philips Research, The Netherlands November 12,
Objectives: 1) Explain the importance of scientific inquiry. 2) Explain the differences between a scientific theory and a scientific law.
Writing your own Madagascar applications Sergey Fomel University of Texas at Austin August 30, 2006 Vancouver, BC.
Reproducible Computational Experiments Using MADAGASCAR Software Package Sergey Fomel Bureau of Economic Geology University of Texas at Austin Applied.
Make the World a Better Place through Reproducible Research Roger D. Peng Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Wall.
Madagascar Software Package Technology for Reproducible Computational Experiments Sergey Fomel Bureau of Economic Geology Jackson School of Geosciences.
How to Contribute to Madagascar and Why Sergey Fomel July 22, 2011 Beijing, China.
 Programming - the process of creating computer programs.
SET ACCESS TO OPEN - MENDELEY Jose Luis Andrade – President, The Americas Sujay Darji – Regional Sales Manager October 22, 2012.
Slide 1 of 25 Chemistry 1.3. © Copyright Pearson Prentice Hall Slide 2 of 25 Thinking Like a Scientist > Alchemy Alchemists developed the tools and techniques.
Sara Bowman Center for Open Science | Promoting, Supporting, and Incentivizing Openness in Scientific Research.
Introduction to Science: The Scientific Method Courtesy of: Omega Science.
May 2016 © 2016 IEEE Importance and Challenges of Reproducible Research Vladimir Kanchev
Sara Bowman Center for Open Science | Promoting, Supporting, and Incentivizing Openness in Scientific Research.
Table of Contents 2.4 How Does Scientific Knowledge Developed? Why Do Scientist use Models? What is a system? How are Models of Systems Used? Models as.
and Statistics, 2016, Vol. 4, No. 1, 1-8. doi: /ajams-4-1-1
Unit 1 Lesson 2 Scientific Investigations Copyright © Houghton Mifflin Harcourt Publishing Company.
Set the Default to Reproducible
Christine L. Borgman, Distinguished Professor and Presidential Chair in Information Studies at UCLA, is the author of more than 250 publications in.
Methods of Science Chapter 1 Section 3.
Section 1.
Chapter 1 The Science of Biology.
The Ethical Use of Electronic Media.
Honors Do Now: (10 mins. Max)
Achieving Open Science
Transparency increases the credibility and relevance of research
Chapter 1 Introduction to Chemistry 1.3 Thinking Like a Scientist
Section 2: Science as a Process
The Scientific Method Chapter 2, section 2-1 p.29-31
The Scientific Method What is it? Mrs. Martins.
PBPK & Systems Pharmacology
Chemistry 1.3.
Environmental Science Chapter 2 Tools of Environmental Science
Chapter 1 Scientific Method *.
Unit 1 Lesson 2 Scientific Investigations
Unit 1 Lesson 2 Scientific Investigations
What is Physical Science?
Environmental Science
Lesson Overview 1.2 Science in Context.
How an RSE can benefit your projects:
Chapter 1.2 –Science in Context
1.2 Science in Context----Outline
Unit 1 Lesson 2 Scientific Investigations
Communication in Science
Chemistry 1.3.
Environmental Science
Strengthening Reproducibility in Network Science
Scientific Inquiry Ch1: Lesson 3
Methods of Science Chapter 1 Section 3.
The Ethical Use of Electronic Media.
Introduction to Science
Science.
CH. 1.6 Scientific Inquiry Ms. De Los Rios 7th G.
Reproducible Research
THE SCIENTIFIC METHOD/APPROACH
Communication in Science
Tools of Environmental Science
EQ: What is the goal of science?
The Nature of Science.
Ch. 1 The Nature of Science
Chapter 1 Introduction to Chemistry 1.3 Thinking Like a Scientist
The Scientific Method What is it? Mrs. Martins.
VISUAL COMMUNICATION USING ADOBE PHOTOSHOP CREATIVE SUITE 5
Research Software Group
Science in Context Read the lesson title aloud to students.
Presentation transcript:

Reproducible Research Sergey Fomel The University of Texas at Austin

Outline Personal experience Why do reproducible research? How to do reproducible research? Reproducible computational experiments

Personal Experience Jon Claerbout and RR at Stanford Madagascar open-source software CiSE special issue (Jan-Feb 2009) David Donoho et al Randall LeVeque Roger Ping and Sandrah Eckel Victoria Stodden

Jon Claerbout’s Story 1987: Sunview experience 1992: LaTeX + cake Interactive programs are slavery 1992: LaTeX + cake Rebuilding books by a single command

Reproducible Research at SEP Stanford Exploration Project Founded in 1973 2 Ph.D. students per year Reproducible research From CD-ROMs to WWW From cake to GNU make 2001 CiSE paper The principal beneficiary is the author

The Madagascar Project Multidimensional data analysis Started in 2006 Open community Open source (GPL) Three levels Building blocks in C Recipes in Python/SCons Papers in LaTeX + SCons http://ahay.org

Personal Experience Jon Claerbout and RR at Stanford Madagascar open-source software CiSE special issue (Jan-Feb 2009) David Donoho et al Randall LeVeque Roger Ping and Sandrah Eckel Victoria Stodden

CiSE Reproducible Research David Donoho, Arian Maleki, Inam Rahman, Morteza Shahram, Victoria Stodden 15 years of reproducible research in computational harmonic analysis MATLAB WaveLab: 690 citations “Striving for reproducibility imposes a discipline that leads to better work.”

CiSE Reproducible Research Randall J. LeVeque Python tools for reproducible research on hyperbolic problems Fortran + Python Clawpack: 7,000 registered users “Scientific and mathematical journals are filled with pretty pictures of computational experiments that the reader has no hope of repeating.”

CiSE Reproducible Research Roger D. Peng and Sandrah P. Eckel Distributed reproducible research using cached computations R language Cacher package “We propose that a modular research approach lends itself more naturally to reproducible results.”

CiSE Reproducible Research Victoria Stodden The legal framework for reproducible research in the sciences Licensing and copyright ORL (Open Research License) “We need a license designed with the needs of computational researchers in mind.”

Why Reproducible? open exchange of data, procedures and materials. Science is the systematic enterprise of gathering knowledge about the universe and organizing and condensing that knowledge into testable laws and theories. The success and credibility of science are anchored in the willingness of scientists to independent testing and replication by other scientists. This requires the complete and open exchange of data, procedures and materials.

Open-Source Software the long-awaited maturation of “Abandoning the habit of secrecy in favor of process transparency and peer review was the crucial step by which alchemy became chemistry. In the same way, it is beginning to appear that open-source development may signal the long-awaited maturation of software development as a discipline.” Eric S. Raymond

How to Do Reproducible Computational Experiments? Code attached to published results Continuous maintenance Previous results used for testing Test-driven development Lessons from open-source Intellectual property Community http://ahay.org