Scientific Software Ecosystems James Howison and Jim Herbsleb Carnegie Mellon University School of Computer Science Research supported by the NSF Office.

Slides:

Advertisements

Similar presentations

Joint CASC/CCI Workshop Report Strategic and Tactical Recommendations EDUCAUSE Campus Cyberinfrastructure Working Group Coalition for Academic Scientific.

Advertisements

OSG Area Coordinator’s Report: Communications March 18 th, 2009 David J. Ritchie.

Broader Impacts: Meaningful Links between Research and Societal Benefits October 23, 2014 Martin Storksdieck I Center for Research on Lifelong STEM Learning.

Introducing the Administrative Data Research Network Tanvi Desai.

Breakout Summary Group Xiaodong Many, many people…

1 CCLI Proposal Writing Strategies Tim Fossum Program Director Division of Undergraduate Education National Science Foundation Vermont.

So what’s the problem? Dashboards are the #1 reason why companies buy CRM solutions such as salesforce.com But often the dashboards don’t get set up in.

April 2009 OSG Grid School - RDU 1 Open Science Grid John McGee – Renaissance Computing Institute University of North Carolina, Chapel.

Bringing XBRL tax filing to the UK Jeff Smith, Customer Contact, Online Services,

SoundSoftware.ac.uk: Software sustainability for the audio and music researcher Chris Cannam, Mark Plumbley, Luís Figueira Centre for Digital Music Queen.

Sociotechnical production systems for software in science James Howison and Jim Herbsleb Institute for Software Research School of Computer Science Carnegie.

Coordination Strategy and Project Management NCAR working group model seems to work well –One WG for each major component of model –Software engineering.

Major Non-Consensus Program and its review process design Wang Yue; Li xiaoxuan Institute of Policy and Management, Chinese Academy of Sciences Zheng yonghe.

The importance of DART for funding agencies Dr. Ingrid Kissling-Näf.

1 European policies for e- Infrastructures Belarus-Poland NREN cross-border link inauguration event Minsk, 9 November 2010 Jean-Luc Dorel European Commission.

Quality Assurance in English Higher Education Cross Border Issues and Transferability Bev Thomas Deputy Director for HE Access and Quality Department for.

Reflections on the Independent Strategic Review of the Performance-Based Research Fund by Jonathan Adams Presentation to Forum on “ Measuring Research.

Hackathons for Scientific Software How and When do they Work? Erik H. Trainer, Chalalai Chaihirunkarn, Arun Kalyanasundaram, James D. Herbsleb.

Directorate for Social, Behavioral, and Economic Sciences Amber L. Story Deputy Division Director Directorate for Social, Behavioral, and Economic Sciences.

The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Objectives.

Russ Hobby Program Manager Internet2 Cyberinfrastructure Architect UC Davis.

Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.

Providing Access to Your Data: Rights Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International Earth Science.

DOE Data Management Plan Requirements

2005 GRIDS Community Workshop1 Learning From Cyberinfrastructure Initiatives Grid Research Integration Development & Support

Mike Hildreth DASPOS Update Mike Hildreth representing the DASPOS project 1.

Software Infrastructure for Sustained Innovation (SI 2 ) PI meeting Arlington, VA January 17-18, 2013 Ewa Deelman, University of Southern California Miron.

Open Science Grid in the U.S. Vicky White, Fermilab U.S. GDB Representative.

Summary of HEP SW workshop Ian Bird MB 15 th April 2014.

Summary of OSG Activities by LIGO and LSC LIGO NSF Review November 9-11, 2005 Kent Blackburn LIGO Laboratory California Institute of Technology LIGO DCC:

EMI is partially funded by the European Commission under Grant Agreement RI EMI Sustainability Alberto Di Meglio, CERN DCI Projects Meeting Amsterdam,

Networks ∙ Services ∙ People TNC 2016, Prague Alice Through the Looking Glass Science DMZ goes above the network 13 June

School on Grid & Cloud Computing International Collaboration for Data Preservation and Long Term Analysis in High Energy Physics.

Beyond the Repository: Research Systems, REF & New Opportunities William J Nixon Digital Library Development Manager.

Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.

How can information systems help us?

Sustaining the software capabilities long term Address Solutions as part of software. Act on “Hard challenges are not technical” bringing in the right.

ICPSR Data Fair November 8, 2010 Katherine McNeill, MIT Libraries

National Science Foundation Opportunities

Washington THE NATIONAL SCIENCE FOUNDATION (NSF) is the only federal agency whose mission includes support for all fields of fundamental science and engineering.

Sustainability of EMI Results

Grant Writing: Seeing the Big Picture

7 things to boost productivity of your small business team.

RDA US Science workshop Arlington VA, Aug 2014 Cees de Laat with many slides from Ed Seidel/Rob Pennington.

Coalition for National Science Funding (CNSF) 

Paolo Budroni, University of Vienna

Jarek Nabrzyski Director, Center for Research Computing

Reproducibility of Research

Equality and Diversity in Research

1.3 Organisational Objectives social auditing

The Shifting Landscape of CI Funding

WELCOME TO AP COMPUTER SCIENCE PRINCIPLES!

Tackling corruption in the oil and gas sector in Nigeria

A Canadian government agency responsible for administering social services and disability support programs implements IBM Cúram to create a more fair,

Marlon Pierce Indiana University February 14, 2012

$$ Money $$ (for research) Bob McMurray

Python Classes in Pune |

Impact Panel SI^2 PIs Meeting.

What, why and best practices in open research

Developing a robust employer engagement strategy

- Student & School Success - K-12 English Language Arts

Developing a robust employer engagement strategy

Mats Rynge USC Information Sciences Institute

e-Infrastructure in Europe: Attributes and Metaphors for Diffusion

Marvin Goldberg MPS-EPP

Collective Impact1 1Kania, J. & Kramer, M. (2011). Collective impact.

The 8-D System Awareness of Problem Identify

What will engineering design practice be like in 2040

Presentation transcript:

Scientific Software Ecosystems James Howison and Jim Herbsleb Carnegie Mellon University School of Computer Science Research supported by the NSF Office of Cyberinfrastructure through the Virtual Organizations as Sociotechnical Systems program NSF Grant #

Our project A socio-technical investigation of the scientific software ecosystem Independently supported by the NSF OCI Three year project begun in November 2009 Open Science Grid and its VOs providing a scientific context

Our work on Open Source ecosystems Thinking above the project level Ecosystem metaphors Evolution through variation, selection and retention Niches, Food-chains/feeding hierarchies Not unplanned: e.g., The Apache Software Incubator Primary findings in open source: Diverse sources of resources/motivations Components/tasks typically undertaken by individual companies or individuals Governance structures are lightweight

CMU/OSG VOSS Workshop Funded by our NSF grant, held at CalTech February 16/17 (thanks to Kent Blackburn and LIGO) VOParticipants SBGridIan Stokes Rees STARJerome Lauret EngageJohn McGee and Mats Rynge OSGRuth Pordes, Jim Weichel and Miron Livny IceCubeGreg Sullivan and Erik Blaufiss LIGOKent Blackburn and Chad Hanna CMSLiz Sexton-Kennedy ATLASRob Gardner UK eScienceDavid De Roure EGEECharles Loomis conway2.isri.cmu.edu/scisoft-ecosystem-workshop/

Outcomes 1.Software reuse Why don’t we do more? Reuse isn’t free 2.Sustaining quality software over long horizons 3.Innovation vs Stability 4.Software and reproducibility 5.Concerns about funding agency policies

Why not always reusing Ease and comfort with “blank page” implementation More fun than “My requirements aren’t so complex” Not at the start but eventually; need simple routes into complex stacks More reputation rewards for project initiators than later contributors

Time Frame mismatches Sustaining high-quality software over long time frames Publishing papers Software work as early career “dues paying” – need long-term career path Project-based funding Chunky funding; how to ensure projects properly “spin off”

Innovation vs. Stability Clear understanding: Two types of software work: experimentation and production Migration as an important time for review How to communicate this to funding agencies and domain science leaders?

Reproducibility Reframing software as part of scientific method Understanding variation from software in same way as radiation in experiments Understanding that including code binds one its source (firm, community) Virtualization as potential But is this just a “once-removed” recursive issue?

Future plans Intensive study of a small number of scientific workflows Working back from published paper Identify components, who wrote it, how funded? Work to understand extent of software work in science Do funding agencies realize how crucial software is? How much they spend? Explore automated methods for assessing impact of individual scientific software components. Potentially introduce OSG people to Open Source foundation people (e.g., Apache, Eclipse) perhaps Workshop?