1. Software Sustainability Institute www.software.ac.uk Software Attribution can we improve the reusability and sustainability of scientific software? http://dx.doi.org/10.6084/m9.figshare.942289 NSF SI2 PIs Meeting, 24-25 February 2014 Neil Chue Hong (@npch), Software Sustainability Institute ORCID: 0000-0002-8876-7606 | N.ChueHong@software.ac.uk Unless otherwise indicated slides licensed under Supported by Project funding from

2. Software Sustainability Institute www.software.ac.uk The Research Cycle Create Test Interpret Publish Revise Paper Data Software Research Outputs Research is a continuous cycle. When we publish we are contributing to the body of knowledge. http://dx.doi.org/10.6084/m9.figshare.942289

3. Software Sustainability Institute www.software.ac.uk Research/Reuse/Reward Cycle Index Identify Cite Reward Create Test Interpret Publish Revise Research Reuse Reuse is also a cycle. We build our research on the work of others. Reward mechanisms should encourage reuse. http://dx.doi.org/10.6084/m9.figshare.942289

4. Software Sustainability Institute www.software.ac.uk The current process Start research Write software Use software Produce results Produce results Publish research paper Release data Release data Release software Release software Which mentions software and data This process is simple but does not reward production or reuse of good software and data. It also has a long contribution cycle. http://dx.doi.org/10.6084/m9.figshare.942289

5. Software Sustainability Institute www.software.ac.uk Write software A better process? Start research Identify existing software Identify existing software Use software Produce results Produce results Publish research paper Adapt/ extend software Release data Release data Release software Release software Publish software paper Publish software paper Publish data paper Publish data paper Which references software and data papers Software and data papers are needed as proxies for rewarding reuse. But it enables a shorter contribution cycle for data and software. http://dx.doi.org/10.6084/m9.figshare.942289

6. Software Sustainability Institute www.software.ac.uk Authorship Lifecycle Identif y Cite Reuse Research Index Papers, data, software all research outputs of a continuous cycle. With software, technology makes it easier to track, but not reward. We cannot separate papers, data and software when we release research. http://openresearchsoftware.metajnl.com http://dx.doi.org/10.6084/m9.figshare.942289

7. Software Sustainability Institute www.software.ac.uk What do we choose to identify: - Workflow? - Software that runs workflow? - Software referenced by workflow? - Software dependencies? What’s the minimum citable part? Boundary

8. Software Sustainability Institute www.software.ac.uk Algorithm Function Program Library / Suite / Package … Granularity

9. Software Sustainability Institute www.software.ac.uk Versioning Personal v1 Personal v1 Personal v2 Personal v2 Personal v3 Personal v3 Personal v2a Personal v2a Public v1 Public v1 Personal v3a Personal v3a Personal v2a Personal v2a Public v2 Public v2 Public v3 Public v3 Why do we version? - To indicate a change - To allow sharing - To confer special status

10. Software Sustainability Institute www.software.ac.uk Authorship Authorship Which authors have had what impact on each version of the software? Which authors have had what impact on each version of the software? Who had the largest contribution to the scientific results in a paper? Who had the largest contribution to the scientific results in a paper?http://beyond-impact.org/?p=175 OGSA-DAI projects statistics from Ohloh

11. Software Sustainability Institute www.software.ac.uk Software Journals http://openresearchsoftware.metajnl.com http://dx.doi.org/10.6084/m9.figshare.942289

12. Software Sustainability Institute www.software.ac.uk Peer review of software? Can the aspects of peer review be decoupled?  Novelty and acceptability  Validity and quality Accurate metadata helps sustainability  But excessive metadata requirements are a barrier Essentially, for reuse and sustainability  Where is it? Who wrote it? How do I run it?  How do I find out more? Software Papers: Improving the reusability and sustainability of scientific software  http://dx.doi.org/10.6084/m9.figshare.795303 http://dx.doi.org/10.6084/m9.figshare.795303 http://dx.doi.org/10.6084/m9.figshare.942289

13. Software Sustainability Institute www.software.ac.uk Types of Metadata Name Provenance and Ownership Functionality and Constraints Content and Composition Environment and Dependencies Location See also:  Significant Properties of Software (Matthews et al)  Software Ontology (Malone et al) http://dx.doi.org/10.6084/m9.figshare.942289

14. Software Sustainability Institute www.software.ac.uk JORS software metapaper

15. Software Sustainability Institute www.software.ac.uk References Reuse Screenshots Introduction Implementation + Usage Anatomy of a software meta- paper Metadata Quality Control

16. Software Sustainability Institute www.software.ac.uk F1000Research Web Tool Other journals you can publish software in: http://bit.ly/softwarejournals

17. Software Sustainability Institute www.software.ac.uk Code as a Research Object What if you could assign DOIs to code easily? Could we make software more reusable? http://mozillascience.org/code-as-a-research-object-a-new-project/ https://github.com/mozillascience/code-research-object http://dx.doi.org/10.6084/m9.figshare.942289

18. Software Sustainability Institute www.software.ac.uk Alternative Metrics

19. Software Sustainability Institute www.software.ac.uk I can get credit for everything Automatically generated from GitHub Repository Starring as a means of recommendation Forking analogous to citing for software … but not necessarily reward http://dx.doi.org/10.6084/m9.figshare.942289

20. Software Sustainability Institute www.software.ac.uk Career Paths in UK Careers outside academic sector Non-university Research (industry, government etc.) ProfessorPermanent Research Staff Early Career Research PhD students Source: The Scientific Century, Royal Society, 2010 (revised to reflect first stage clarification from “What Do PhD’s Do?” study) UK STEM graduate career paths

21. Software Sustainability Institute www.software.ac.uk Where we are now We must describe and cite software otherwise we cannot benefit from and reward reuse and refinement  Software papers are a citation mechanism that works with existing infrastructure and norms  Direct citation of code + metadata might be better But we still need to fix the reward mechanism for non-traditional research outputs  And this is entirely in our hands as scientists http://dx.doi.org/10.6084/m9.figshare.942289

22. Software Sustainability Institute www.software.ac.uk Further Information Software Papers: Improving the reusability and sustainability of scientific software  http://dx.doi.org/10.6084/m9.figshare.795303 http://dx.doi.org/10.6084/m9.figshare.795303 Journals in which you can publish software:  http://bit.ly/softwarejournals http://bit.ly/softwarejournals Journal of Open Research Software  http://openresearchsoftware.metajnl.com/ http://openresearchsoftware.metajnl.com/ Discussion: what is the minimum metadata required to describe a code object for scientific reuse?  https://github.com/mozillascience/code-research-object/issues https://github.com/mozillascience/code-research-object/issues Contribute: Code as a research object:  https://github.com/mozillascience/code-research-object https://github.com/mozillascience/code-research-object The DOI for this presentation: 10.6084/m9.figshare.942289 The Software Sustainabilty Institute is a collaboration between universities of Edinburgh, Manchester, Oxford and Southampton. Supported by EPSRC Grant EP/H043160/1.