The 500 builds of 300 applications in the HeLmod repository will at least get you started on a full suite of scientific applications Aaron Kitzmiller,

Slides:



Advertisements
Similar presentations
NCeSS e-Stat quantitative node Prof. William Browne & Prof. Jon Rasbash University of Bristol.
Advertisements

Chapter 3.2 C++, Java, and Scripting Languages. 2 C++ C used to be the most popular language for games Today, C++ is the language of choice for game development.
Systems Analysis and Design in a Changing World, 6th Edition
The Basic Tools Presented by: Robert E., & Jonathan Chase.
Packaging of EPICS-basedControl System Software
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
ISCE telecon Mar 19, 2015 ISCE developer team. Agenda ISCE download website Currently supported sensors Minimum requirements Recommended setup (OS X and.
Computer Concepts 7th Edition Parsons/Oja Chapter 3 Computer Software Section A: Software Basics.
CCA Port, Component & Application Build Skeleton Templates “A new script toolkit for generating CCA build skeletons” Torsten Wilde and James Kohl Oak Ridge.
Unified Modeling Language, Version 2.0
NA-MIC National Alliance for Medical Image Computing Slicer Building and Deployment Steve Pieper, PhD.
Michael Still Google Inc. October, Managing Unix servers the slack way Tools and techniques for managing large numbers of Unix machines Michael.
Slide 1 Systems Analysis and Design With UML 2.0 An Object-Oriented Approach, Second Edition Chapter 2: Introduction to Object-Oriented Systems Analysis.
Guide to Linux Installation and Administration, 2e1 Chapter 11 Using Advanced Administration Techniques.
National Center for Supercomputing ApplicationsNational Computational Science Grid Packaging Technology Technical Talk University of Wisconsin Condor/GPT.
In the Labs… X-Bot 2003 by Overtech Technologies.
Computer Software Types Three layers of software Operation.
GLite build and integration system Building and Packaging Robert HARAKALY
Slide 1 Systems Analysis and Design With UML 2.0 An Object-Oriented Approach, Second Edition Chapter 2: Introduction to Object-Oriented Systems Analysis.
 Programming - the process of creating computer programs.
1 Unified Modeling Language, Version 2.0 Chapter 2.
Data Organization Quality Assurance and Transformations.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
Fabian Lema Wk6 Remote Monitoring of Android Devices Using Inca Framework University Of Queensland, Australia August 7, 2013.
Automating software releases brian d foy August 24, 2004 Dallas/Ft. Worth Perl Mongers sponsored by Metallect.
Irakli Garibashvili Director, National Scientific Library in Georgia.
GLite build and integration system Building and Packaging Robert HARAKALY
Data Management: Data Processing Types of Data Processing at USGS There are several ways to classify Data Processing activities at USGS, and here are some.
NREL is a national laboratory of the U.S. Department of Energy, Office of Energy Efficiency and Renewable Energy, operated by the Alliance for Sustainable.
MAY 18, 2016 BARRY SMITH MATHEMATICS AND COMPUTER SCIENCE DIVISION ARGONNE NATIONAL LABORATORY WEBINAR SERIES: COLLABORATION AMONG THE IDEAS SCIENTIFIC.
WELCOME TO THE ARE YOU IN? HI-TECH REVOLUTION ARE YOU IN?
Slide 1 Unified Modeling Language, Version 2.0 Object-Oriented SAD.
1 Creative Innovation – Customer Satisfaction – Continual Quality Improvement Accessing and Building Asterisk SCF.
Getting Started in RPM Packaging Izhar Firdaus / KageSenshi Contributor Fedora Project
Perl in RPM-Land Dave Cross Magnum Solutions Ltd YAPC::Europe 15 th August 2008.
A gentle introduction to Autotools The good, the bad and the ugly Kees-Jan Dijkzeul October 28 th, 2010.
Karsten Wade Sr. Developer Community Mgr, Red Hat.
How to Get Started With Python
New Tools Used by the Scientific Linux Team
Chapter Goals Describe the application development process and the role of methodologies, models, and tools Compare and contrast programming language generations.
Build and Test system for FairRoot
What is F/LOSS? By Scot Henderson.
Development Environment
CMIT100 Chapter 14 - Programming.
Licenses and Interpreted Languages for DHTC Thursday morning, 10:45 am
How to open source your Puppet configuration
Improving quality and reproducibility of code
CSE 374 Programming Concepts & Tools
CompTIA Server+ Certification (Exam SK0-004)
Systems Analysis and Design With UML 2
Objectives Identify the built-in data types in C++
Systems Analysis and Design With UML 2
A451 Theory – 7 Programming 7A, B - Algorithms.
The Linux Operating System
Revision Control, Automated Testing and Docker RSE Conference 2017
Maintaining software solutions
INSTALL PROVIDER PROJECT REVIEW – I JAN 2004 S.RAMESH R.SENTHIL NATHAN
June 2011 David Front Weizmann Institute
Oficesetup.com  Technical expert studying and writing helpful articles on antivirus and other security products.
An Introduction to Device Drivers
Cmake Primer.
Microsoftofficesupport.org  Technical expert studying and writing helpful articles on antivirus and other security products.
Programming.
An introduction to the Linux environment v
UNIX/Linux Development Environment
Extending Languages.
Perl in RPM-Land Dave Cross Magnum Solutions Ltd YAPC::Europe
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Black All good PowerPoint starts with black..
Microsoft 365 Business Technical Fundamentals Series
Presentation transcript:

The 500 builds of 300 applications in the HeLmod repository will at least get you started on a full suite of scientific applications Aaron Kitzmiller, John Brunelle, Michele Clamp, James Cuff Informatics and Scientific Applications, Research Computing Faculty of Arts and Sciences Harvard University 18 May 2018 FAS | Research | Computing

Scientific software publication is easier than ever… Distribution via PyPi, CPAN, github, DataVerse, Figshare. Journals will publish scientific software (http://www.software.ac.uk/resources/guides/which-journals-should-i-publish-my-software) Articles like this (“Publish your computer code: it is good enough”) encourage software publication No generally agreed up standards 18 May 2018 FAS | Research | Computing

…resulting in a dizzying array of delivery mechanisms Linux distro package managers (yum, apt-get) Autotools, Cmake Hand-edited Makefiles Things that look like autoconf, but aren’t Poorly constructed binaries Language interpreter-specific tools (Python/pip, R/install.packages, Perl cpan) that work pretty well except when they don’t Completely custom scripts that prompt for information Homebrew, Linuxbrew Custom dependency managers Whatever boost uses 18 May 2018 FAS | Research | Computing

FAS | Research | Computing … and a huge software maintenance burden that a standard module-based system cannot effectively address 18 May 2018 FAS | Research | Computing

FAS | Research | Computing Harvard Extensions for Lmod HeLmod uses rpmbuild, spec files and scripts to construct reproducible, shareable Lmod deployments https://github.com/fasrc/helmod Lmod (https://github.com/TACC/Lmod) forces you to choose a compiler (and MPI) version before loading modules Different versions of the same module cannot be loaded together Bash scripts and RPM macros support build iterations over multiple compiler (and MPI) combinations RPM Spec files explicitly detail the successful build procedure. 18 May 2018 FAS | Research | Computing

FAS | Research | Computing 18 May 2018 FAS | Research | Computing

FAS | Research | Computing 18 May 2018 FAS | Research | Computing

FAS | Research | Computing 18 May 2018 FAS | Research | Computing

We went through the pain so you don’t have to 18 May 2018 FAS | Research | Computing