Jetstream: A national research and education cloud Jeremy Fischer ORCID 0000-0001-7078-6609 Senior Technical Advisor, Collaboration and.

Slides:



Advertisements
Similar presentations
April 19, 2015 CASC Meeting 7 Sep 2011 Campus Bridging Presentation.
Advertisements

Bill Barnett, Bob Flynn & Anurag Shankar Pervasive Technology Institute and University Information Technology Services, Indiana University CASC. September.
Data Gateways for Scientific Communities Birds of a Feather (BoF) Tuesday, June 10, 2008 Craig Stewart (Indiana University) Chris Jordan.
Pti.iu.edu /jetstream Award # A national science & engineering cloud funded by the National Science Foundation Award #ACI
1 Supplemental line if need be (example: Supported by the National Science Foundation) Delete if not needed. Supporting Polar Research with National Cyberinfrastructure.
NSF Vision and Strategy for Advanced Computational Infrastructure Vision: NSF Leadership in creating and deploying a comprehensive portfolio…to facilitate.
Pti.iu.edu /jetstream Award # A national science & engineering cloud funded by the National Science Foundation Award #ACI Jetstream Overview.
Pti.iu.edu /jetstream Award # A national science & engineering cloud funded by the National Science Foundation Award #ACI Prepared for the.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. Rockhopper: Penguin on Demand at Indiana.
FutureGrid: an experimental, high-performance grid testbed Craig Stewart Executive Director, Pervasive Technology Institute Indiana University
Campus Bridging: What is it and why is it important? Barbara Hallock – Senior Systems Analyst, Campus Bridging and Research Infrastructure.
Pti.iu.edu /jetstream Award # A national science & engineering cloud funded by the National Science Foundation Award #ACI
Statewide IT Conference, Bloomington IN (October 7 th, 2014) The National Center for Genome Analysis Support, IU and You! Carrie Ganote (Bioinformatics.
Win8 on Intel Programming Course The challenge Paul Guermonprez Intel Software
Next Generation Cyberinfrastructures for Next Generation Sequencing and Genome Science AAMC 2013 Information Technology in Academic Medicine Conference.
Craig Stewart 23 July 2009 Cyberinfrastructure in research, education, and workforce development.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. Using the Purdue DB Technology to build.
Goodbye from Indianapolis, IUPUI, and Craig A. Stewart Executive Director, Pervasive Technology Institute Associate Dean, Research Technologies Indiana.
Big Red II & Supporting Infrastructure Craig A. Stewart, Matthew R. Link, David Y Hancock Presented at IUPUI Faculty Council Information Technology Subcommittee.
I-Light: A Network for Collaboration between Indiana University and Purdue University Craig Stewart Associate Vice President Gary Bertoline Associate Vice.
Genomics, Transcriptomics, and Proteomics: Engaging Biologists Richard LeDuc Manager, NCGAS eScience, Chicago 10/8/2012.
The National Center for Genome Analysis Support as a Model Virtual Resource for Biologists Internet2 Network Infrastructure for the Life Sciences Focused.
Leveraging the National Cyberinfrastructure for Top Down Mass Spectrometry Richard LeDuc.
September 6, 2013 A HUBzero Extension for Automated Tagging Jim Mullen Advanced Biomedical IT Core Indiana University.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. The IQ-Table & Collection Viewer A.
RNA-Seq 2013, Boston MA, 6/20/2013 Optimizing the National Cyberinfrastructure for Lower Bioinformatic Costs: Making the Most of Resources for Publicly.
Pti.iu.edu /jetstream Award # funded by the National Science Foundation Award #ACI Jetstream - A self-provisioned, scalable science and.
July 18, 2012 Campus Bridging Security Challenges from “Panel: Security for Science Gateways and Campus Bridging”
Pti.iu.edu /jetstream Award # funded by the National Science Foundation Award #ACI Jetstream Overview – XSEDE ’15 Panel - New and emerging.
Using Prior Knowledge to Improve Scoring in High-Throughput Top-Down Proteomics Experiments Rich LeDuc Le-Shin Wu.
INDIANAUNIVERSITYINDIANAUNIVERSITY Spring 2000 Indiana University Information Technology University Information Technology Services Please cite as: Stewart,
November 18, 2015 Quarterly Meeting 30Aug2011 – 1Sep2011 Campus Bridging Presentation.
February 27, 2007 University Information Technology Services Research Computing Craig A. Stewart Associate Vice President, Research Computing Chief Operating.
Craig Stewart ORCID ID Jetstream Principal Investigator Executive Director, Indiana University Pervasive Technology Institute 30 September.
UITS Research Technologies – Services Available to Regenstrief Institute 13 Oct 2015 Craig Stewart ORCID ID Executive Director, Indiana.
A national science & engineering cloud funded by the National Science Foundation Award #ACI Craig Stewart ORCID ID Jetstream.
Craig Stewart ORCID ID Jetstream Principal Investigator Executive Director, Indiana University Pervasive Technology Institute Presented.
Pti.iu.edu /jetstream Award # A national science & engineering cloud funded by the National Science Foundation Award #ACI
Recent key achievements in research computing at IU Craig Stewart Associate Vice President, Research & Academic Computing Chief Operating Officer, Pervasive.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. Update on EAGER: Best Practices and.
Award # funded by the National Science Foundation Award #ACI Jetstream: A Distributed Cloud Infrastructure for.
Jetstream: A new national research and education cloud Jeremy Fischer ORCID Senior Technical Advisor, Collaboration.
A national science & engineering cloud funded by the National Science Foundation Award #ACI Craig Stewart ORCID ID Jetstream.
Craig Stewart ORCID ID Jetstream Principal Investigator Executive Director, Indiana University Pervasive Technology Institute Presented.
1 A national science & engineering cloud funded by the National Science Foundation Award #ACI Craig Stewart ORCID ID Jetstream.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. Informatics Tools at the Indiana CTSI.
Award # funded by the National Science Foundation Award #ACI Jetstream: INFO-590, Science Gateways Architecture.
Funded by the National Science Foundation Award #ACI Jetstream: Adding Cloud-based Computing to the National Cyberinfrastructure Matthew
Jetstream Overview Jetstream: A national research and education cloud Jeremy Fischer ORCID Senior Technical Advisor,
PAUL STACEY Except where otherwise noted these materials are licensed under a Creative Commons Attribution 3.0 (CC BY)CC BY Open Licensing Requirements.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
1 Campus Bridging: What is it and why is it important? Barbara Hallock – Senior Systems Analyst, Campus Bridging and Research Infrastructure.
Research & Academic Computing Indiana University Statewide IT Conference 11 September 2003 Indianapolis IN.
New Ventures in Research, Engineering, and Educational Computing
Digital Campus: Foundation Projects
Jetstream: A science & engineering cloud Mike Lowe
Tools and Services Workshop
Joslynn Lee – Data Science Educator
Matt Link Associate Vice President (Acting) Director, Systems
funded by the National Science Foundation Award #ACI
Dr. Craig A. Stewart Orcid ID:
Methodology Overview 2 basics in user studies Lecture /slide deck produced by Saul Greenberg, University of Calgary, Canada Notice: some material in this.
Introduction to XSEDE Resources HPC Workshop 08/21/2017
SowiDataNet - A User-Driven Repository for Data Sharing and Centralizing Research Data from the Social and Economic Sciences in Germany Monika Linne, 30.
State of XSEDE: XSEDE14 John Towns PI and Project Director, XSEDE
Chapter 2: The Linux System Part 1
Introduction to Free HPC Resources: XSEDE
Introduction to electronic resources management
Sun's Approach To Accessibility Concertation Meeting 19 May 2003
Presentation transcript:

Jetstream: A national research and education cloud Jeremy Fischer ORCID Senior Technical Advisor, Collaboration and Engagement Support UITS Research Technologies funded by the National Science Foundation Award #ACI

funded by the National Science Foundation Award #ACI What is Jetstream? First managed production cloud for science and engineering research Interactive computing and data analysis resources “on demand” Part of the NSF eXtreme Digital (XD) program

funded by the National Science Foundation Award #ACI What is Jetstream? Focus on ease-of-use, broad accessibility Reproducibility: Store, publish via IU Scholarworks (DOI) Will support persistent gateways (iPlant, Galaxy, generic “SciGAP” build-a-gateway image) The primary goal set by IU and its partners in implementing Jetstream is to create a resource that expands the users of XD program resources beyond the current community of users. VM library, custom VMs, or “private computing system”

funded by the National Science Foundation Award #ACI Not just another XD resource (Why Jetstream?) National Science Foundation (NSF) estimates that 299,000 researchers, educators, and learners received direct support during the year ending September 2013 Only 1.5% of those completed a computation, data analysis, or visualization task on XD resources Less than 3% had an account on the XSEDE portal. Jetstream will be a new, interactive cloud-based system that, through its scale and flexibility, will dramatically enhance the diversity and size of the US researcher community benefiting from XD resources.

funded by the National Science Foundation Award #ACI Who will use Jetstream? For the researcher needing a handful of cores TODAY rather than thousands next week. Software creators and researchers needing to create their own customized virtual machines and workflows Science gateway creators using Jetstream as either the frontend or processor for scientific jobs STEM Educators teaching on a variety of subjects

funded by the National Science Foundation Award #ACI “Long tail” of the NSF XD Ecosystem A self-provisioned, scalable science & engineering cloud environment Capability class machines Traditional HPC, HTC systems

funded by the National Science Foundation Award #ACI Science Domains Biology: iPlant and Galaxy VMs, enabling access to and use of new analytical codes in various modalities Earth Science: VMs capable of requesting NSIDC data and running common routines to enable more effective research and better analyses of data Field Station Research: VM-based data collection and analysis tools to support data sharing and collaboration GIS: Deliver the CyberGIS toolkit and provide access to ArcGIS in a VM using IU’s existing site license Network Science: Build VMs with CIShell tool builders to deliver network analysis tools interactively Social Sciences: Create VMs that allow selection of data from the Odum Institute in a way that retains provenance and version information Whatever you do, probably …unless you run large scale MPI codes or HTC workloads!

funded by the National Science Foundation Award #ACI st century workforce development Specialized virtual Linux desktops and applications to enable research and research education at small colleges and universities HBCUs (Historically Black Colleges and Universities) MSIs (Minority Serving Institutions) Tribal colleges Higher-education institutions in EPSCoR States

funded by the National Science Foundation Award #ACI Jetstream System Overview

funded by the National Science Foundation Award #ACI The Jetstream Interface

funded by the National Science Foundation Award #ACI Supporting Jetstream Users User Communities Cornell Virtual Workshops XSEDE Campus Champions XSEDE Training, Education, and Outreach (TEOS) User Guides / XSEDE KB

funded by the National Science Foundation Award #ACI Jetstream Timeline…what comes next? Production system has arrived and is installed at both locations Early operations mode is underway at IU and should be underway at TACC by the time of this presentation. As of first of March 2016, there were 18 XSEDE projects on Jetstream and 70 distinct users – growing daily! Acceptance work on production systems is proceeding with the NSF review scheduled for the first week of May Full, unrestricted operations after system is accepted

funded by the National Science Foundation Award #ACI How can I use Jetstream? An XSEDE User Portal (XUP) account is required. They are free! Get one at Read the Allocations Overview Write a successful allocation request – start with a Startup or Education request - requestshttps://portal.xsede.org/successful- requests

funded by the National Science Foundation Award #ACI Where can I get help or learn more? Production: – User guides: – XSEDE KB: – – Campus Champions: – Training Videos / Virtual Workshops (TBD) Early operations: – – Early use:

funded by the National Science Foundation Award #ACI Jetstream Partner Organizations Initial construction partners Application / community lead partners Management & Operations partners

funded by the National Science Foundation Award #ACI Questions? Project website: Project Direct License Terms Fischer, Jeremy. March Jetstream Overview – SPAN Workshop 3. University of Central Florida, Orlando, FL. Also available at: Jetstream is supported by NSF award (Craig Stewart, IU, PI) XSEDE is supported by NSF award (John Towns, UIUC, PI) This research was supported in part by the Indiana University Pervasive Technology Institute, which was established with the assistance of a major award from the Lilly Endowment, Inc. Opinions presented here are those of the author(s) and do not necessarily represent the views of the NSF, IUPTI, IU, or the Lilly Endowment, Inc. Items indicated with a © are under copyright and used here with permission. Such items may not be reused without permission from the holder of copyright except where license terms noted on a slide permit reuse. Except where otherwise noted, contents of this presentation are copyright 2015 by the Trustees of Indiana University. This document is released under the Creative Commons Attribution 3.0 Unported license ( This license includes the following terms: You are free to share – to copy, distribute and transmit the work and to remix – to adapt the work under the following conditions: attribution – you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work.