Apache Airavata (Incubating) Gateway to Grids & Clouds Suresh Marru Nov 10 th 2011.

Slides:

Advertisements

Similar presentations

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (

Advertisements

Xsede eXtreme Science and Engineering Discovery Environment Ron Perrott University of Oxford 1.

1 US activities and strategy :NSF Ron Perrott. 2 TeraGrid An instrument that delivers high-end IT resources/services –a computational facility – over.

(e)Science-Driven, Production- Quality, Distributed Grid and Cloud Data Infrastructure for the Transformative, Disruptive, Revolutionary, Next-Generation.

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

Grid Programming Environment (GPE) Grid Summer School, July 28, 2004 Ralf Ratering Intel - Parallel and Distributed Solutions Division (PDSD)

1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.

Federated Access to US CyberInfrastructure Jim Basney CILogon This material is based upon work supported by the National Science Foundation.

Globus Computing Infrustructure Software Globus Toolkit 11-2.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

1 Building National Cyberinfrastructure Alan Blatecky Office of Cyberinfrastructure EPSCoR Meeting May 21,

Best Practices: Integration of OpenTopography DEM data with UIUC Viewshed tool SDSC OT team.

Grid Computing for Real World Applications Suresh Marru Indiana University 5th October 2005 OSCER OU.

Apache Airavata GSOC Knowledge and Expertise Computational Resources Scientific Instruments Algorithms and Models Archived Data and Metadata Advanced.

- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

XCAT Science Portal Status & Future Work July 15, 2002 Shava Smallen Extreme! Computing Laboratory Indiana University.

TeraGrid Information Services John-Paul “JP” Navarro TeraGrid Grid Infrastructure Group “GIG” Area Co-Director for Software Integration and Information.

Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.

Future Grid Future Grid User Portal Marlon Pierce Indiana University.

Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.

Towards a Javascript CoG Kit Gregor von Laszewski Fugang Wang Marlon Pierce Gerald Guo

TeraGrid Science Gateways: Scaling TeraGrid Access Aaron Shelmire¹, Jim Basney², Jim Marsteller¹, Von Welch²,

Long Term Ecological Research Network Information System LTER Grid Pilot Study LTER Information Manager’s Meeting Montreal, Canada 4-7 August 2005 Mark.

Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University

Developing Cyberinfrastructure to Support Computational Chemistry Workflows Marlon Pierce (IU), Suresh Marru (IU), Sudhakar Pamidighantam (NCSA) Sashikiran.

Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski

August 2007 Advancing Scientific Discovery through TeraGrid Adapted from S. Lathrop’s talk in SC’07

SAN DIEGO SUPERCOMPUTER CENTER NUCRI Advisory Board Meeting November 9, 2006 Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director.

ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.

23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29

Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.

Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.

COMP3019 Coursework: Introduction to GridSAM Steve Crouch School of Electronics and Computer Science.

Cyberinfrastructure Planning at NSF Deborah L. Crawford Acting Director, Office of Cyberinfrastructure HPC Acquisition Models September 9, 2005.

Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,

October 21, 2015 XSEDE Technology Insertion Service Identifying and Evaluating the Next Generation of Cyberinfrastructure Software for Science Tim Cockerill.

Interoperability Grids, Clouds and Collaboratories Ruth Pordes Executive Director Open Science Grid, Fermilab.

Tutorial: Building Science Gateways TeraGrid 08 Tom Scavo, Jim Basney, Terry Fleury, Von Welch National Center for Supercomputing.

1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.

 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.

Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,

Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

08/05/06 Slide # -1 CCI Workshop Snowmass, CO CCI Roadmap Discussion Jim Bottum and Patrick Dreher Building the Campus Cyberinfrastructure Roadmap Campus.

Known Territories l There are several ways that Globus software has been used that are well-trod paths u General-purpose Grid infrastructures u Domain-specific.

GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.

ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University

Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.

Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,

OGCE Components for Enhancing UltraScan Job Management. Suresh Marru,Raminder Singh, Marlon Pierce.

Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University.

Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]

Lightweight construction of rich scientific applications Daniel Harężlak(1), Marek Kasztelnik(1), Maciej Pawlik(1), Bartosz Wilk(1) and Marian Bubak(1,

Riding the Crest: High-End Cyberinfrastructure Experiences and Opportunities on the NSF TeraGrid A Panel Presentation by Laura M c GinnisRadha Nandkumar.

1 NSF/TeraGrid Science Advisory Board Meeting July 19-20, San Diego, CA Brief TeraGrid Overview and Expectations of Science Advisory Board John Towns TeraGrid.

National Computational Science National Center for Supercomputing Applications National Computational Science Integration of the MyProxy Online Credential.

GSI: Security On Teragrid A Introduction To Security In Cyberinfrastructure By Dru Sepulveda.

National Energy Research Scientific Computing Center (NERSC) Visportal : interface to grid enabled NERC resources Cristina Siegerist NERSC Center Division,

OGCE Workflow and LEAD Overview Suresh Marru, Marlon Pierce September 2009.

Forging the eXtremeDigital (XD) Program Barry I. Schneider Program Director, Office of CyberInfrastructure January 20, 2011.

MGRID Architecture Andy Adamson Center for Information Technology Integration University of Michigan, USA.

Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University

Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.

Integrated Information Services “IIS” JP Navarro, U. of Chicago/ANL OGF 30 October 28, 2010.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.

TeraGrid’s Process for Meeting User Needs. Jay Boisseau, Texas Advanced Computing Center Dennis Gannon, Indiana University Ralph Roskies, University of.

EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu

Overview on the work performed during EPIKH Training Faiza MEDJEK /INFN, CATANIA 1.

XSEDE’s Campus Bridging Project

iSERVOGrid Architecture Working Group Brisbane Australia June

Presentation transcript:

Apache Airavata (Incubating) Gateway to Grids & Clouds Suresh Marru Nov 10 th 2011

Outline  Introducing Airavata  High level architecture  Initial community  Potential synergies Rave, Wookie Axis2, ODE OODT, Tikka Oozie, Hadoop

My Background  Suresh Marru  Indiana University  Program Director, XSEDE Science Gateways  Area of interest Distributed Systems, Grid & Cloud computing Service oriented architectures & workflow systems

Airavata Mentors -Ate DoumaAte Douma -Paul FremantlePaul Fremantle -Ross Gardler (Champion)Ross Gardler -Chris A. MattmannChris A. Mattmann -Aleksander SlominskiAleksander Slominski -Sanjiva WeerawarnaSanjiva Weerawarna

NSF TeraGrid Objectives DEEP Science: enabling terascale and petascale science – make science more productive through an integrated set of very-high capability resources address key challenges prioritized by users WIDE Impact: empowering communities – bring TeraGrid capabilities to the broad science community partner with science community leaders - “Science Gateways” OPEN Infrastructure, OPEN Partnership – provide a coordinated, general purpose, reliable set of services and resources partner with campuses and facilities

XSEDE Vision The eXtreme Science and Engineering Discovery Environment (XSEDE) will: enhance the productivity of scientists and engineers by providing them with new and innovative capabilities and thus facilitate scientific discovery while enabling transformational science/engineering and innovative educational programs 6

Extended Collaboration for Science Gateways ECSS: Support communities that wish to use XD resources via science gateways and/or data repositories Gateway Software Incubator: Evaluates new software and makes recommendation to gateway community. Gateway community building: Actively engage gateway developers in sharing experiences and learning from each other. Gateway Helpdesk: Specialized personnel assist in gateway tickets. XSEDE Interactions: Interface between gateway developers and XD architecture and operations groups.

Using Grid Credentials from Portals Workstation Grid Certificate(or proxy), username, password MyProxy Server Portal Interaface Gateway Server Compute Servers Username, password Grid Proxy Job Submit or File Transfer request Output Proxy, Job Request Job Status, Output Step 0 Step 1 Step 2,3,,

Abstractions 9 Load Leveler PBS/Torque Sun Grid Engine LSF Globus Unicore Genesis 2 EC2 API Gateway Frameworks

Airavata high level view

Registries

Airavata Workflow Architecture

Airavata WS Messenger

Synergies with Apache Projects Web Interfaces/gadgets/widgets – Rave Web Service Engines – Axis2, CXF Workflow Engines – ODE, Oozie Distributed Infrastructures – Hadoop family Data & Metadata management – Tikka, OODT Registries and Searching – Jackrabbit, Lucene

Contact  Suresh Marru