SURA GridPlan Infrastructure Working Group Art Vandenberg Georgia State University Mary Fran Yafchak SURA Working.

Slides:



Advertisements
Similar presentations
National Institute of Advanced Industrial Science and Technology Ninf-G - Core GridRPC Infrastructure Software OGF19 Yoshio Tanaka (AIST) On behalf.
Advertisements

Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
Experiences in Middleware Deployment: Teach a man to fish… Mary Fran Yafchak NMI Integration Testbed Manager SURA IT Program Coordinator.
Today’s Agenda Introductions, Agenda & “Other Topics” (8:30 – 9:00) History/Snapshots of SURAgrid (9:00 – 9:30) SURA & SURAgrid (9:30 – 10:15) Revisit.
What is Grid Computing System Virtualization of distributed computing and data resources such as processing, network bandwidth and storage capacity to.
High Performance Computing Course Notes Grid Computing.
SURAgrid Accounting Status September Accounting WG - Phase 1 Call for a working group at SURAgrid All-Hands March 07, to develop (at least) a.
Supporting Transformative Research Through Regional Cyberinfrastructure (CI) Dr. Dali Wang, Grid Infrastructure Specialist.
NMI Integration Testbed Three Years of Middleware Evaluation, Integration & Inspiration Mary Fran Yafchak SURA IT Program Coordinator.
SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop: Grid Application Planning & Implementation January 5-7, 2005.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Grid Networks. SURAGrid GSU UAH UAB UMICH UVA USC TACC LSU GPN GaTech SC DUKE GMU Tulane UARK TTU See presentation on Nov 22, 2005 from SURAGrid team.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
April 2009 OSG Grid School - RDU 1 Open Science Grid John McGee – Renaissance Computing Institute University of North Carolina, Chapel.
1 11 th Fed/Ed PKI Meeting Some quick updates from recent HEPKI-TAG and SURA work Jim Jokl
SURAgrid Update SURA Internet2 SMM April 23, 2007 Mary Fran Yafchak, SURA IT Program Coordinator, SURAgrid project manager.
Update on Activities of the SURA Grid Planning Group Ed Seidel (and Gary Crane) Co-Chair, SURA Grid Planning Group Director, Center Computation & Technology.
DynamicBLAST on SURAgrid: Overview, Update, and Demo John-Paul Robinson Enis Afgan and Purushotham Bangalore University of Alabama at Birmingham SURAgrid.
Chao “Bill” Xie, Victor Bolet, Art Vandenberg Georgia State University, Atlanta, GA 30303, USA February 22/23, 2006 SURA, Washington DC Memory Efficient.
SURAgrid Governance Committee Art VandenbergMike Sachon SGC ChairSGC Co-Chair September 27, 2007.
Supporting Transformative Research Through Regional Cyberinfrastructure (CI) Gary Crane, Director IT Initiatives.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
Final Steps in the NMI Integration Testbed Program Mary Fran Yafchak SURA IT Program Coordinator NMI Integration Testbed Manager
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
USERS Implementers Target Communities NMI Integration Testbed The NMI Integration Testbed NMI Participation Developed and managed by SURA Evaluate NMI.
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
October 15, 2003 Art Vandenberg Internet2 Fall Member Meeting1 Taking Grids out of the Lab and onto the Campus at Georgia State University – Case Study.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
State of SURAgrid for All-Hands meeting September 2007 Mary Fran Yafchak SURA IT Program Coordinator
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Grid Networks. SURAGrid GSU UAH UAB UMICH UVA USC TACC LSU GPN GaTech SC DUKE GMU Tulane UARK TTU See presentation on Nov 22, 2005 from SURAGrid team.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Grid Computing & Semantic Web. Grid Computing Proposed with the idea of electric power grid; Aims at integrating large-scale (global scale) computing.
3 Nov 2003 A. Vandenberg © Second NMI Integration Testbed Workshop on Experiences in Middleware Deployment, Anaheim, CA 1 Grids at Georgia State – Starting.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
SURA IT Committee & Regional CASA Meeting “SURAgrid Partnership” Sheraton Four Points 1201 K Street, NW Washington, DC March 7, 2006 Jerry P. Draayer SURA.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Leveraging Campus Authentication for Grid Scalability Jim Jokl Marty Humphrey University of Virginia Internet2 Meeting April 2004.
GridLab WP-2 Cactus GAT (CGAT) Ed Seidel, AEI & LSU Co-chair, GGF Apps RG, Gridstart Apps TWG Gabrielle Allen, Robert Engel, Tom Goodale, *Thomas Radke.
Computing the Smith-Waterman Algorithm on the Illinois Bio-Grid Dave S. Angulo 1, Nigel M. Parsad 2, Tom Goodale 3, Gabrielle Allen 3, Ed Seidel 3 1 The.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Southeastern Universities Research Association (SURA) - Intro for Fed/Ed 18 Mary Fran Yafchak Senior Program Manager, IT
Launching a great program! SURAgrid All Hands Meeting – September 21, 2006.
Parallel Algorithm for Multiple Genome Alignment Using Multiple Clusters Nova Ahmed, Yi Pan, Art Vandenberg Georgia State University SURA Cyberinfrastructure.
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
NMI Integration Testbed Mary Fran Yafchak NMI Integration Testbed Manager Southeastern Universities Research Association
Tool Integration with Data and Computation Grid “Grid Wizard 2”
David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.
© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.
Dynamic Grid Computing: The Cactus Worm The Egrid Collaboration Represented by: Ed Seidel Albert Einstein Institute
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
Workload Management Workpackage
Clouds , Grids and Clusters
Joslynn Lee – Data Science Educator
Professor, University of Maryland
Grid Computing.
Mary Fran Yafchak Senior Program Manager, IT
NMI Testbed GRID Utility for Virtual Organization
ExaO: Software Defined Data Distribution for Exascale Sciences
Presentation transcript:

SURA GridPlan Infrastructure Working Group Art Vandenberg Georgia State University Mary Fran Yafchak SURA Working Group Co-leads:

March 22, 20052/19 Infrastructure WG Charter Primary Goal: Build a regional grid or interconnection of semi-regional grids capable of supporting activities that advance the availability of Grid infrastructure to SURA member institutions.

March 22, 20053/19 Infrastructure WG Charter Specific Activities: Increase the number and diversity of interconnected nodes and their availability to researchers. Expand secure grid authentication between institutions, including diverse local CAs & BridgeCA in alignment with national & international directions. Implement grid services and tools, and evaluation of these, within a test environment of actual nodes and applications.

March 22, 20054/19 Infrastructure WG Charter Specific Activities: Develop new network monitoring, measurement and performance tools available to grid applications and users. Investigate policy and entry procedures for shared inter-institutional grids & recommend best practices. Investigate models to open grid resources to broader user communities (e.g. teaching faculty, students).

March 22, 20055/19 SURAgrid as Foundation Evolved from the NMI Testbed Grid, initiated by SURA in September 2003 as part of the NSF Middleware Initiative (NMI) Integration Testbed Program – Goal is a scalable infrastructure that leverages local institutional identity and authorization while managing access to shared resources across organizational boundaries. –Working to build the grid without over-specifying the technology –Enabling inter-institutional access that is “seamless” for users and realistic (interoperable, scalable) for the grid –Fostering the sharing and development of real applications to proof the infrastructure while bringing recognizable value to users

March 22, 20056/19 SURAGrid: participants… from May 2004 GSU UAH UAB UMICH UVA USC TACC Louisiana TAMU UFL OleMiss GMU Tulane UARK TTU SC LSU GPN

March 22, 20057/19 SURAgrid Resources

March 22, 20058/19 Application Example 1 Genome Alignment Algorithm 1. Researcher: Nova Ahmed, PhD Student, Georgia State University 2. Application Goal: Analysis of genome alignment performance across clusters and grids 3. Value of sharing: Access to resources not available at home institutions 4. Participating Institutions: GSU, UAB, USC, TACC, UVA

March 22, 20059/19 Sequence alignment Sequences used to find biologically meaningful relationships among organisms –Evolutionary info; diseases, causes, cures –Finding out information about proteins Compute intensive for long sequences –Needleman & Wunsch (1970) - optimal global alignment –Smith & Waterman (1981) - optimal local alignment –Taylor (1987) - multiple alignment by pairwise alignment –BLAST trades optimal results for faster computation Challenge - achieve optimal results without sacrificing speed

March 22, /19 Parallel distribution of multiple sequences Sequences 1-6 Sequences 7-12 Seq 1-2 Seq 5-6 Seq 3-4

March 22, /19 Computation Time potential for multiple clusters across grid?

March 22, /19 UVA using UAB cert (BridgeCA)

March 22, /19 Application Example 2 Task-Farming for Black Hole Simulation 1.Researcher: Rion Dooley, IT Analyst, CCT 2.Application Goal: Faster calculation for “grand scale” parameter survey 3.Value of sharing: Unattended, opportunistic use of computational resources across institutions 4.Participating Institutions: LSU, TACC, UVA*, UAB* *via BridgeCA

March 22, /19 Task Farming Certain classes of problems require large numbers of nearly identical runs to produce meaningful results. Examples: –Monte-Carlo simulations –Smith-Waterman analyses –Data mining –Parameter sweeps Task farming is a way to utilize multiple resources to solve such problems.

March 22, /19 Task Farm Infrastructure Using general Task Farming infrastructure written using Cactus –Hierarchy of “Task Farm Managers (TFM)” –Pluggable components to easily use different technologies (e.g. GAT) –Grid enabled and very portable –Supports task scheduling Can handle needs of different classes of applications by adding new “Logic Managers” –Fill out simple API for general task farming (how to start application, provide parameter file, etc) Application independent –no need to recompile existing application –Generic Logic Manager can be used for most apps

March 22, /19 Task Farm Infrastructure Grid functionality provided through the Grid Application Toolkit (GAT) –Resource discovery –Job submission –File transfer Using GAT means many different technologies/services can be used

March 22, /19 Task Monitoring Task Farming infrastructure can make use of our other tools, e.g. –HTML interface to monitor the progress of the overall tasks and to steer individual TFM’s* –Portal interface to start, stop, and track tasks

March 22, /19 Future of TFI and SURA Grid Explore new ways to schedule and share resources with SURA Grid –User-centric vs. resource-centric resource allocation –Dynamic resource scheduling based on “good neighbor” policies

March 22, /19 Sample Run: Black Hole Simulation Parameter Survey