Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.

Slides:



Advertisements
Similar presentations
Wei Lu 1, Kate Keahey 2, Tim Freeman 2, Frank Siebenlist 2 1 Indiana University, 2 Argonne National Lab
Advertisements

GT 4 Security Goals & Plans Sam Meder
Virtual Machine Technology Dr. Gregor von Laszewski Dr. Lizhe Wang.
The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.
High Performance Computing Course Notes Grid Computing.
A Computation Management Agent for Multi-Institutional Grids
Seminar Grid Computing ‘05 Hui Li Sep 19, Overview Brief Introduction Presentations Projects Remarks.
The Grid ”Enter the GRID” af Kristian Mandrup. Indeks Intro Overview Architecture Solutions Future Conclusions & discussion.
USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:
Notes to the presenter. I would like to thank Jim Waldo, Jon Bostrom, and Dennis Govoni. They helped me put this presentation together for the field.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.
Simo Niskala Teemu Pasanen
Globus Computing Infrustructure Software Globus Toolkit 11-2.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Design and Implementation of a Single System Image Operating System for High Performance Computing on Clusters Christine MORIN PARIS project-team, IRISA/INRIA.
Core Grid Functions: A Minimal Architecture for Grids William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (www-itg.lbl.gov/~wej)
Virtual Infrastructure in the Grid Kate Keahey Argonne National Laboratory.
Grid Information Systems. Two grid information problems Two problems  Monitoring  Discovery We can use similar techniques for both.
OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
Grid Security Issues Shelestov Andrii Space Research Institute NASU-NSAU, Ukraine.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
Developing & Managing A Large Linux Farm – The Brookhaven Experience CHEP2004 – Interlaken September 27, 2004 Tomasz Wlodek - BNL.
Cracow Grid Workshop October 2009 Dipl.-Ing. (M.Sc.) Marcus Hilbrich Center for Information Services and High Performance.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
Grid Middleware Tutorial / Grid Technologies IntroSlide 1 /14 Grid Technologies Intro Ivan Degtyarenko ivan.degtyarenko dog csc dot fi CSC – The Finnish.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
CEOS Working Group on Information Systems and Services - 1 Data Services Task Team Discussions on GRID and GRIDftp Stuart Doescher, USGS WGISS-15 May 2003.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:
Grid technology Security issues Andrey Nifatov A hacker.
7. Grid Computing Systems and Resource Management
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Networking: Applications and Services Antonia Ghiselli, INFN Stu Loken, LBNL Chairs.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Condor Services for the Global Grid: Interoperability between OGSA and Condor Clovis Chapman 1, Paul Wilson 2, Todd Tannenbaum 3, Matthew Farrellee 3,
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Globus: A Report. Introduction What is Globus? Need for Globus. Goal of Globus Approach used by Globus: –Develop High level tools and basic technologies.
Collaborative Tools for the Grid V.N Alexandrov S. Mehmood Hasan.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
GridOS: Operating System Services for Grid Architectures
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
University of Technology
Grid Services B.Ramamurthy 12/28/2018 B.Ramamurthy.
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Grid Computing Software Interface
Presentation transcript:

Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis

Outline Background Starting assumptions Solutions Globus and PlanetLab cooperation

Globus & PlanetLab Both address similar problems  Discover, monitor and allocate resources  Securely  In a coordinated way Why do we want to compare?  Some pieces might be transferred  Some pieces might be complementary Why is it tricky to compare?  Both are active projects  Projects are complementary  Globus is a software toolkit PlanetLab is a deployment

Grids & Globus Grids  Resource sharing  Dynamic multi-institutional VOs  Coordinated problem solving Globus  Resource discovery, management, monitoring, data movement, security  Uniform API at the library level  Independent of underlying resource management mechanism  Standards-based (OGSA, Web Services, WSRF)

PlanetLab Infrastructure testbed Best suited for services that need dispersed points of presence Experimental and production use Designed to run on dedicated hosts Uses virtualization  Low level system abstraction  The user sees a distributed set of virtual containers  Unix-style API Higher value services are built on top Currently: 580 nodes on 275 sites

Similar problems, different assumptions User communities Application characteristics Resource characteristics Resource ownership

User communities Globus  User diversity  Rich functionality to meet application requirements  Standards-based  GSI framework Tools Protocols APIs PlanetLab  CS Researchers  Minimal functionality Duplicated user effort Competing services  Limited functionality Example: Security

Applications Grid applications  Compute intensive  Storage requirements  Network bandwidth  A “necessary evil” PlanetLab services  Network intensive  An objective Resource Distribution

Resources Globus  Wide resource heterogeneity  All major OSs supported  Java-based implementations  even larger set of possible environments PlanetLab  Testbed for new services  No legacy hardware or software  Assumes/exploits homogeneity  Supports Intel-based Linux machines

Resource ownership Globus  Resource owner controls the site PlanetLab  Limited control for the resource owner  Homogeneity is required  OS and architecture are mandated  PlanetLab admin has root access on nodes  PlanetLab admin has access to a remote power button

Different assumptions, different solutions Local resource management Federated resource sharing

Local resource management Globus  Unified interface for local resource management  Underlying mechanisms may vary  Main abstractions: Service Job PlanetLab  Low level management functionality  Same for all individual resources  Main abstraction: Virtual Machine

Federated resource sharing Global view of the resources Basic concept: delegation  Resource usage delegation Delegate the right to consume resources of a site Delegate to an application or a broker  Identity delegation Delegate one’s identity to another to act on his behalf

Resource usage delegation Globus  WS-Agreement Agreement represeantation Re-negotiation protocols Agreement state monitoring  Enforcement mechanism is undefined  User binds an agreement to a job or service PlanetLab  Resource capability 160 bit opaque value Represents access to resources (CPU, disk, network, memory, etc.)  Passed between services  Services can add more info (e.g. authorization, authentication)

Identity delegation Globus  GSI  X.509 proxy certificates Time limited Delegation of subset of privileges No third-party needed Dynamic delegation Delegation to dynamic entities PlanetLab  No mechanism  Services can implement their own Service A Service B

Global resource allocation and scheduling Globus  Exploits identity delegation PlanetLab  Exploits resource usage delegation Node Managers Brokers Job submission & identity delegation Job submission Forward Capability Provide capability Job submission … … … … … …

Globus and PlanetLab cooperation PlanetLab is a platform hosting Globus Example: Data grids  Geographically distributed data resources  Globus provides the services for Data management, access and analysis Security  PlanetLab provides low level services to optimize transfers (e.g. BANANAS) Example: Dynamic Runtime Environments  Globus is used to initiate a virtual container on a PlanetLab node

Recommendations Globus  Support for resource usage rights delegation  Community contribution integration PlanetLab  Service interoperability  Support for identity delegation

Discussion Is it really useful to run Globus over PlanetLab? How would users benefit from the Globus and PlanetLab cooperation? Can the two systems benefit from each other?

End