The Grid Background and Architecture. 1. Keys to success for IT technologies Infrastructure Open Standards.

Slides:



Advertisements
Similar presentations
Interaction model of grid services in mobile grid environment Ladislav Pesicka University of West Bohemia.
Advertisements

The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.
High Performance Computing Course Notes Grid Computing.
This product includes material developed by the Globus Project ( Introduction to Grid Services and GT3.
1 On Death, Taxes, & the Convergence of Peer-to-Peer & Grid Computing Adriana Iamnitchi Duke University “Our Constitution is in actual operation; everything.
Seminar Grid Computing ‘05 Hui Li Sep 19, Overview Brief Introduction Presentations Projects Remarks.
The Grid ”Enter the GRID” af Kristian Mandrup. Indeks Intro Overview Architecture Solutions Future Conclusions & discussion.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Grid Computing 7700 Fall 2005 Lecture 5: Grid Architecture and Globus Gabrielle Allen
PROTOCOLS AND ARCHITECTURE Lesson 2 NETS2150/2850.
Introduction and Overview “the grid” – a proposed distributed computing infrastructure for advanced science and engineering. Purpose: grid concept is motivated.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.
E-commerce Introduction. What is E-commerce? The use of the Internet and WWW to transact business? The use of the Internet and WWW to transact business?
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
Globus Computing Infrustructure Software Globus Toolkit 11-2.
Grid Computing Net 535.
Middleware for P2P architecture Jikai Yin, Shuai Zhang, Ziwen Zhang.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Core Grid Functions: A Minimal Architecture for Grids William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (www-itg.lbl.gov/~wej)
Grid Toolkits Globus, Condor, BOINC, Xgrid Young Suk Moon.
DISTRIBUTED COMPUTING
Grid Computing - AAU 14/ Grid Computing Josva Kleist Danish Center for Grid Computing
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
1 Grid Computing Middleware Presenter: Xon Xay Nguyen Tuan Viet Tram The Phien.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
The Anatomy of the Grid Mahdi Hamzeh Fall 2005 Class Presentation for the Parallel Processing Course. All figures and data are copyrights of their respective.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Middleware for Grid Computing and the relationship to Middleware at large ECE 1770 : Middleware Systems By: Sepehr (Sep) Seyedi Date: Thurs. January 23,
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GRID ARCHITECTURE Chintan O.Patel. CS 551 Fall 2002 Workshop 1 Software Architectures 2 What is Grid ? "...a flexible, secure, coordinated resource- sharing.
Grid Services I - Concepts
Authors: Ronnie Julio Cole David
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
The Globus Toolkit®: The Open Source Solution for Grid Computing
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Enabling e-Research in Combustion Research Community T.V Pham 1, P.M. Dew 1, L.M.S. Lau 1 and M.J. Pilling 2 1 School of Computing 2 School of Chemistry.
David Smiley SOA Technology Evangelist Software AG Lead, follow or get out of the way Here Comes SOA.
1 Observations on Architecture, Protocols, Services, APIs, SDKs, and the Role of the Grid Forum Ian Foster Carl Kesselman Steven Tuecke.
7. Grid Computing Systems and Resource Management
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Condor Services for the Global Grid: Interoperability between OGSA and Condor Clovis Chapman 1, Paul Wilson 2, Todd Tannenbaum 3, Matthew Farrellee 3,
Globus: A Report. Introduction What is Globus? Need for Globus. Goal of Globus Approach used by Globus: –Develop High level tools and basic technologies.
The Globus Toolkit The Globus project was started by Ian Foster and Carl Kesselman from Argonne National Labs and USC respectively. The Globus toolkit.
Towards ‘Ubiquitous’ Ubiquitous Computing: an alliance with ‘the Grid’ Oliver Storz, Adrian Friday, and Nigel Davies Computing Department, Lancaster University,
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Clouds , Grids and Clusters
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Globus —— Toolkits for Grid Computing
Grid Computing.
University of Technology
GRID COMPUTING PRESENTED BY : Richa Chaudhary.
Grid Computing B.Ramamurthy 9/22/2018 B.Ramamurthy.
Introduction to Grid Technology
Large Scale Distributed Computing
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Presentation transcript:

The Grid Background and Architecture

1. Keys to success for IT technologies Infrastructure Open Standards

Infrastructure without, no one can use the technology financed  by governments, very first  by industry, after interest increases

Open Standards fast evolution efficiency will be increased more and more integrated

2. How Infrastructure is built railroads, telephones and power development was very complicated started in small regional areas connected to a bigger network to be successful:  acceptance by the users  support by the governments financial promotive

3. Scientific demands computational vs. observational = 1 to 10 remote access to  data  instrumentation data and computation intensive powerful management of resources

Problems of experimental science only few resources worldwide research must be done on site The Grid may allow corporative work between scientists team spread all over the world

4. Business Impact large corporations are global in extent The Grid may link suppliers, manufactures and customers unite a company into a single collaborative team

Infrastructure for the masses only accepted widely if it  becomes transparent to the user  doesn‘t need much knowledge  is highly reliable

The growth of technology development phase  technology itself is important  mainly experts mass adoption  applications, reliability and availability  control returns to experts sinks into background

5. History ARPANET started in the early 1970s experimental network developed important protocols  TCP/IP  notion packet switching

Evolution (1) 1997, GT2  usability and interoperability  solutions for authentication and  resource discovery and access  protocols, APIs and services  GT2 „standards“ not formular not for public review

Evolution (2) 2002, OGSA  extended GT2 concepts and technologies  service-oriented architectures  Web services  provides framework

6. Concepts (1) Analogies to Peer-to-Peer file sharing sharing in terms of The Grid  direct access to computers software data sensors all other resources

6. Concepts (2)  sharing under a certain set of rules  mechanisms for accounting payment (if needed)  in money  in access to user‘s local resources

Concepts (3) achieving various QoS decomposing of integrated infrastructure  into fragmanted systems different resources  shared under certain circumstances pool of resources  members can use under a certain set of rules

7. Architecture seperated into different layers  providing different levels of abstraction lowest level  first step for resources into the Grid core protocol  establishing secure connection between Grid members  shared access to local resources  base for many different applications

Fabric Layer (1) provides local resources  shared over the Grid  computational power  storage  access to sensors translating local protocols to Grid protocols components in this layer will act as proxy objects

Fabric Layer (2) Component provides access to one kind of resources implements resource specific operations general operations for concurrent access show higher-level protocols the resources‘  structure  state  capabilities

Connectivity and Resource Layer narrow neck (hourglass model) based on many maybe different fabric layer technologies base for many very highspread technologies small set of core abstractions and protocols local resources connected to those how ask for them

Communication protocols include  transport  routing  naming defined by the ISO/OSI model TCP/IP protocol stack

Security (Connectivity Layer) one base functionality of this layer secure exchange of data identity verifying  users  resources implementations should  base on existing standards  support single sign-on

Resource Access (Resource Layer) enabling user to interact with remote resources defines protocols for  secure negotiation  initiation  monitoring  control  accounting  payment information protocols managing protocols

Collective Layer protocols and services to provide interactions across collections of resources in many cases built inside the application for examples  weather forecast program  Netsolve/GridSolve 2.0

Application Layer comprises the user applications applications constructed by calling upon services of any layer may introduce different layers

8. Implementations Globus Toolkit Version 2 (GT2) Open Grid Service Architecture (OGSA)

GT2 (1) first standardized implementation Grid protocols at higher levels assumes suitable software on fabric elements  CPU scheduling  file system management  sytem monitoring some components for discovering information about common resource types

GT2 (2) connectivity layer defined by GSI protocols  single sign-on authentication  communication protection  restricted delegation of rights

GT2 (3) implements GRAM protocol provides secure, reliable creation and management of remote computation uses  „gate-keeper“ to initiate  „job manager“ to manage „GRAM reporter“ for local computations

GT2 (4) Monitoring and Discovery Service (MDS-2)  discovering and accessing configuration status information  data model  resource-level protocols  configurable local registry  collective registry

OGSA (1) standardization of core GT protocols use essential Grid functions in different settings service orientated uniform treatment of all network entries

OGSA (2) Grid service  implements standard interfaces behaviors conventions  services are defined by the OGSI

Resources Need some sort of refundment  Financial  other

P2P-Networks: eMule Refundment by Priority Modifier * Waitingtime => Queue Rank

Credit System in eMule Ratio1 = 2*Up / Down Ratio2 = SQRT(Up+2) Modifier = Min{Ratio1,Ratio2} 1<=Modifier<=10 If Up Modifier = 1 If Down = 0 => Modifier = 10

OurGrid CPU-Sharing Round based Problems:  Free Riders  ID Changers

r A (B) = v(B,A)−v(A,B) r A (B): reputation of B relative to A v(B,A): Value of favours B done to A v(A,B): Value of favours A done to B rho: probability of consumer in turn f: probability of freerider epsilon: probability of a freerider getting a resource

r A (B) = v(B,A)−v(A,B) f=0,5

r A (B) = v(B,A)−v(A,B) rho=0,5

r A (B) = v(B,A)−v(A,B) rho=0,5

r A (B) = max{0, v(B,A) - v(A,B)} rho=0,5

r A (B) = max{0, v(B,A) - v(A,B) + log(v(B,A))} rho=0,5

Thank You