Grid Computing School of Engineering Young Joo, Han.

Slides:



Advertisements
Similar presentations
The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.
Advertisements

Database Architectures and the Web
IT INFRASTRUCTURE AND EMERGING TECHNOLOGIES
What is Grid Computing? Cevat Şener Dept. of Computer Engineering, METU.
High Performance Computing Course Notes Grid Computing.
Distributed Systems 1 Topics  What is a Distributed System?  Why Distributed Systems?  Examples of Distributed Systems  Distributed System Requirements.
Transforming the very fabric of the Internet into a high-performance video game machine Digital Media: The Butterfly Grid Presented by: Hao Wang.
Seminar Grid Computing ‘05 Hui Li Sep 19, Overview Brief Introduction Presentations Projects Remarks.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The Grid Background and Architecture. 1. Keys to success for IT technologies Infrastructure Open Standards.
An Introduction to Grid Computing Richard Fujimoto Reference: The Grid 2, ch. 1-4, 7 Ian Foster & Carl Kesselman (eds.)
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
Chapter 9: Moving to Design
Grid Computing Net 535.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Cloud Computing.
Grid Toolkits Globus, Condor, BOINC, Xgrid Young Suk Moon.
Chapter 9 Elements of Systems Design
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
Application Layer CHAPTER 2. Announcements and Outline  Administrative Items  Questions? Recap 1.Introduction to Networks 1.Network Type 2.N etwork.
DISTRIBUTED COMPUTING
Lecture 3: Sun: 16/4/1435 Distributed Computing Technologies and Middleware Lecturer/ Kawther Abas CS- 492 : Distributed system.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
1 Introduction to Middleware. 2 Outline What is middleware? Purpose and origin Why use it? What Middleware does? Technical details Middleware services.
C5- IT Infrastructure and Emerging Technologies. Input – Process - Output 2 A computer  Takes data as input  Processes it  Outputs information CPU.
C5- IT Infrastructure and Emerging Technologies Let us buy some Blade Servers!
The Anatomy of the Grid Mahdi Hamzeh Fall 2005 Class Presentation for the Parallel Processing Course. All figures and data are copyrights of their respective.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
Copyright © 2002 Intel Corporation. Intel Labs Towards Balanced Computing Weaving Peer-to-Peer Technologies into the Fabric of Computing over the Net Presented.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Middleware for Grid Computing and the relationship to Middleware at large ECE 1770 : Middleware Systems By: Sepehr (Sep) Seyedi Date: Thurs. January 23,
9 Systems Analysis and Design in a Changing World, Fourth Edition.
GRID ARCHITECTURE Chintan O.Patel. CS 551 Fall 2002 Workshop 1 Software Architectures 2 What is Grid ? "...a flexible, secure, coordinated resource- sharing.
Authors: Ronnie Julio Cole David
9 Systems Analysis and Design in a Changing World, Fourth Edition.
The Globus Toolkit®: The Open Source Solution for Grid Computing
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:
1 Observations on Architecture, Protocols, Services, APIs, SDKs, and the Role of the Grid Forum Ian Foster Carl Kesselman Steven Tuecke.
7. Grid Computing Systems and Resource Management
Networking: Applications and Services Antonia Ghiselli, INFN Stu Loken, LBNL Chairs.
Chapter 3 Selecting the Technology. Agenda Internet Technology –Architecture –Protocol –ATM IT for E-business –Selection Criteria –Platform –Middleware.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
6 march Building the INFN Grid Proposal outline a.ghiselli,l.luminari,m.sgaravatto,c.vistoli INFN Grid meeting, milano.
Distributed Geospatial Information Processing (DGIP) Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
9. 9 Systems Analysis and Design in a Changing World, Fourth Edition.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
9 Systems Analysis and Design in a Changing World, Fifth Edition.
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Clouds , Grids and Clusters
Access Grid and USAID November 14, 2007
Globus —— Toolkits for Grid Computing
Grid Computing.
Database Architectures and the Web
University of Technology
GRID COMPUTING PRESENTED BY : Richa Chaudhary.
Grid Computing B.Ramamurthy 9/22/2018 B.Ramamurthy.
The Globus Toolkit™: Information Services
Distributed Systems Bina Ramamurthy 11/30/2018 B.Ramamurthy.
Distributed Systems Bina Ramamurthy 12/2/2018 B.Ramamurthy.
Introduction to Grid Technology
Grid Application Model and Design and Implementation of Grid Services
Introduction to Grid Technology
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Distributed Systems Bina Ramamurthy 4/22/2019 B.Ramamurthy.
Presentation transcript:

Grid Computing School of Engineering Young Joo, Han

Contents Grid Computing Comparison with other tech Grid Architecture –Fabric layer –Connectivity layer –Resource layer –Collective layer –Application layer Grid Category –Computational Grid –Data Grid –Access Grid

Software Trends Time (years) scale Structured programming Object-oriented programming Component programming monolithic Client-server Classes Multi-tier Server-side Grid Computing Application complexity

Grid computing offers a model for solving massive computational problems by making use of the unused CPU cycles of large numbers of disparate, often desktop, computers treated as a virtual cluster embedded in a distributed telecommunications infrastructure.clusterembedded telecommunications The coordinated, transparent and secure sharing of IT resources across geographically distributed sites Grids are built on standards-based interoperability to deliver integrated solutions that allow virtual collaboration Grid Computing Virtual Servers, Storage and Instruments Grid Middleware Distributed Physical Servers and Storage

Grid Enable Source: IBM Sharing of Resources – Virtual Organizations and Collaboration Management of Resources - Quality of Service and Optimization Access to Resources - On Demand Computing and Utility Models

Grid Technology Natural evolution of distributed systems and the Internet. Middleware supporting network of systems to facilitate sharing, standardization and openness. Infrastructure and application model dealing with sharing of compute cycles, data, storage and other resources. Move towards delivering “computing” to masses similar to other utilities (electricity and voice communication). Currently used for high performance computing however the trend is towards Service Oriented Applications (SOA).

Comparison (Grid vs WWW) GridWWW Transmission Method Peer to PeerServer to Client Transmission Speed G bps ~ T bpsK bps ~ M bps SharingLarge scale DB Distributed super com. Hyper Text based information BrowserJACO3, TENT, etcIE, Netscape MiddlewareGlobus, LegionServed by application

Comparison (Grid vs P2P) GridP2P ConnectivityCollaborationPoint to Point CommunityLimited user groupOpen NetworkHigh speed networkInternet Open strategyStorage and computing power share File share

Grid Architecture

Open Grid Services Architecture (Integration of Grid and Web services) Applications on demand Secure and Universal access Business integration shareaccess manage Resources On demand Global accessibility Vast resource scalability Continuous Availability Web Services Grid Protocols

Layered Grid Architecture (By Analogy to Internet Architecture) Application Fabric “Controlling things locally”: Access to, & control of, resources Connectivity “Talking to things”: communication (Internet protocols) & security Resource “Sharing single resources”: negotiating access, controlling use Collective “Coordinating multiple resources”: ubiquitous infrastructure services, app-specific distributed services Internet Transport Application Link Internet Protocol Architecture Slide courtesy of C. Kessleman Cal(IT)2 Presentation

Layered Grid Architecture Application Collective Resource Connectivity Fabric Internet Link Transport Grid Protocol Architecture Internet Protocol Architecture

Fabric Layer Fabric layer: Provides the resources to which shared access is mediated by Grid protocols. Example: computational resources, storage systems, catalogs, network resources, and sensors. Fabric components implement local, resource specific operations. Richer fabric functionality enables more sophisticated sharing operations. Sample resources: computational resources, storage resources, network resources, code repositories, catalogs.

Connectivity Layer Application Collective Resource Connectivity Fabric Grid Protocol Architecture Nexsus Interface Grid Security Infrastructure GSI

Connectivity Layer Communicating easily and securely. Connectivity layer defines the core communication and authentication protocols required for grid-specific network functions. This enables the exchange of data between fabric layer resources. Support for this layer is drawn from TCP/IP’s IP, TCL and DNS layers. Authentication solutions: single sign on, etc.

Resource Layer Application Collective Resource Connectivity Fabric Grid Resource Information Protocol (GRIP) GridFTP Grid Resource Access Management (GRAM) Grid Protocol Architecture Grid Resource Registration Protocol (GRRP) Data Transfer Grid Information Services Resource Management

Resources Layer Resource layer defines protocols, APIs, and SDKs for secure negotiations, initiation, monitoring control, accounting and payment of sharing operations on individual resources. Two protocols information protocol and management protocol define this layer. Information protocols are used to obtain the information about the structure and state of the resource, ex: configuration, current load and usage policy. Management protocols are used to negotiate access to the shared resource, specifying for example QoS, advanced reservation, etc.

Collective Layer Application Collective Resource Connectivity Fabric Data Replication Services Directory Services Grid Protocol Architecture Monitoring Services Scheduling and Brokering Services

Collective Layer Coordinating multiple resources. Contains protocols and services that capture interactions among a collection of resources. It supports a variety of sharing behaviors without placing new requirements on the resources being shared. Sample services: directory services, coallocation, brokering and scheduling services, data replication service, workload management services, collaboratory services.

Applications Layer These are user applications that operate within VO environment. Applications are constructed by calling upon services defined at any layer. Each of the layers are well defined using protocols, provide access to useful services. Well defined APIs also exist to work with these services. A toolkit Globus implements all these layers and supports grid application development.

Grid Category

Categorization Ambient mic (tabletop) Presenter mic Presenter camera Audience camera High-Throughput Computing Grid System Computational Grid Data Grid Access Grid Distributed Super Computing On Demand Cooperative work Environment Multimedia

Computational Grid Computational grid is a hardware and software infrastructure that provide dependable, consistent, pervasive and inexpensive to access to high-end computational capabilities Infrastructure because computational grid is large-scale pooling of resources, whether compute cycle, data, sensors, or people Computational grid is analogous to electric power grid

Example (Butterfly.net) Massively Multiplayer Online Game Very complex, wide virtual world, many buildings, rooms, polygons, textures, characters, and so on… Millions of users invests enormous amounts of time, energy, money. $10 billion in 2001 to $18 billion in 2005 (US only) Lineage (NCSoft, South Korea). The biggest MMG game in the world, the most number of users. (1.2 millions users pay for it each month.) EverQuest(US), a half-million subscrivers.

Technical problems Inherently issuing problems –MMGs are often unavailable for hours at a time –MMGs suffer from lag –MMGs offer a minimal set of interactions. Reasons –Difficulties on development network-based game VS. standalone PC game –“Client-server protocol –Difficulties on load estimation –Server maintenance and reconfiguration

Solutions Low cost and high performance equipment –Intel processor + Linux OS Distributed game server architecture on Grid environment and multicast-mesh over User Datagram Protocol(UDP) –Security, Reliability, Scalability, Load balancing, high speed and high quality game, –No down time, No lag –Cost effective, –No risk

Data Grid A data grid is a grid computing system that deals with data - the controlled sharing and management are large amounts of distributed data. These are often, but not always, combined with computational grid computing systems.grid computingcomputationalgrid computing These applications require widely distributed access to data by many people in many places. The data grid creates virtual collaborative environments that support distributed but coordinated scientific and engineering research Example: Medical X-ray DB(telepacs system)

Access Grid Access Grid is a collection of resources and technologies that enable large format audio and video based collaborations:audiovideocollaborations The Access Grid is an ensemble of resources including multimedia large-format displays, presentation and interactive environments, and interfaces to Grid middleware and to Visualization environmentsmultimediamiddleware Visualization

Example (Share of 3D Objects & Collaborative Interaction) KIST Screen Remote Screen

Shuyukan High School, Japan

Grid Past, Present, Future

Past –Origins and broad adoption in eScience, fueled by open source Globus Toolkit Present –Rapidly growing commercial adoption –Open Grid Services Architecture (OGSA) Future –Key enabler of new applications & industries based on resource virtualization and distributed service integration

Reference Analysis of state Management in Web Services and Various Extensions (Ai Ting, Wang Caixia, Xie Young) Grid Computing (Wieley) Etc.

Q & A