Scalable Grid system– VDHA_Grid: an e-Science Grid with virtual and dynamic hierarchical architecture Huang Lican College of Computer.

Slides:



Advertisements
Similar presentations
Caltech Proprietary Videoconferencing Security in VRVS 3.0 and Future Videoconferencing Security in VRVS 3.0 and Future Kun Wei California Institute of.
Advertisements

Peer to Peer and Distributed Hash Tables
GridVine: Building Internet-Scale Semantic Overlay Networks By Lan Tian.
1.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 1: Introducing Windows Server.
Module 5: Configuring Access to Internal Resources.
Naming Computer Engineering Department Distributed Systems Course Asst. Prof. Dr. Ahmet Sayar Kocaeli University - Fall 2014.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
Rheeve: A Plug-n-Play Peer- to-Peer Computing Platform Wang-kee Poon and Jiannong Cao Department of Computing, The Hong Kong Polytechnic University ICDCSW.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
A Gateway For SIP Event Interworking - Sasu Tarkoma & Thalainayar Balasubramanian Ramya.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Host Identity Protocol
Microsoft Windows 2003 Server. Client/Server Environment Many client computers connect to a server.
Grid Information Systems. Two grid information problems Two problems  Monitoring  Discovery We can use similar techniques for both.
Middleware challenges to service providers, the Nordic view TERENA, Ingrid Melve, UNINETT.
1 TAPAS Workshop Nicola Mezzetti - TAPAS Workshop Bologna Achieving Security and Privacy on the Grid Nicola Mezzetti.
Chapter 1: Computing with Services Service-Oriented Computing: Semantics, Processes, Agents – Munindar P. Singh and Michael N. Huhns, Wiley, 2005.
Peer to Peer Research survey TingYang Chang. Intro. Of P2P Computers of the system was known as peers which sharing data files with each other. Build.
Presented by Xiaoyu Qin Virtualized Access Control & Firewall Virtualization.
Networks – Network Architecture Network architecture is specification of design principles (including data formats and procedures) for creating a network.
Database Application Security Models Database Application Security Models 1.
ASG - Towards the Adaptive Semantic Services Enterprise Harald Meyer WWW Service Composition with Semantic Web Services
Grid Security Issues Shelestov Andrii Space Research Institute NASU-NSAU, Ukraine.
Wireless Networks of Devices (WIND) Hari Balakrishnan and John Guttag MIT Lab for Computer Science NTT-MIT Meeting, January 2000.
Module 5: Designing a Terminal Services Infrastructure.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Application of Content Computing in Honeyfarm Introduction Overview of CDN (content delivery network) Overview of honeypot and honeyfarm New redirection.
Project guide Dr. G. Sudha Sadhasivam Asst Professor, Dept of CSE Presented by C. Geetha Jini (07MW03)
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Locating Mobile Agents in Distributed Computing Environment.
1 Vigil : Enforcing Security in Ubiquitous Environments Authors : Lalana Kagal, Jeffrey Undercoffer, Anupam Joshi, Tim Finin Presented by : Amit Choudhri.
Understanding to InterGrid and WAG Dr. ZhenChun Huang Tsinghua Univ. NRSCC/RSGS/SIG Team Sep, 2006.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
INTERNET AND ADHOC SERVICE DISCOVERY BY: NEHA CHAUDHARY.
Grid Middleware Tutorial / Grid Technologies IntroSlide 1 /14 Grid Technologies Intro Ivan Degtyarenko ivan.degtyarenko dog csc dot fi CSC – The Finnish.
Grid Computing & Semantic Web. Grid Computing Proposed with the idea of electric power grid; Aims at integrating large-scale (global scale) computing.
th CODATA 2006, BEJING1 A P2P Service Discovery Strategy Based on Content Catalogues Dr. Lican Huang, Director Institute of Network & Distributed.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.
Security Mechanisms for Delivering Ubiquitous Services in Next Generation Mobile Networks Haitham Cruickshank University of Surrey workshop on Ubiquitous.
ADVANCED COMPUTER NETWORKS Peer-Peer (P2P) Networks 1.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Michał Jankowski, Paweł Wolniewicz, Jiří Denemark, Norbert Meyer,
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
1 Gateways. 2 The Role of Gateways  Generally associated with primary sites in ESG-CET  Provides a community-facing web presence  Can be branded as.
Chapter 1: Computing with Services Service-Oriented Computing: Semantics, Processes, Agents – Munindar P. Singh and Michael N. Huhns, Wiley, 2005.
Connect. Communicate. Collaborate Deploying Authorization Mechanisms for Federated Services in the eduroam architecture (DAMe)* Antonio F. Gómez-Skarmeta.
Algorithms and Techniques in Structured Scalable Peer-to-Peer Networks
GraDS MacroGrid Carl Kesselman USC/Information Sciences Institute.
Introduction to Active Directory
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
1 AHM, 2–4 Sept 2003 e-Science Centre GRID Authorization Framework for CCLRC Data Portal Ananta Manandhar.
1 Active Directory Service in Windows 2000 Li Yang SID: November 2000.
A Portrait of the Semantic Web in Action Jeff Heflin and James Hendler IEEE Intelligent Systems December 6, 2010 Hyewon Lim.
Active Directory. Computers in organizations Computers are linked together for communication and sharing of resources There is always a need to administer.
INFSO-RI Enabling Grids for E-sciencE Policy management and fair share in gLite Andrea Guarise HPDC 2006 Paris June 19th, 2006.
Csci5233 Computer Security1 Bishop: Chapter 14 Representing Identity.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Windows Active Directory – What is it? Definition - Active Directory is a centralized and standardized system that automates network management of user.
Network Topologies for Scalable Multi-User Virtual Environments Lingrui Liang.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Domain Name System: DNS To identify an entity, TCP/IP protocols use the IP address, which uniquely identifies the Connection of a host to the Internet.
XtreemOS IP project is funded by the European Commission under contract IST-FP Scientific coordinator Christine Morin, INRIA Presented by Ana.
AMGA Web Interface Salvatore Scifo INFN sez. Catania
Grid Computing.
Gonçalo Borges, Mário David, Jorge Gomes
The Globus Toolkit™: Information Services
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
A P2P Service Discovery Strategy Based on Content Catalogues
Presentation transcript:

Scalable Grid system– VDHA_Grid: an e-Science Grid with virtual and dynamic hierarchical architecture Huang Lican College of Computer Science, Zhejiang University

Backgroud College of Computer Science,Zhejiang University The mode of Grid computing is client/server at present. It is not scalable. Scalability is the most challengeable problem of Grid computing P2P computing is scalable but it does not fulfill the requirements of Grid computing We want something which has P2P properties and also is easily managed and implemented Virtual and Dynamic hierarchical architecture is just the thing we want.

Advantages of VDHA College of Computer Science,Zhejiang University Combine advantages of P2P and C/S Satisfy the scalable and dynamical requirements of Grid

Overview of Virtual and Dynamic Hierarchical Architecture (VDHA) College of Computer Science,Zhejiang University dynamic and virtual hierarchical architecture to satisfy the requirements of Grid computing. Client end (client host) accesses Grid system via a node (called as entrance node). The nodes are grouped virtually. Nodes can join the group and leave the group dynamically. The groups are virtually hierarchical, with one root-layer, several middle-layers, and many leaf virtual groups (these groups are called VOs). Among the nodes of VOs, one ( just one ) node (called as gateway node) in each group is chosen to form upper-layer groups, from the nodes of these upper-layer groups to form upper-upper-layer

Network Structure of VDHA_Grid College of Computer Science,Zhejiang University

Structure of VDHA College of Computer Science,Zhejiang University

Some concepts of VDHA College of Computer Science,Zhejiang University Grid node: node in the Grid system Entrance node :a Grid node which is an entrance point for users to login into the Grid system Owned node: a Grid node which manages the users User: role which uses the Grid Client host: an apparatus used by users to login into the Grid system and to do the business. Gateway node: a Grid node which takes coordinate functions in several different layer virtual groups Virtual group: a group virtually formed by the Grid nodes Coordinator of virtual group : a gateway node taking coordinate functions in the virtual group Virtual group tree: a hierarchical tree formed by virtual groups

Definition of VDHA College of Computer Science,Zhejiang University VDHA is a virtual group tree with depth of at least two layers. VDHA has dynamic properties in the number of grid nodes, layers and virtual groups, virtual group compositions, and so on.

Grid Group Management Protocol(GGMP)—maintaining the virtual group tree College of Computer Science,Zhejiang University If there are any changes in any nodes such as a node’s joining or leaving, these changes are forwarded to gateway node, which forwards this change information to all the nodes in the two neighboring layer groups. if there is any status changed needed to change gateway node, online node with maximum weight value is chosen as the new gateway node.

Scalable service discovery College of Computer Science,Zhejiang University Unlike Web service and Globus, VDHA_Grid Publishes and registers the service into the owner Node by the administrator of the node itself. service description is based on RDF. Service discovery is scalable. Time, space and message_cost Complexity is salable, and the Implementation is also scalable.

Grid Service Description Framework (GSDF) and ontology-based Grid service description language College of Computer Science,Zhejiang University Must answer the following questions: (1) How does QDP use GSDF to find the services? (2) What protocol does the service bind and how does the protocol marshals? (3) How does SLMS use GSDF to implement the services? (4) How does the service account? (5) How does the service grant access right (authorization)? (6) What QoS does the service support?

Query and Discovery Protocol(QDP) College of Computer Science,Zhejiang University Full Search Query and Discovery Protocol (FSQDP)

FSQDP performance College of Computer Science,Zhejiang University Influence of number of nodes in a virtual group on the time response (suppose all virtual group has the same number of nodes)

FSQDP performance -continue College of Computer Science,Zhejiang University influence of number of layers on the time response

Query and Discovery Protocol(QDP) College of Computer Science,Zhejiang University Domain-Specific Query and Discovery Protocol (DSQDP)

Query and Discovery Protocol(QDP) -- complexity College of Computer Science,Zhejiang University FSQDP DSQDP 4 5 6

Scalable Grid Security Infrastructure College of Computer Science,Zhejiang University (1)Nodes in the Grid system are trusted with each other. (2) Only user and node have certificates (3) Users are managed by their owner nodes (4)Grid nodes are grouped as virtual organizations (VO). These VOs are hierarchically grouped as virtual groups (VG). (5)All nodes and VO or VGs have global identification names (the nodes ID may be Internet IP address, IDs of VOs or VGs are similar to DNS). (6)The schema of mapping global entities to local entities is very easy. (local entity plus node name and VO path tree in virtual group tree forms globe entity VDHA_Grid has the following properties:

Scalable Grid Security Infrastructure: log on Authentication College of Computer Science,Zhejiang University

Scalable Grid Security Infrastructure: log on Authentication College of Computer Science,Zhejiang University Step1: the user gets access to client from which the user proxy is to be created, client generate Reqmessage; Ow-public (user-private (authen-inf, user-credential)) Send (Reqmessage1, cli, ent); Step2: Send (Reqmessage1, ent, ow); Step3: User-public (ow-private (authen-inf1, user-credential 1)) Check Address-header with user-credential Check authen-inf ow-private (user-private(user-credential) ) Send (resultmessage, ow, ent); Send (resultmessage, ent, cli);

Scalable Grid Security Infrastructure: Access control College of Computer Science,Zhejiang University

VDHA_Grid prototype implementation College of Computer Science,Zhejiang University

java implementation College of Computer Science,Zhejiang University

java implementation College of Computer Science, Zhejiang University VDHA_GRID mainframe

java implementation College of Computer Science, Zhejiang University Client_API

A scenario of service consuming and providing

Features of VDHA_Grid College of Computer Science,Zhejiang University Decentralized design and autonomy scalability Mobile computing and huge network High performance and full discovery of resources and services Fault-tolerance

CASE study (Chinese University e-Science Grid CUEG) College of Computer Science,Zhejiang University

What is CUEG ? College of Computer Science,Zhejiang University The virtual research projects granted by MOE aimed to enhance the science and technology research by virtual cooperation via Internet. ( information sharing and cooperation research) Its nodes are usually located in the Universities or Institutes. ( present, most of servers are PC servers ) The nodes are relative stable compared with other type Grids. The Universities are always formed into virtual organizers according to specific domains, (especially key labs) several virtual organizers share a more general common domain.

Case : heterogeneous information sharing College of Computer Science,Zhejiang University

Conclusion College of Computer Science,Zhejiang University VDHA can solve the scale and autonomy problems VDHA has mobile computing property. VDHA has high performance and full discovery of resources and services. VDHA may easily manage privileges and roles of users. VDHA satisfies the needs of Grid about security and authentication

Thanks