Grid Information Services: alternate models

Slides:



Advertisements
Similar presentations
23 July 2002 Performance Comparison of Grid Information Services Beth Plale Computer Science Dept. Indiana University Unified Relational GIS Project Collaborative.
Advertisements

LACP Project Proposal.
1 Scoped and Approximate Queries in a Relational Grid Information Service Dong Lu, Peter A. Dinda, Jason A. Skicewicz Prescience Lab, Dept. of Computer.
Virtual LANs.
Nondeterministic Queries in a Relational Grid Information Service Peter A. Dinda Dong Lu Prescience Lab Department of Computer Science Northwestern University.
Introduction to Databases
Scenario ResultsEase of Use Ease of Use captures intangible aspects of performance of a grid service, in particular, amount of work client must undertake.
Towards Virtual Networks for Virtual Machine Grid Computing Ananth I. Sundararaj Peter A. Dinda Prescience Lab Department of Computer Science Northwestern.
File Systems and Databases
CS 501: Software Engineering Fall 2000 Lecture 16 System Architecture III Distributed Objects.
Ch 12 Distributed Systems Architectures
Peter Dinda Department of Computer Science Northwestern University Beth Plale Department.
Dynamic Topology Adaptation of Virtual Networks of Virtual Machines Ananth I. Sundararaj Ashish Gupta Peter A. Dinda Prescience Lab Department of Computer.
Hardware & Software Needed For LAN and WAN
What is a Database? A database is any collection of data.
NETWORK CENTRIC COMPUTING (With included EMBEDDED SYSTEMS)
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
Information storage: Introduction of database 10/7/2004 Xiangming Mu.
June 25 th PDPTA Incorporating an XML Matching Engine into Distributed Brokering Systems.
Data Comm. & Networks Instructor: Ibrahim Tariq Lecture 3.
Database System Concepts and Architecture Lecture # 2 21 June 2012 National University of Computer and Emerging Sciences.
2. Database System Concepts and Architecture
Database Systems: Design, Implementation, and Management Tenth Edition Chapter 12 Distributed Database Management Systems.
Datasets on the GRID David Adams PPDG All Hands Meeting Catalogs and Datasets session June 11, 2003 BNL.
1 CS 430 Database Theory Winter 2005 Lecture 2: General Concepts.
Management Information Systems, 4 th Edition 1 Chapter 8 Data and Knowledge Management.
Routing and Routing Protocols
Experiences with OGSA-DAI : Portlet Access and Benchmark Deepti Kodeboyina and Beth Plale Computer Science Dept. Indiana University.
11 CLUSTERING AND AVAILABILITY Chapter 11. Chapter 11: CLUSTERING AND AVAILABILITY2 OVERVIEW  Describe the clustering capabilities of Microsoft Windows.
Virtual Machines Created within the Virtualization layer, such as a hypervisor Shares the physical computer's CPU, hard disk, memory, and network interfaces.
Introduction to Active Directory
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
1 Active Directory Service in Windows 2000 Li Yang SID: November 2000.
Client-server communication Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.
Instructor Materials Chapter 2: Scaling VLANs
Xerox Analyst Training
College of Arts & Science Computer Science Department
Understanding Web Server Programming
California Institute of Technology
Internet and Intranet.
Semester 4 - Chapter 3 – WAN Design
Network Architecture Layered system with alternative abstractions available at a given layer.
Open Source distributed document DB for an enterprise
Network Load Balancing
(ITI310) SESSIONS 6-7-8: Active Directory.
: An Introduction to Computer Networks
Chapter 4: Routing Concepts
Chapter 2: Scaling VLANs
Chapter 3: Windows7 Part 4.
NT Server - Networking Southeaster University Domain System
Internet and Intranet.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Unit 27: Network Operating Systems
Applying Domain-Specific Modeling Languages to Develop DRE Systems
MANAGING DATA RESOURCES
Software Defined Networking (SDN)
PPPoE Internet Point to Point Protocol over Ethernet
File Systems and Databases
SQL Server 2000: Integration with AD and E2K
Grid Resources: E-R Diagram
Enabling Innovation Inside the Network
The Globus Toolkit™: Information Services
Ananth I. Sundararaj Ashish Gupta Peter A. Dinda Prescience Lab
Cloud computing mechanisms
Internet and Intranet.
Analysis models and design models
Database System Concepts and Architecture
Internet and Intranet.
Presentation transcript:

Grid Information Services: alternate models Beth Plale Computer Science Dept. Indiana University Collaborator: Peter Dinda, Northwestern 07 June 2002

Types of Resource Information Grid Entity Description Organizations Accountable bodies and owners of resources People Resource admins, resource providers, GIS admins Physical resources Compute resources, network interfaces, benchmark results, number of users, load Services Job manager, load leveler, other GIS’ Comm resources Link capacity, switch capacity, error rate, drop rate Software packages BLAS, LAPACK, etc. Event producers Generators of event streams Event channels Propagators of event streams Event dictionaries List of commonly used event types Instruments Radar systems, telescopes, etc. Network paths Available bandwidth and expected latency Network topologies Hosts, switches, routers Wireless devices Wireless hosts, wavepoints, cells, etc. Virtual organizations Groups of collaborators 07 June 2002

Criteria for Inclusion in GIS An object in the repository represents an entity in the grid A grid entity has representation in the resource repository if: The grid entity can be described The grid entity has value to more than one application The grid entity is persistent (exists beyond single application run) 07 June 2002

Services Provided by GIS Query interface: client requests information via query in query language e.g., SELECT … FROM … WHERE in SQL Update interface: requests to add information to repository through language interface e.g., UPDATE … in SQL 07 June 2002

Services Provided by GIS Security interface Object level or column level? Access control Replication interface Provides replica transparency Management interface Turns self on and off Distribution (not a service, but a necessity) Hierarchical data partitions easily amongst administrative domains. 07 June 2002

Our absolute truths and logical conclusion Grid entities have complex relationships that are not captured in current GIS’. The kinds of questions asked of GIS data are more complex than the questions asked today. Some entities require rapid update rates. Fast query and update response time, and minimizing size of result are important goals. (1) Therefore: we are compelled to evaluate multiple data models against performance criteria (1) using use-case query benchmarks. 07 June 2002

start Entity Relationship schema diagram relat- ional (mySQL) ldap represented as transformed into relat- ional (mySQL) ldap (MDS) Grid GIS query benchmark XML (Xindice) 07 June 2002

Grid Resources: E-R Diagram availability clusters provides services network cards name, IP, os, physicalmemory, processor.load, storage.used, system.uptime is-a type, mfgBW host, port, protocol made of batch queue hosts end points has scalapac, lapack host benchmarks supports receives/ supplies instan. from application sources applications status switches switch benchmarks connections network paths routers traceroute packet loss, latency.roundtripDelay.ping, bandwidth.avail.TCP.singleStream network links network link benchmarks 07 June 2002

Grid Resources: Relational availability clusters services batch queue network cards type, mfgBW name, IP, os, physicalmemory, processor.load, storage.used, system.uptime host, port, protocol hosts end points host benchmarks scalapac, lapack application sources applications status switches switch benchmarks connections network paths routers traceroute packet loss, latency.roundtripDelay.ping, bandwidth.avail.TCP.singleStream network links network link benchmarks 07 June 2002

Grid Resources: Hierarchical GIS_top network paths connections hosts clusters services end points module execs host benchmarks network cards module sources batch queue routers switches network links Relationships parent, child (one -> many) switch benchmarks network link benchmarks alias (LDAP) or pointer (XML) 07 June 2002

Local control at Admin Domain Level -- similar to DNS requestor transformed XML doc 5. XSLT 1. Xpath query XML doc XPath XML doc 4. 2. 3. SQL LDAP XML db mySQL LDAP Local control at Admin Domain Level -- similar to DNS 07 June 2002

Areas of Overlap common schema start Entity Relationship schema diagram schema represented as Use cases to fuel benchmark queries transformed into relat- ional (mySQL) ldap (MDS) Grid GIS query benchmark XML (Xindice) 07 June 2002

ER diagram: Revised Network Topology nodes end points network compute paths A B C D type: switch, router E F AB AC AD BD CD … “give me all paths from A to E” G 07 June 2002