Managing Service Metadata as Context The 2005 Istanbul International Computational Science & Engineering Conference (ICCSE2005) Mehmet S. Aktas

Slides:



Advertisements
Similar presentations
Distributed Systems Major Design Issues Presented by: Christopher Hector CS8320 – Advanced Operating Systems Spring 2007 – Section 2.6 Presentation Dr.
Advertisements

Study of Hurricane and Tornado Operating Systems By Shubhanan Bakre.
BiodiversityWorld GRID Workshop NeSC, Edinburgh – 30 June and 1 July 2005 Resource wrappers, web services, grid services Jaspreet Singh School of Computer.
Web Services Composite Application Framework Mark Little
OASIS Reference Model for Service Oriented Architecture 1.0
Distributed components
Latest techniques and Applications in Interprocess Communication and Coordination Xiaoou Zhang.
Distributed Systems Fall 2009 Replication Fall 20095DV0203 Outline Group communication Fault-tolerant services –Passive and active replication Highly.
1 A Framework for Highly Available Services Based on Group Communication Alan Fekete Idit Keidar University of Sidney MIT.
Emerging Research Dimensions in IT Security Dr. Salar H. Naqvi Senior Member IEEE Research Fellow, CoreGRID Network of Excellence European.
.NET Mobile Application Development Introduction to Mobile and Distributed Applications.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
A Web Services Based Streaming Gateway for Heterogeneous A/V Collaboration Hasan Bulut Computer Science Department Indiana University.
23 September 2004 Evaluating Adaptive Middleware Load Balancing Strategies for Middleware Systems Department of Electrical Engineering & Computer Science.
QoS-enabled middleware by Saltanat Mashirova. Distributed applications Distributed applications have distinctly different characteristics than conventional.
A Scalable Framework for the Collaborative Annotation of Live Data Streams Thesis Proposal Tao Huang
THE NEXT STEP IN WEB SERVICES By Francisco Curbera,… Memtimin MAHMUT 2012.
Presenter: Dipesh Gautam.  Introduction  Why Data Grid?  High Level View  Design Considerations  Data Grid Services  Topology  Grids and Cloud.
5.1 Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.
DISTRIBUTED COMPUTING
Introduction: Databases and Database Users
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
International Telecommunication Union Geneva, 9(pm)-10 February 2009 ITU-T Security Standardization on Mobile Web Services Lee, Jae Seung Special Fellow,
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
Distributed Systems: Concepts and Design Chapter 1 Pages
© Oxford University Press 2011 DISTRIBUTED COMPUTING Sunita Mahajan Sunita Mahajan, Principal, Institute of Computer Science, MET League of Colleges, Mumbai.
Managing Dynamic Metadata and Context Mehmet S. Aktas Advisor: Prof. Geoffrey C. Fox.
Unit – I CLIENT / SERVER ARCHITECTURE. Unit Structure  Evolution of Client/Server Architecture  Client/Server Model  Characteristics of Client/Server.
RELATIONAL FAULT TOLERANT INTERFACE TO HETEROGENEOUS DISTRIBUTED DATABASES Prof. Osama Abulnaja Afraa Khalifah
Distributed File System By Manshu Zhang. Outline Basic Concepts Current project Hadoop Distributed File System Future work Reference.
- Ahmad Al-Ghoul Data design. 2 learning Objectives Explain data design concepts and data structures Explain data design concepts and data structures.
Advanced Computer Networks Topic 2: Characterization of Distributed Systems.
1 Advanced Software Architecture Muhammad Bilal Bashir PhD Scholar (Computer Science) Mohammad Ali Jinnah University.
IHE Profile – SOA Analysis: In Progress Update Brian McIndoe January 18, 2011.
Managing Dynamic Metadata and Context Mehmet S. Aktas.
1 Managing Dynamic Metadata and Context Mehmet S. Aktas Computer Science, Informatics, Pervasive Technology Laboratories Indiana University Bloomington.
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
Plethora: A Wide-Area Read-Write Storage Repository Design Goals, Objectives, and Applications Suresh Jagannathan, Christoph Hoffmann, Ananth Grama Computer.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Information Technology Needs and Trends in the Electric Power Business Mladen Kezunovic Texas A&M University PS ERC Industrial Advisory Board Meeting December.
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 30 – Media Server (Part 5) Klara Nahrstedt Spring 2009.
Web Service Resource Framework WSMO Presentation Jos de Bruijn Digital Enterprise Research Institute http ://
1 G52IWS: Web Services Chris Greenhalgh. 2 Contents The World Wide Web Web Services example scenario Motivations Basic Operational Model Supporting standards.
Course: COMS-E6125 Professor: Gail E. Kaiser Student: Shanghao Li (sl2967)
© 2004 IBM Corporation ICSOC2004 Panel Discussion: Grid Systems: What is needed from web service standards? Jeffrey Frey IBM.
The IEEE International Conference on Cluster Computing 2010
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Managing Metadata in Service Architectures Mehmet S. Aktas Advisor: Prof. Geoffrey C. Fox.
Information Federation in Grid Information Services Mehmet S. Aktas Advisor: Prof. Geoffrey C. Fox Ph.D. Defense Exam May 3, 2007.
Problem On a regular basis we use: –Java applets –JavaScript –ActiveX –Shockwave Notion of ubiquitous computing.
Dsitributed File Systems
1 Web Service Information Systems and Applications GGF16 Semantic Grid Workshop Athens Greece February Geoffrey Fox Computer Science, Informatics,
Distributed File System. Outline Basic Concepts Current project Hadoop Distributed File System Future work Reference.
Scaling and Fault Tolerance for Distributed Messages in a Service and Streaming Architecture Hasan Bulut Advisor: Prof. Geoffrey Fox Ph.D. Defense Exam.
Cloud-based movie search web application with transaction service Group 14 Yuanfan Zhang Ji Zhang Zhuomeng Li.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Service Oriented Architecture (SOA) Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Chapter 1 Characterization of Distributed Systems
Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.
Hasan Bulut Scaling and Fault Tolerance for Distributed Messages in a Service and Streaming Architecture Hasan Bulut
Computer Science Department
Grid Services B.Ramamurthy 12/28/2018 B.Ramamurthy.
Service Oriented Architecture (SOA)
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Information Services for Dynamically Assembled Semantic Grids
Database System Architectures
Presentation transcript:

Managing Service Metadata as Context The 2005 Istanbul International Computational Science & Engineering Conference (ICCSE2005) Mehmet S. Aktas Computer Science Department INDIANA

2 of 17 Outline  Introduction  Problem Statement, Hypothesis, Design Goals  Literature Survey, Research Issues  Milestones  Summary

3 of 17 Context in Gaggle of Services  Def: "Context is any information that can be used to characterize the situation of an entity, where an entity can be a person, place, or computational object.“ Dey A. et al, 1999  Context is metadata associated to both services and their activities  independent of any interaction  static context, dynamic context  generated as result of interaction  information associated to an activity or session  Gaggle of Services are set of actively collaborating managed services for a particular common goal generate events as result of interactions are very small part of the whole Grid

4 of 17 Motivations  Current Grid Information Services provide information describing services independent of their interactions.  We need management of all information associated with services for; correlating activities of widely distributed services management of events especially in multimedia collaboration enabling uniform query capabilities to both conversation- based or monolog context information  “Give me list of services satisfying C:{a,b,c..} QoS requirements and participating S:{x,y,z..} sessions” providing information to enable  real-time replay/playback and  session failure recovery capabilities

5 of 17 Application Use Domain  Workflow-style distributed application: Geographic Information System Grid sensor grid data services generates events when a certain magnitude event occurs firing off various codes, filtering, analyzing raw data, generating images, maps needs a distributed context management to correlate workflow activities  Characteristics of domain any number of widely distributed services can be involved conversation metadata  transient  multiple writers

6 of 17 Problem Statement What is a novel process of building Information Services, maintaining dynamic session-related metadata of widely distributed services, providing uniform interface to both interaction-independent and conversation-based context?

7 of 17 Hypothesis  A fault-tolerant, high performance, scalable information system maintaining widely distributed dynamically generated metadata for Gaggle of Services providing uniform interface to context information  utilization of existing Grid Information Services for interaction-independent context to improve search capabilities enabling coordination of widely distributed services in Gaggles  workflow-style Grid applications enabling distributed event management and various capabilities for A/V conferencing applications  discovery of entities in a session  enabling playback/replay capabilities,  enabling session failure recovery

8 of 17 Architectural Design Goals  Key Design Goals of our Design scalability  with respect to #  widely distributed services performance  high responsiveness, reduced access latency fault tolerance  high availability of information  robust to replica crashes flexibility  accommodate broad range of application domains  read-dominated, read/write dominated

9 of 17 WS-CAF WS-Context - Key Concepts  WS Composite Application Framework (WS-CAF) WS-Context, WS-Coordination, WS-Transaction Mngmt.  WS Context defines context, context service and mapping on SOAP shared data to correlate service activities context information dependent on the type of the activity  transactional activity: the URI of the coordinator in a session context service maintains associated context participants of an activity register with context service for lifecycle of that activity

10 of 17 WSRF, WS-Metadata Exchange Key Concepts  WSRF (Web Service Resource Framework) defines standard interfaces and behaviors for distributed system integration enables every service to expose state data for query, update supports resource oriented approach for stateful interactions  WS-Metadata Exchange provides mechanism for sharing information about the capabilities of individual Web services  WS-Policy, WSDL allows querying a WS Endpoint to retrieve metadata about what to know to interact with them defines request/response message pairs to retrieve WS metadata

11 of 17 Limitations in Specifications for Service Communication  WSRF does not actually accomplish state management by just enabling access and update rights heterogeneous service environment workflow-style applications  WSRF, WS-Metadata Exchange models service metadata private to a service does not scale in managing activities of multiple services WS-Metadata Exchange defines only how to access interaction-independent metadata  WS-Context is promising it has limitations simple framework for context management limited query capability does not address distributed management aspects of context metadata

12 of 17 Research Issues  Recap on key design goals: scalability, performance, fault tolerance  research issues related replicating dynamic metadata deployment (dynamic vs. static replication)  Where to place replicas of given context metadata?  What are the properties of new location must meet?  How to know if replica location stable?  How can we provide tailored replication based on R/W properties?

13 of 17 Research Issues II consistency  What is the appropriate consistency model?  How do replicas exchange replica updates in what direction?  performance efficient metadata access  How to choose a replica server to best serve client request?  How to avoid performance degradation due to repetitive queries?

14 of 17 Research Issues III  scalability load balancing strategies  How to manage load balancing?  other research issues session recovery  How to enable session recovery? uniform interface to context  How to provide a uniform interface to context?

15 of 17 Milestones  Uniform Update and Query (search, discovery) Services  Sequencer Service ensures that an order is imposed on actions/events that take place in a session

16 of 17 Milestones II  Storage (Replication) Service decide # and placement of replicas enable autonomous behavior support robust behavior for replica crashes  Access (Request Distribution) Service distribute request among object replicas  Expeditor Service generalized caching mechanism reduce storage access due to repetitive queries

17 of 17 Summary  Here we addresses following problems Lack of support in Grid Information Services for context (session-related dynamic metadata) management to correlate activities in workflow-style applications:  by providing a novel approach for management of widely distributed, shared session-related dynamic metadata Lack of support in Grid Information Services to provide distributed session management:  by providing distributed event management system enabling session failure recovery or replay/playback capabilities Lack of search capabilities in Grid Information Services:  by providing uniform search interface to both interaction independent and conversation-based context enabling service discovery through events