Service Proforma Middleware Workshop. Notes Please complete as much of this proforma as possible – it will help make the workshop more informative & productive.

Slides:



Advertisements
Similar presentations
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Advertisements

Service Proforma Middleware Workshop. Notes Please complete as much of this proforma as possible – it will help make the workshop more informative & productive.
WS-JDML: A Web Service Interface for Job Submission and Monitoring Stephen M C Gough William Lee London e-Science Centre Department of Computing, Imperial.
31242/32549 Advanced Internet Programming Advanced Java Programming
Web Service Ahmed Gamal Ahmed Nile University Bioinformatics Group
Grid Quality of Service and Service Level Agreements Karim Djemame University of Leeds.
SOA and Web Services. SOA Architecture Explaination Transport protocols - communicate between a service and a requester. Messaging layer - enables the.
Dorian Grid Identity Management and Federation Dialogue Workshop II Edinburgh, Scotland February 9-10, 2006 Stephen Langella Department.
Adapted from: ©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Fly-over Introduction Purpose of Database Systems View of Data Data.
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Purpose of Database Systems View of Data Data Models Data Definition.
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Purpose of Database Systems View of Data Data Models Data Definition.
Ch 12 Distributed Systems Architectures
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Database Management Systems Purpose of Database Systems View of Data.
UMIACS PAWN, LPE, and GRASP data grids Mike Smorul.
1 Classification: Genpact Internal.  Tool From Oracle  Works with Oracle Database  PL/SQL Based  Widely Used with Oracle Applications  Can be Used.
Chapter 10 Architectural Design
Workflow Management Chris A. Mattmann OODT Component Working Group.
ADVANCED DATABASES WITH ORACLE 11g FOR ADDB7311 LEARNING UNIT 1 of 7.
Introduction to Databases
Metadata Harvesting The Hague, 13 & 14 January 2009 Julie Verleyen Scientific Coordinator, Europeana Office EuropeanaLocal Knowledge Sharing Workshop.
Resource Management and Accounting Working Group Working Group Scope and Components Progress made Current issues being worked Next steps Discussions involving.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting June 13-14, 2002.
World Class Standards CCIF New York - April Grids, Clouds and Service Infrastructures ETSI Strategy & New Initiatives.
London e-Science Centre Imperial College London Making the Grid Pay Economic Services - Pricing and Payment William Lee.
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
20 October 2006Workflow Optimization in Distributed Environments Dynamic Workflow Management Using Performance Data David W. Walker, Yan Huang, Omer F.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Computer Emergency Notification System (CENS)
EGEE Catalogs Peter Kunszt EGEE Data Management Middleware Service Grids NeSC, July 2004 EGEE is a project funded by the.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Purpose of Database Systems View of Data Data Models Data Definition.
Chapter 10 Intro to SOAP and WSDL. Objectives By study in the chapter, you will be able to: Describe what is SOAP Exam the rules for creating a SOAP document.
Walk through the reporting process for Barcelona Convention using Reportnet Miruna Badescu, Giuseppe Aristei.
Grid Services I - Concepts
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
Service Proforma Middleware Workshop. Notes Please complete as much of this proforma as possible – it will help make the workshop more informative & productive.
SEE-GRID-SCI The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no.
A university for the world real R © 2009, Chapter 9 The Runtime Environment Michael Adams.
ECI – electronic Commerce Infrastructure “ An application to the Shares Market ” Demetris Zeinalipour ( Melinos Kyriacou
GBIF Data Access and Database Interoperability 2003 Work Programme Overview Donald Hobern, GBIF Programme Officer for Data Access and Database Interoperability.
June 25, 2007 WORKS 07, HPDC 07, Monterey Bay California, June GRIDCC: Real-time Workflow system A.Stephen McGough, Asif Akram, Li Guo, Marko Krznaric,
Jini Architecture Introduction System Overview An Example.
Predictable Workflow Deployment Service Stephen M C Gough Ali Afzal, Anthony Mayer, Steven Newhouse, Laurie Young London e-Science Centre Department of.
RUS: Resource Usage Service Steven Newhouse James Magowan
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
Service Proforma Middleware Workshop. Notes Please complete as much of this proforma as possible – it will help make the workshop more informative & productive.
1 G52IWS: Web Services Chris Greenhalgh. 2 Contents The World Wide Web Web Services example scenario Motivations Basic Operational Model Supporting standards.
CDDLM on HP SmartFrog Middleware Workshop. Service: CDDLM Distributed Deployment Framework HPL implementation of GGF CDDLM WG – (and.
1 OGSA-DAI: Service Grids Neil P Chue Hong. 2 Motivation  Access to data is a necessity on the Grid  The ability to integrate different data resources.
Workflow Enactment in ICENI Dr Andrew Stephen M C Gough Laurie Young, Ali Afzal, Steven Newhouse and John Darlington London e-Science Centre 2 nd September.
The GT 4 GRAM Service Sam Meder Middleware Workshop.
Database System Concepts Introduction Purpose of Database Systems View of Data Data Models Data Definition Language Data Manipulation Language Transaction.
©Silberschatz, Korth and Sudarshan 1.1 Database System Concepts قواعد البيانات Data Base قواعد البيانات CCS 402 Mr. Nedal hayajneh E- mail
Chapter 1 Overview of Databases and Transaction Processing.
From Coulouris, Dollimore, Kindberg and Blair Distributed Systems: Concepts and Design Edition 5, © Addison-Wesley 2012 Slides for Chapter 9 Web Services.
B2access.eudat.eu B2ACCESS User Training How to register with B2ACCESS Version 1 February 2016 This work is licensed under the Creative Commons.
18 May 2006CCGrid2006 Dynamic Workflow Management Using Performance Data Lican Huang, David W. Walker, Yan Huang, and Omer F. Rana Cardiff School of Computer.
CDDLM on HP SmartFrog Middleware Workshop. Service: CDDLM Distributed Deployment Framework HPL implementation of GGF CDDLM WG – (and.
BOF-1147, JavaTM Technology and WebDAV: Standardizing Content Management Java and WebDAV Juergen Pill Team Leader Software AG Remy Maucherat Software Engineer.
Chapter 1: Introduction
OGSA Data Architecture Scenarios
Wide Area Workload Management Work Package DATAGRID project
Software Engineering System Modeling Chapter 5 (Part 1) Dr.Doaa Sami
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
Presentation transcript:

Service Proforma Middleware Workshop

Notes Please complete as much of this proforma as possible – it will help make the workshop more informative & productive for us all. If you will be talking about more than one service feel free to add an overall architecture diagram showing the relationship between services. Also, please provide a motivation slide for developing/using the service set.

Service: ICENI End to end Grid middleware. Providing Launching, Scheduling, Reservation and inter-application communication. –URL: –Licence: ICENI, based on Sun open source licence –Support: Web site / mailing list SOA Model:Jini

Service: Scheduling Takes workflow (Execution Plan) and Job descriptions (JDML) and determines the best place to deploy on the grid.

Service Operations: Scheduling operation name: launchJob –Description: Takes a workflow, determines where to run each component within it and deploys over the Grid. –IN: XML document, either Execution Plan (workflow) or JDML (single job) –OUT: Concrete Execution Plan (XML) detailing where the component (job) has been launched to.

Service Operations: Scheduling operation name: generateQuote –Description: Takes a workflow, determines where to run each component within it and inform requester of this decision. –IN: XML document, either Execution Plan (workflow) or JDML (single job) –OUT: Concrete Execution Plan (XML) detailing where the component (job) would be launched to.

Service: Performance Provides performance information. Collects performance information. Processes performance information.

Service Operations: Performance operation name: register –Description: Register an application for monitoring while it runs. –IN: String name for the job. –OUT: String, unique id for the performance monitoring

Service Operations: Performance operation name: addEP –Description: Takes a workflow for an application and records it for use later on (processing). –IN: XML: Concrete Execution Plan (workflow), unique id provided by register –OUT: null

Service Operations: Performance operation name: getActivityTime –Description: Request information from the Performance repository about how long an activity is expected to take. –IN: Component description, Resource description and activity name. (string) –Optional IN: Share count, Problem specific characteristics (name value pairs) –OUT: Either a single time value or a set of timings if optional values not used.

Service Operations: Performance operation name: getProblemCharacteristics –Description: Find out what problem space characteristics (and types) can be used for a given case. –IN: Component description (string) –OUT: Set of name type pairings.

Service Operations: Performance operation name: Performance Events –Description: Events generated by applications listened to by the Performance Service. –Data Structure: Unique id for the performance monitoring of the application, Component, Time, Resource, type of event (start, port or internal)

Service: Launching Provides an abstract interface for launching jobs onto resources.

Service Operations: Launching operation name: launchJob –Description: Takes a job description JDML and launches it on a resource controlled by this service. –IN: XML document JDML –OUT: XML document describing if job launched successfully.

Service Operations: Launching operation name: getResources –Description: Returns a set of resource id’s that this service can deploy onto. –IN: User Credentials (optional). –OUT: Set of resource id’s. If a user certificate was provided then only resources the user can use are returned.

Service Operations: Launching operation name: getResourceDescription –Description: Returns a full description of the resource. –IN: The id of the resource, User Credentials (optional) –OUT: XML document describing the Resource. Empty if user not allowed to access or resource doesn’t exist.

Service Operations: Launching operation name: getResourceAttribute –Description: Request a single attribute about a resource. –IN: Resource id, attribute name and User Credentials (optional). –OUT: String (may be XML doc) for the named attribute. Empty if resource/attribute is not found or user doesn’t have access.

Service Operations: Launching operation name: getLocations –Description: Returns a human readable list of the names of the resources. –IN: User Credentials (optional). –OUT: List of names. If user credentials used only those the user can access are returned.

Service: Launching with Reservation Provides access to reservation services of resources exposed through a launcher.

Service Operations: Launching with Reservation operation name: createReservation –Description: Create a reservation with a resource. –IN: Agreement document (XML) –OUT: The modified Agreement document and a reservation id.

Service Operations: Launching with Reservation operation name: renegotiateAgreement –Description: Attempt to modify an agreement. –IN: Agreement document (XML). –OUT: Agreement document (XML) either conforming change or offering an alternative.

Service Operations: Launching with Reservation operation name: cancelReservation –Description: Cancel a previously made agreement. –IN: The reservation id. –OUT: XML indicating success or failure.

Service Operations: Launching with Reservation operation name: createHold –Description: Create a time limited reservation that will expire if not confirmed in time. –IN: Agreement document (XML) –OUT: Modified Agreement document and a Hold identity

Service Operations: Launching with Reservations operation name: confirmHold –Description: Convert a hold into a permanent reservation. –IN: The hold id. –OUT: XML conformation of success/failure.

Service Operations: Launching with Reservations operation name: cancelHold –Description: Cancel a hold. –IN: The hold id. –OUT: XML conformation of success/failure.

Service Operations: Reservations operation name: makeReservation –Description: Takes a concrete workflow (Execution Plan) and attempts to reserve all the required resources. –IN: XML document Execution Plan (workflow). –OUT: Execution Plan (XML) detailing the reservations made.

Service Operations: Reservations operation name: cancelReservation –Description: Takes a resource id and reservation id and cancels it. These can be found in XML document returned from makeReservation. –IN: resource id, reservation id. –OUT: XML conformation of success/failure

Service: Reservation Engine Allows abstract access to the low level DRM specific reservation functionality.

Service Operations: Reservation Engine operation name: makeReservation –Description: Takes XML reservation request (user credentials, interval) and attempts to reserve. –IN: XML document – Reservation Request. –OUT: Modified Reservation Request, either confirming details or offering an alternative.

Service Operations: Reservation Engine operation name: cancelReservation –Description: Takes a reservation id and attempts to cancel it. –IN: Reservation id. –OUT: XML conformation of success/failure.

Service Operations: Reservation Engine operation name: makeHold –Description: Make a time limited reservation. –IN: XML reservation request (user credentials, interval). –OUT: Modified Reservation Request, either confirming details or offering an alternative.

Service Operations: Reservation Engine operation name: cancelHold –Description: Cancel a hold. –IN: Hold id. –OUT: XML conformation of success/failure.

Service Operations: Reservation Engine operation name: confirmHold –Description: Convert a hold into a normal reservation. –IN: Hold id. –OUT: XML conformation of success/failure.

What do you use to build your service? (i.e. How ‘standard’ is your service?) NB:A low score means less risk & more mainstream Widely Implemented Standard Specification (1pt) – Implemented draft specification (2pt) – Implemented draft specification (3pt) –<Specification in standards body but alternatives exist. Industry is divided. One/few implementations exist. (e.g., Transactions, coordination, notification, etc.). Implemented proposal (4pt) –An implementation of an idea, a proposal but not submitted to standards body yet (e.g., WS-Addressing, WS-Trust, etc.) Non-implemented proposal (5pt) – Concept (6pt) – TOTAL: JINI, 1pt, Concept 6pt = 7pt.

Service Dependencies What else does your service depend on (i.e. external dependencies)? –Logging : Java Logging What does your implementation depend on? –Languages : Java –JINI based.

AAA & Security What authentication mechanism do you use? –X509 certificates based. What authorisation mechanism do you use? –From JINI infrastructure. What accounting mechanism do you use? –None at present. Does service interaction need to be encrypted? If these are not used now, will they be in the future?

Exploiting the Service Architecture What features from your ‘plumbing’ do you use in your service? –Event notification –Meta-data –Registry discovery/advertisement

Service Activity Multiple interaction or single user? –Multiple interaction Throughput (1/per day or 100/per second?) –~ 10/per min. Typical data volume moved in Typical data volume moved out –Depends on job.

Service Failure Required Reliability –Failure semantics? Positive ack Required Persistence –No current persistence. Required Availability –One of many.

Required Service Management Remote access to: –Performance –Progress (limited at present).