15 April 2003 Registry Workgroup Meeting University of Leicester Astrogrid Registry Elizabeth Auden Astrogrid Registry Workgroup Iteration 2 Workgroup.

Slides:



Advertisements
Similar presentations
MQ Series Cross Platform Dominant Messaging sw – 70% of market Messaging API same on all platforms Guaranteed one-time delivery Two-Phase Commit Wide EAI.
Advertisements

SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
3 September 2004NVO Coordination Meeting1 Grid-Technologies NVO and the Grid Reagan W. Moore George Kremenek Leesa Brieger Ewa Deelman Roy Williams John.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
SDM center All-hands breakout session notes March 2002 Gatlinburg TN.
C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.
VAMDC Registry Portal Proof of Concept. Registry VAMDC Registry is available at – ex.jsp
System Design and Memory Limits. Problem  If you were integrating a feed of end of day stock price information (open, high, low, and closing price) for.
19-20 March 2003 IVOA Registry Workgroup LeSc Astrogrid Registry: Early Designs Elizabeth Auden Astrogrid Registry Workgroup Leader IVOA Registry Workgroup.
Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Introduction to Web services MSc on Bioinformatics for Health Sciences May 2006 Arnaud Kerhornou Iván Párraga García INB.
GGF Toronto Spitfire A Relational DB Service for the Grid Peter Z. Kunszt European DataGrid Data Management CERN Database Group.
1 Database Systems Implementation Introduction. 2 First, some History Many techniques have their roots in two early systems (1970s):  INGRES (Berkeley)
Service Broker Lesson 11. Skills Matrix Service Broker Service Broker, provides a solution to common problems with message delivery and consistency that.
DAT304 Leveraging XML and HTTP with Sql Server Irwin Dolobowsky Program Manager Webdata Group.
Data Integration in Service Oriented Architectures Rahul Patel Sr. Director R & D, BEA Systems Liquid Data – XML-based data access and integration for.
2003 April 151 Data Centres: Connecting to the Real World Clive Page.
9 Chapter Nine Extracting and Transforming Data with SQL Server 2000.
Lecture 7 Interaction. Topics Implementing data flows An internet solution Transactions in MySQL 4-tier systems – business rule/presentation separation.
XML Overview. Chapter 8 © 2011 Pearson Education 2 Extensible Markup Language (XML) A text-based markup language (like HTML) A text-based markup language.
Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.
Dynamic Data Exchanges with the Java Flow Processor Presenter: Scott Bowers Date: April 25, 2007.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
Introduction on R-GMA Shi Jingyan Computing Center IHEP.
AstroGrid AstroGrid increases scientific research possibilities by : enabling access to distributed astronomical data and information resources. providing.
DUCKS – Distributed User-mode Chirp- Knowledgeable Server Joe Thompson Jay Doyle.
AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
RELATIONAL FAULT TOLERANT INTERFACE TO HETEROGENEOUS DISTRIBUTED DATABASES Prof. Osama Abulnaja Afraa Khalifah
10/25/20151 Single Sign-On Web Service Supervisors: Viktor Kulikov Alexander Sherman Liana Lipstov Pavel Bilenko.
ICDL 2004 Improving Federated Service for Non-cooperating Digital Libraries R. Shi, K. Maly, M. Zubair Department of Computer Science Old Dominion University.
Implementing the XDS Infrastructure Bill Majurski IT Infrastructure National Institute of Standards and Technology.
The Project The Virtual Observatory Technical Progress Andy Lawrence Nottingham All-Hands meeting Sept 2003 AstroGrid
A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.
AgINFRA science gateway for workflows and integrated services 07/02/2012 Robert Lovas MTA SZTAKI.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
A university for the world real R © 2009, Chapter 9 The Runtime Environment Michael Adams.
Metadata Mòrag Burgon-Lyon University of Glasgow.
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
GBIF Data Access and Database Interoperability 2003 Work Programme Overview Donald Hobern, GBIF Programme Officer for Data Access and Database Interoperability.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE User Forum, Manchester, 10 May ‘07 Nicola Venuti
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
A PPARC funded project Workflow in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.
Web Services from 10,000 feet Part I Tom Perkins NTPCUG CertSIG XML Web Services.
Feb 24-27, 2004ICDL 2004, New Dehli Improving Federated Service for Non-cooperating Digital Libraries R. Shi, K. Maly, M. Zubair Department of Computer.
REGISTRY WORKGROUP Brief: The registry group has been working on a registry query web service, AstroLog, and AstroMQ. Progress: The registry group has.
By J Swetha ( ) V V Aishwarya ( ).
XML 1. Chapter 8 © 2013 Pearson Education, Inc. Publishing as Prentice Hall SAMPLE XML SCHEMA (XSD) 2 Schema is a record definition, analogous to the.
Review of PARK Reflectometry Group 10/31/2007. Outline Goal Hardware target Software infrastructure PARK organization Use cases Park Components. GUI /
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
MQ Series Cross Platform Dominant Messaging sw – 70% of market
WEB IVR SMS WAP USSD One Picture to Understand USDP What is USDP … …
MSSL Astrogrid Workshop
Open Source distributed document DB for an enterprise
CERN-Russia Collaboration in CASTOR Development
Lecture 1: Multi-tier Architecture Overview
Tiers vs. Layers.
MQ Series Cross Platform Dominant Messaging sw – 70% of market
Gordon Erlebacher Florida State University
SDMX IT Tools SDMX Registry
Presentation transcript:

15 April 2003 Registry Workgroup Meeting University of Leicester Astrogrid Registry Elizabeth Auden Astrogrid Registry Workgroup Iteration 2 Workgroup Meeting University of Leicester 15 April 2003

15 April 2003 Registry Workgroup Meeting University of Leicester Registry XML formatted queries processed for any registry services Technology: web services (soap), DB2 (database), XPath / XQuery (XML parsing) 4 service types (so far): data provider, data storage, data transformation, other registries Registry services perform query parsing and query processing Web Service Query: XPath Astrogrid Portal Registry Database: DB2 Data Archive Data Storage Data Transformation Distributed Network of Registries Job Control Data Mover Work Flow *** Registry use cases implemented through different SQL queries, not different service methods ***

15 April 2003 Registry Workgroup Meeting University of Leicester AstroLog XML formatted messages to be queued or stored Technology: XMLBlaster (maybe???) Message Queue: queue job, user, and community messages Message Log (queue with database persistence): store job, user, and community messages Components send message to MQ: MQ delivers messages to destination component and AstroLog AstroLog: persistent message storage in a database Log Queue ASTRO MQ Interface

15 April 2003 Registry Workgroup Meeting University of Leicester Use Cases: Registry 1.Look up community log: Receive request to look up community log from portal. Look up and return community log to portal. 2.Look up dataset provider: Receive request to look up datasets for the Workflow Controller. Look up and return metadata about dataset provider. 3.Store messages: Receive and store message from Job Controller. 4.Look up data locations: Receive request to look up data locations from Data Mover. Look up and return data locations to Data Mover. 5.Look up dataset details: Receive request to look up dataset details (such as UCDs) from Job Scheduler. Look up and return dataset details to Job Scheduler. 6.Receive queries: Query parser receives xml-formatted query from Portal. Convert XML query to SQL statement and execute SQL statement. 7.Build and send XML responses: Send SQL response to query response parser. Reformat SQL response as XML formatted response and send to Portal. 8.Registry database query: Execute SQL query on registry database.

15 April 2003 Registry Workgroup Meeting University of Leicester Use Cases: AstroLog 1.Store messages: Store messages from the Job Controller, Dataset, or VOTable Catenation on the AstroLog. 2.Look up messages: Receive request from Portal to look up messages. Look up and return messages to the Portal.

15 April 2003 Registry Workgroup Meeting University of Leicester Interfaces: Provide I. Service Registry 1.Portal: look up community log 2.Workflow: look up datasets 3.Data Mover: look up locations 4.Job Scheduler: look up dataset details II. AstroLog 1.Job Control: store messages 2.Dataset (data provider?): store messages 3.VOTable Catenation: store messages 4.Job Monitor: store messages 5.Portal: look up and store messages Registry Interface: receive query, return response AstroLog Interface: store message, look up message

15 April 2003 Registry Workgroup Meeting University of Leicester Interfaces: Consume I. Service Registry 1.Portal: Registry query request 2.Workflow: Dataset query request 3.Data Mover: Dataset locations query request 4.Job Scheduler: Dataset details query request II. AstroLog 1.Job Control: Store message request 2.Dataset (data provider?): Store message request 3.VOTable Catenation: Store message request 4.Job Monitor: Store message request 5.Portal: Store and look up message request

15 April 2003 Registry Workgroup Meeting University of Leicester Registry Class Diagram Interfaces: Registry Interface Classes: QueryParser, ServiceRegistry Methods: xmlToSQL, sqlToXML, parseQuery, processQuery

15 April 2003 Registry Workgroup Meeting University of Leicester AstroLog Class Diagram Interfaces: AstroLog Interface Classes: AstroLog, Message Methods: storeMessage, lookUpMessage

15 April 2003 Registry Workgroup Meeting University of Leicester Registry: 23/04 – 06/06 23/04 – 25/04 Determine query format /05 – 06/06 AstroMQ use cases 5 06/05 – 09/05 DB2: process / return SQL / /06 Registry use cases 4 09/05 – 19/05 Populate DB2 with real data /05 – 29/05 Web service: look up message /05 – 26/05 Web service: store message /05 – 19/05 Web service: process query /04 – 07/05 Web service: xmlToSQL /05 – 20/05 message log /05 – 15/05 message queue /04 – 30/04 Web service: query to parser /04 – 28/04 AstroMQ Interface /04 – 28/04 Registry Interface /04 – 30/04 Determine Metadata: Dataset Dataset details Data location Messages – job Messages - user /04 – 06/05 Set up DB2 with Metadata: Dataset Dataset details Data location Messages – job Messages - user /05 – 13/05 Web service: sqlToXML 2.4 Elizabeth Pedro Elizabeth Peter, Pedro Elizabeth Peter, Pedro Elizabeth Peter, Pedro Elizabeth Roy Peter Pedro Peter Pedro Peter Pedro Peter Pedro Peter Pedro Elizabeth Peter, Roy Elizabeth Peter Elizabeth Peter Elizabeth Roy Elizabeth Roy /04 – 08/05 Evaluate MQ systems 3.2 Peter Pedro 7

15 April 2003 Registry Workgroup Meeting University of Leicester Registry WSDL WSDL available on wiki (later this morning): RegistryQueryService: parseQuery(String query) QueryParserService: xmlToSQL(String xmlQuery), sqlToXML(String sqlQuery) ProcessQueryService: processQuery(String sqlQuery) AstroLogService: storeMessage(String message), lookUpMessage(String messageDetails) Other stuff available on wiki (later this morning): Registry It02 Together project Sequence diagram gifs Class diagram Iteration network chart (Gantt chart if / when I get MSProject sorted out)