Mike Jackson EPCC OGSA-DAI Today – Release 8 OGSA-DAI Tutorial GGF17, Tokyo.

Slides:



Advertisements
Similar presentations
1 OGSA-DAI Platform Dependencies Malcolm Atkinson for OMII SC 18 th January 2005.
Advertisements

MIT Lincoln Laboratory A Service-Oriented Approach to Application Development Robert Darneille & Gary Schorer WPI MQP Presentations ICS Group 10 October.
Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
An Overview of OGSA-DAI Kostas Tourlas
Michael Pizzo Software Architect Data Programmability Microsoft Corporation.
BiodiversityWorld GRID Workshop NeSC, Edinburgh – 30 June and 1 July 2005 Resource wrappers, web services, grid services Jaspreet Singh School of Computer.
GridFTP: File Transfer Protocol in Grid Computing Networks
Amy Krause Applications Consultant, EPCC Tom Sugden Applications Consultant, EPCC OGSA-DAI Client Toolkit Principles.
Inside Data Access with SQLXML: Architecture Guide Rolandas Gricius MCT, MCSE, MCSD Adapted From.
Inside the GDS The Engine, Activities, Data Resource Implementations and Role Mapping EPCC, University of Edinburgh Tom Sugden First.
Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.
1 An Introduction to OGSA-DAI Konstantinos Karasavvas 13 th September 2005.
Writing Perform Documents EPCC, University of Edinburgh Amy Krause ( Tom Sugden First International Summer.
Apache Tomcat Server Typical html Request/Response cycle
Mike Jackson EPCC OGSA-DAI Today Release 2.2 Principles and Architectures for Structured Data Integration: OGSA-DAI.
17 July 2006ISSGC06, Ischia, Italy1 Agenda Session 26 – 14:30-16:00 An Overview of OGSA-DAI OGSA-DAI today – and future features How to extend OGSA-DAI.
Transaction log grows unexpectedly
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
CVSQL 2 The Design. System Overview System Components CVSQL Server –Three network interfaces –Modular data source provider framework –Decoupled SQL parsing.
Using Opal to deploy a real scientific application as a Web service Sriram Krishnan
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
© Geodise Project, University of Southampton, Data Management in Geodise Jasmin Wason, Zhuoan Jiao and Marc Molinari Engineering.
1 OGSA-DAI: Status and Future Plans Neil Chue Hong.
OGSA-DAI: Future Work and Wrap-up The OGSA-DAI Team
Database Architecture Introduction to Databases. The Nature of Data Un-structured Semi-structured Structured.
Accounting for the Grid Usage Records and a Resource Usage Service.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
ES Metadata Management Enabling Grids for E-sciencE ES metadata OGSA-DAI NA4 GA Meeting, D. Weissenbach, IPSL, France.
Introduction to SEQUEL. What is SEQUEL? Acronym for Structural English Query Language Acronym for Structural English Query Language Standard language.
Ashwani Roy Understanding Graphical Execution Plans Level 200.
OGSA-DAI Architecture The OGSA-DAI Team
CVSQL 2 The Revenge of the SQL. The present Read-only access to CVS repository logs Language is a subset of SQL XML interface for returning results Built-in.
An Introduction to HDInsight June 27 th,
DAIT (DAI Two) NeSC Review 18 March Description and Aims Grid is about resource sharing Data forms an important part of that vision Data on Grids:
OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh.
1 1 EPCC 2 Curtin Business School & Edinburgh University Management School Michael J. Jackson 1 Ashley D. Lloyd 2 Terence M. Sloan 1 Enabling Access to.
Web: OGSA-DAI 3.0 Ally Hume, Amy Krause OGSA-DAI Workshop 17th October 2007.
Lattice QCD Data Grid Middleware: status report M. Sato, CCS, University of Tsukuba ILDG6, May, 12, 2005.
A Brief Documentation.  Provides basic information about connection, server, and client.
Wrapping Scientific Applications As Web Services Using The Opal Toolkit Wrapping Scientific Applications As Web Services Using The Opal Toolkit Sriram.
OGSA-DAI.
Data access and integration with OGSA-DAI: OGSA-DQP Steven Lynden University of Manchester.
INFSO-RI Enabling Grids for E-sciencE OGSA DAI Data Access and Integration Marek Ciglan Institute of Informatics, Slovac Academy.
The OGSA-DAI Client Toolkit The OGSA-DAI Team
Mike Jackson EPCC OGSA-DAI Architecture + Extensibility OGSA-DAI Tutorial GGF17, Tokyo.
OGSA-DAI Presented by Mike Mineter (Most) slides from Neil Chue-Hong (EPCC)
Metadata Mòrag Burgon-Lyon University of Glasgow.
OGSA-DAI Neil Chue Hong 29 th January 2007 OGF19, Chapel Hill.
Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI Technology Update GGF17, Tokyo (Japan)
- Joiner Transformation. Introduction ►Transformations help to transform the source data according to the requirements of target system and it ensures.
Lundi 7 décembre 2015 Lavoisier. Motivations data sources provided by many partners –heterogeneity of used technologies objectives –reduce complexity.
1 OGSA-DAI Status Report Neil P Chue Hong 20 th May 2005.
INT-2: XQuery Levels the Data Integration Playing Field Carlo (Minollo) Innocenti DataDirect XML Technologies, Program Manager.
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
Neil Chue Hong Project Manager, EPCC OGSA-DAI Status and Benchmarks All Hands Meeting 2005 Nottingham, 22 September.
DEV332 Programming for the Middle Tier in Visual Basic.NET Billy Hollis Author / Consultant.
Java Programming: Advanced Topics 1 Enterprise JavaBeans Chapter 14.
Stored Procedures / Session 4/ 1 of 41 Session 4 Module 7: Introducing stored procedures Module 8: More about stored procedures.
1 OGSA-DAI: Service Grids Neil P Chue Hong. 2 Motivation  Access to data is a necessity on the Grid  The ability to integrate different data resources.
Amy Krause EPCC Profiling OGSA-DAI Performance OGSA-DAI Technology Update GGF17, Tokyo (Japan)
DataGrid is a project funded by the European Commission EDG Conference, Heidelberg, Sep 26 – Oct under contract IST OGSI and GT3 Initial.
OGSA-DQP Steven Lynden University of Manchester. Data access & integration with OGSA-DAI: GGF 17 2 Introduction OGSA-DQP is a service based distributed.
SQL Basics Review Reviewing what we’ve learned so far…….
Apache Cocoon – XML Publishing Framework 데이터베이스 연구실 박사 1 학기 이 세영.
OGSA-DAI Current Version Guy Warner.
OGSA-DAI.
DAT 400 Inside Data Access with SQLXML: Architecture Guide Alexander Vaschillo Lead Program Manager WebData XML Group Microsoft Corporation.
Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI on OMII 2.0 OMII The Open Middleware Infrastructure Institute NeSC,
OGSA-DAI User Requirements and Scenarios
Presentation transcript:

Mike Jackson EPCC OGSA-DAI Today – Release 8 OGSA-DAI Tutorial GGF17, Tokyo

11 May 2006http:// What’s in a name? April 28 th 2006 It’s not release 8 –The lingering ghost of OGSI It’s release 2.2 –OGSA-DAI WSI 2.2 –Runs under Apache Axis on Tomcat –Runs under Axis 1.2RC3 on Tomcat –Runs under OMII –OGSA-DAI WSRF 2.2 –Runs under Globus Toolkit and

11 May 2006http:// Resource management Transient data service resources –Exist only in memory –No associated configuration files on the server –Associated activity to create new transient resources Resource withdrawal –An activity to withdraw a data service resource –Optionally remove its configuration files from the server

11 May 2006http:// Relational multi-resources A data service resource that aggregates multiple relational data service resources Aggregated resources can be local or remote Associated activities –Submit a query to every aggregated resource and return a bag of the results –Submit a query to every aggregated resource and return the results from the first one that completes –Remove duplicate rows from a bag of the results

11 May 2006http:// Activities… Data conversion activities –Convert ResultSet to WebRowSet –Convert ResultSet to CSV –Convert BLOB from ResultSet column into bytes Relational meta-data activities –Retrieve logical database schema –Convert logical database schema to XML –Retrieve physical database schema XMLDB activities –XQuery

11 May 2006http:// …and some more Projection and transformation activities –Remove duplicate rows from a WebRowSet –Project a ResultSet onto a column name or index –Project a WebRowSet onto a column name or index –Project CSV values onto a column index –Distribute numeric values onto spaces –Generate a random sample of input data –Write a stream of bytes to a temporary file and output a reference to this file Delivery activities –Throw data away – Write data to a resource property –Deliver data to a SOAP attachment

11 May 2006http:// Then there’s… eXist data resources and XQuery BLOBs –Improved support for BLOBs in SQL query and update activities –Activity to dump BLOBs into temporary files server-side Security –Authorization –Resource level –Activity level –GSI Secure Conversation message-level security for inter-service communications using data transport –OGSA-DAI WSRF only Logging and exceptions –Revamped logging, exceptions and internationalization

11 May 2006http:// …and… JARs –Third party JARs are now bundled with OGSA-DAI –OGSA-DAI WSI –JARs required to compile OGSA-DAI source distribution –JARs required to run OGSA-DAI clients –OGSA-DAI WSRF –Non-Globus Toolkit JARs required to compile OGSA-DAI source distribution –JARs required to run OGSA-DAI clients Usage –Publication of an initial set of usage scenarios and best practice Benchmarking and performance: –Numerous performance enhancements –Publication of summary of work