2003 April 151 Data Centres: Connecting to the Real World Clive Page.

Slides:

Advertisements

Similar presentations

Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 10 Servlets and Java Server Pages.

Advertisements

IVOA Registry WG, IVOA Registry WG Pune, 28 Sept 2004.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALToolKit.

2003 May 24Clive Page Physical Units in Queries May 24Clive Page Where units are needed Consider simple query like this: SELECT * from t1, t2 WHERE.

9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.

Web forms and CGI scripts Dr. Andrew C.R. Martin

CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.

A Prototype Implementation of a Framework for Organising Virtual Exhibitions over the Web Ali Elbekai, Nick Rossiter School of Computing, Engineering and.

15 April 2003 Registry Workgroup Meeting University of Leicester Astrogrid Registry Elizabeth Auden Astrogrid Registry Workgroup Iteration 2 Workgroup.

The KB on its way to Web 2.0 Lower the barrier for users to remix the output of services. Theo van Veen, ELAG 2006, April 26.

Chapter 12: ADO.NET and ASP.NET Programming with Microsoft Visual Basic.NET, Second Edition.

Week 23 - Revision1 Week 23 Revision DSA. Week 23 - Revision2 Agenda Section A: Multiple choice Section B: Problem-oriented questions Topics for revision.

BinX and Astronomy Bob Mann Institute for Astronomy and National e-Science Centre.

CVSQL 2 The Design. System Overview System Components CVSQL Server –Three network interfaces –Modular data source provider framework –Decoupled SQL parsing.

Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.

INTRODUCTION TO WEB DATABASE PROGRAMMING

JSP Standard Tag Library

NETWORK CENTRIC COMPUTING (With included EMBEDDED SYSTEMS)

XForms: A case study Rajiv Shivane & Pavitar Singh.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Homogeneous Access to Tabular Data Beijing, China - May.

VOTable: Tabular Data for Virtual Observatory François Ochsenbein Roy Williams Clive Davenhall, Daniel Durand, Pierre Fernique, Robert Hanisch, David Giaretta,

S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.

GDT V5 Web Services. GDT V5 Web Services Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas, Nevada GDT.

Using XML technologies to implement complex tables in short- term statistics Francesco Rizzo

Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.

Posting XML Data From the Client to a Server Eugenia Fernandez IUPUI.

OracleAS Reports Services. Problem Statement To simplify the process of managing, creating and execution of Oracle Reports.

WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.

Developing Reporting Solutions with SQL Server

DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.

Last News of and

Web Server Administration Web Services XML SOAP. Overview What are web services and what do they do? What is XML? What is SOAP? How are they all connected?

Chapter 27 The World Wide Web and XML. Copyright © 2004 Pearson Addison-Wesley. All rights reserved.27-2 Topics in this Chapter The Web and the Internet.

CS4273: Distributed System Technologies and Programming Lecture 13: Review.

XML & Mediators Thitima Sirikangwalkul Wai Sum Mong April 10, 2003.

IBM - CVUT Student Research Projects Creating mp3 from text documents & Viewing text information via voice Zlatuška Martin Kašpárek.

Data Management Console Synonym Editor

ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.

1 Database Management Systems: part of the solution or part of the problem? Clive Page 2004 April 28.

Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.

JavaScript - A Web Script Language Fred Durao

An RTAG View of Event Collections, and Early Implementations David Malon ATLAS Database Group LHC Persistence Workshop 5 June 2002.

Overview Web Session 3 Matakuliah: Web Database Tahun: 2008.

Astronomical Data Archiving and Curation Clive Page AstroGrid Project University of Leicester 2004 March 22.

Chapter 27 The World Wide Web and XML. Copyright © 2004 Pearson Addison-Wesley. All rights reserved.27-2 Topics in this Chapter The Web and the Internet.

JSTL The JavaServer Pages Standard Tag Library (JSTL) is a collection of useful JSP tags which encapsulates core functionality common to many JSP applications.

Database & Website ‘Buffet’ 1.ASU Lichen Herbarium Database 2.ASU Lichen Herbarium Website 3.ABLS Lichen Exchange 4.The Species Analyst (Kansas) 5.Collections.

AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.

Accessing Relational Databases from the World Wide Web by Tam Nguyen & V. Srinivasan Presented by Megan Thomas and Randi Thomas CS294-7 February 11, 1999.

EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.

Preliminary Ocean Project Page 1 WGISS SG May 15, C. Caspar G. Tandurella P. Goncalves G. Fallourd I. Petiteville Preliminary Ocean Project Phase.

AstroGrid Usability & Docs, JBO, 6 th Dec 2005 Jonathan Tedds Leicester University AstroGrid Usability & Documentation Usability –Documentation –Infrastructure.

UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.

©SoftMooreSlide 1 Introduction to HTML: Forms ©SoftMooreSlide 2 Forms Forms provide a simple mechanism for collecting user data and submitting it to.

Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.

Martin Kruliš by Martin Kruliš (v1.1)1.

How Web Database Architectures Work CPS181s April 8, 2003.

Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.

Compilation of XSLT into Dataflow Graphs for Web Service Composition Peter Kelly Paul Coddington Andrew Wendelborn.

VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.

XML 1. Chapter 8 © 2013 Pearson Education, Inc. Publishing as Prentice Hall SAMPLE XML SCHEMA (XSD) 2 Schema is a record definition, analogous to the.

AstroGrid Datacenters AstroGrid Consortium Review Dec 2004 Martin Hill

ODP V2 Data Provider overview. 22 Scope Data Provider provides access to data and metadata of the local data systems. Data Provider is a wrapper, installed.

Internet/Web Databases

Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.

Chapter 27 WWW and HTTP.

Presentation transcript:

2003 April 151 Data Centres: Connecting to the Real World Clive Page

2003 April 152 Aim To provide Web Services interfaces to a few data centres to provide realistic data for the current iteration. How data centres many? Maybe three…

2003 April 153 XML Formats for Output ImagesNothing yet Time seriesNothing yet SpectraNothing yet TablesVOTable Conclusion: in this iteration just handle tabular datasets.

2003 April 154 XML Formats for Input AQL (Astronomical Query Language): much discussion, not much progress. ASU (Astronomical Server URL): ad-hoc pre-XML definition of CGI parameters by CDS, used since 1996 by a number of archives. SIAP (Simple Image Access Protocol) – CGI parameters defined by NVO for their prototypes in Xpath: draft standard for querying XML documents – designed for tree-structured data. Xquery: based on Xpath, includes WHERE section similar to SQL, more suitable for tabular data. SQL: standard for RDBMS but only used by some astronomical archives

2003 April 155 Query Language: proposal for ad-hoc solution Use simplified form of SQL in an XML wrapper: SELECT FROM WHERE includes UCDs so generic queries possible allows same query to be sent to >1 archive may includes column/UCD names and the usual syntax of relational expressions Need special provision for cone-search in selection, e.g. –Boolean pseudo-function CONE(RA, DEC, RADIUS) No joins, no sub-selects, no sorting or grouping, at present.

2003 April 156 Possible Datasets DatasetLocationSystem/DBMSInputOutput APM catalogueCambridgeSolaris/SybaseCGIVOTable 6df galaxy survey EdinburghWin-NT/SQL server?VOTable nearly done USNO-BLeicesterLinux/DB2?XML STP datasetsRALVarious/home grown?VOTable USNO-BLeicester (LEDAS) Solaris/WCStoolsCGIVOtable SuperCOSMOSEdinburghWin-NT/SQL server?VOTable in progress Vizier collection LeicesterLinux/SybaseASUVOTable

2003 April 157 Problem Areas All current services are synchronous: user waits while HTML is generated and streamed to the browser. –How to set up an asynchronous service where results appear later, and are sent to MySpace or elsewhere? How is the query generated in XML format? How is the query in pseudo-SQL parsed into the CGI parameters or SQL the local DBMS needs?

2003 April 158 Metadata Problems How does the query system know which column names exist, or how to translate UCDs to columns? –It gets the information in the Registry How does the Registry get its information on columns and UCDs in each table? Answer: either –It gets the information from the Data Service –OR it gets filled in laboriously by hand. Conclusion Data centres must implement a Web Service which responds to queries about their metadata AQL must be extended to deal with these queries.