12 Oct 2003VO Tutorial, ADASS Strasbourg, 20031 Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.

Slides:



Advertisements
Similar presentations
IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Advertisements

IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
2008 NVO Summer School1 Image Visualization in the VO Doug Tody (NRAO) Francois Bonnarel (CDS) T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Updated SkyMouse and Suggestions to VO Service Developers HuaPing SUN, Chenzhou CUI China-VO National Astronomical Observatory of China.
October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.
26 October 2004ADASS Pasadena1 Publishing and Resource Discovery with Registries Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY Kevin Benson.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Chenzhou CUI National Astronomical Observatory of China.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
VO Data Access Layer Working Group Summary IVOA Cambridge, UK 16 May 2003 Doug Tody, NRAO.
VO & Astro-Wise & others A.Belikov OmegaCEN
F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,
Dec 2, 2014 MAST Data Discovery Portal Tom Donaldson Tony Rogers.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
Science with the Virtual Observatory Brian R. Kent NRAO.
Scalable Metadata Definition Frameworks Raymond Plante NCSA/NVO Toward an International Virtual Observatory How do we encourage a smooth evolution of metadata.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
26 October 2005HST Calibration Workshop1 The National Virtual Observatory and HST T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US National Virtual.
Strasbourg astronomical Data Centre (DS) Françoise GENOVA.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
Web Services BOF This is a proposed new working group coming out of the Grid Computing Environments Research Group, as an outgrowth of their investigations.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Coordination Portal/Data sources L2:Data access & Handling Points to be raised : - Downloading data sources/data via the Portal…keeping visibility of data.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
OGSA-DAI 简介及其它在 China-VO DAS 系统中的应用 杨阳 中国虚拟天文台研发团队 Chinese Virtual Observatory.
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
February 12, 2002Tom McGlynn ADEC Interoperability Technical Working Group Report.
Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,
Simple Image Access International VIRTUAL OBSERVATORY
Google Sky.
Google Sky.
SVO - ESAVO Use case: Comparison of evolutionary synthesis models
Presentation transcript:

12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL O BSERVATORY

12 Oct 2003VO Tutorial, ADASS Strasbourg, Agenda –DAL Overview and Concepts (Doug Tody) –Server, Client HowTo How to Implement the DAL Cone Search and SIA services (Gretchen Greene) How to Navigate VO Datasets Using VO Protocols (Tom McGlynn) –How to Adapt Existing Archives to SIA The XMM-Newton and ISO Cases (Pedro Osuna) CDS Aladin Image Service and Client Viewer (Francois Bonnarel)

12 Oct 2003VO Tutorial, ADASS Strasbourg, DAL Overview and Concepts What is the Data Access Layer (DAL)? –portal for VO applications development –consists of a family of data access services –services provide access to both data and computation –services integrate other VO technologies VOTable, ADQL, data models, UCD, etc. What DAL enables –distributed, multiwavelength data analysis applications –applications may be either end-user, or VO analysis services

12 Oct 2003VO Tutorial, ADASS Strasbourg, DAL Architecture Usage –registry used to discover services –DAL services provide access to VO resources –distributed client applications use these services Access Protocols –data access protocols define each service –access protocols are neutral middleware not a user interface! implementation not constrained (e.g., language, technology) server, client not constrained Information Model –information model independent of low level protocol –HTTP GET now, Web, Grid services later –service back-end can be of any complexity

12 Oct 2003VO Tutorial, ADASS Strasbourg, Family of DAL Services Service Types –image, table, spectrum, time series, etc. Data model-based data access –each services implements a specific data model –the same data can be viewed via different services e.g., event list or visibility data as image or spectrum

12 Oct 2003VO Tutorial, ADASS Strasbourg, Current DAL Services Cone search –access to astronomical catalogs –simple query based on position, search radius –returns a VOTable containing results Simple Image Access (SIA) –uniform access to image archives –atlas and pointed image archives –image cutouts, image mosaics –image is returned as a FITS file or graphics file Simple Spectral Access (SSA) –currently being specified –access to 1D spectra and SEDs –spectra is returned as ascii, VOTable, FITS

12 Oct 2003VO Tutorial, ADASS Strasbourg, Basic DAL Service Interface Registry used to discover services or data –registry query is optional –data query will locate services providing desired data –service query will find services by type Data query against specific service –returns a VOTable listing datasets which satisfy query Dataset access –returns an individual object of the specified type –service metadata query –describes the capabilities of an individual service

12 Oct 2003VO Tutorial, ADASS Strasbourg, Key Concepts Data discovery –find data based on its type and attributes Data provenance –what is this data and where did it come from? Data characterization –observation time, spectral bandpass, resolution, sensitivity, etc. Virtual data –data is generated upon demand to match query (e.g., image cutout) –server-side analysis or transformation functions Data models, data mediation –map external data into a VO data model (image, spectrum, etc.) –map VO data model to a client API –necessary to deal with heterogeneous, multiwavelength data

12 Oct 2003VO Tutorial, ADASS Strasbourg, DAL Roadmap Future evolution of the DAL services –broader range of services –spectra, time series, NDimage, etc. –service sophistication will evolve as VO technology develops and as reference code becomes available Grid computing –component frameworks –distributed, scalable computation (uniprocessor, cluster, grid) –astronomical data analysis components execute in any context –integrate VO with everyday astronomical data analysis