NVO Summer School 20081 VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

Slides:



Advertisements
Similar presentations
IVOA Registry WG, IVOA Registry WG Pune, 28 Sept 2004.
Advertisements

IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
The NVO Portal Tom McGlynn, NASA/GSFC Gretchen Greene, ST ScI John Good, IRSA/IPAC Roy Williams, CACR/Caltech Mike Fitzpatrick, NOAO T HE US N ATIONAL.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
Applications Interest Group Tom McGlynn (based on Mark Allens summary from Cambridge)
NVO Summer School, Aspen Center for Physics1 Publishing and Resource Discovery with Registries Ray Plante Gretchen Greene.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
9/14/2006NVOSS III1 The Future of the Virtual Observatory Robert Hanisch US NVO Project Manager Space Telescope Science Institute T HE US N ATIONAL V IRTUAL.
Discovery and Exploration in the VO Chris Miller NOAO/CTIO La Serena, Chile T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sep 6, 2008NVOSS Desktop Messaging Mike Fitzpatrick NOAO.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
The NVO Data Discovery Portal Tom McGlynn NASA/GSFC.
Footprint Service Specification NVO Summer School 2008 Gretchen Greene (thanks to Tamas Budavari and Francois Bonnarel) T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sep 3, 2008NVOSS Mobile VO Mike Fitzpatrick NOAO.
September 7, 2005NVO Summer School1 Building a SkyNode Server Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Image Visualization in the VO Doug Tody (NRAO) Francois Bonnarel (CDS) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen Center for Physics1 Publishing and Resource Discovery with Registries Ray Plante Matthew Graham.
September 13, 2004NVO Summer School1 Exploring VO Registries, Resources and Software with The NVO DataScope and Other VO Tools Tom McGlynn NASA/GSFC T.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
14 Sep 2006NVO Summer School T HE US N ATIONAL V IRTUAL O BSERVATORY Simple SSA Query Kelly McCusker Amy Kimball Mike Koss Phil Warner Melinda Mello.
Sept NVO Summer School1 The NVO DataScope: Internals Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Remote Visualisation System (RVS) By: Anil Chandra.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
VO-DAS Chenzhou CUI Chao LIU, Haijun TIAN, Yang YANG, etc National Astronomical Observatories, CAS.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Web + VO + Database Technologies = HLA Footprints STScI: Gretchen Greene, Steve Lubow, Brian McLean, Rick White and the HLA Team JHU: Alex Szalay and Tamas.
October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.
26 October 2004ADASS Pasadena1 Publishing and Resource Discovery with Registries Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY Kevin Benson.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
VO & Astro-Wise & others A.Belikov OmegaCEN
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Last News of and
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
25 Jan The Virtual Observatory: Core Capabilities and Support for Statistical Analyses in Astronomy T HE US N ATIONAL V IRTUAL O BSERVATORY Robert.
Science with the Virtual Observatory Brian R. Kent NRAO.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
VO Applications Enrique Solano LAEFF / INTA. Move from download to service paradigm Leave the data where it is. Operations on data (search, cluster analysis,
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Applications May 2006, Victoria, Canada VOQuest A tool.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
IVOA RM, VOResources, Identifiers, Interfaces Chenzhou CUI.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Evanthia Hatziminaoglou, ESO - Garching Virtual Observatory Info-Workshop, SOFIA January 2008 VO Tools Overview.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
February 12, 2002Tom McGlynn ADEC Interoperability Technical Working Group Report.
End of the Beginning for IVOA is now Roy Williams IVOA Technical Lead.
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
VO tools and applications in a nutshell
Google Sky.
Google Sky.
Presentation transcript:

NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY

NVO Summer School Summary What are the VO agreements and tools that are used within by VO clients and services? Set the context for building blocks that subsequent talks will describe in detail. Show how the protocols work together.

NVO Summer School VO Protocols and Jargon Data Formats –VOTable –FITS –XML Data Access –Cone Search –Simple Image Access (SIA) –Simple Spectral Access (SSA) –Table access/SkyNode Astronomical Data Query Language (ADQL) (extends SQL) Semantics –Uniform Column Descriptors (UCDs) –Space-Time Coordinates (STC) –IVOA Identifiers Registry –Resource Metadata –Registry Protocols –OAI VOEvent NESSSI VOSpace PLASTIC/SAMP

Services Discovery portal: suite of collaborating tools to find data. –Registry: keyword search interface to registry db –SimpleQuery: Web tool to search and filter tables –Inventory: find data near sets of positions –DataScope: find everything near a given position –VIM: VO Integration and Mining-Combine data from multiple sources –Table converters/wizards –VOClient: Work from the command line. NOAO Portal: Graphical interface to VO data iPortal: Access to VO through mobile devices TOPCAT: CLI tool to manipulate tables VOPlot: CLI tool to plot VOTable data VOStat: Web tool to do statistics of VO data. WESIX: Web tool to extract and correlated objects from images. OpenSkyQuery: Web tool to query many on-line tables WCSFixer: Determine exact geometry of images. NVO Summer School 20084

5 Formats VOTable –XML format for tabular information Catalog query results List of images or spectra Lists of resources Includes UCDs for columns FITS –Standard astronomical binary data format –Images, spectra, … XML (eXtensible Markup Language) –Industry standard –Hierarchical –Extensible

NVO Summer School Data Access:Cone Search Simple query around a given region Returns VOTables Examples: What observations has Spitzer made of the Antennae? How many x-ray objects are within 30 of Abell 1656?

Data Access: Simple image access What images overlap a given region? Create me an image of this region. First step produces VOTables with links to image User downloads images as FITS in second stage V1.0 is widely deployed. V2.0 is under development. Examples: Find all Chandra X-ray images near the Galactic center. Ask SkyView for an I/R cutout of the Orion spur. NVO Summer School 20087

Data Access: Simple spectral access What spectra are available within this region More sophisticated than SIA (includes support for Data Models and more complex criteria) Some services beginning to appear. Examples: Does HST have an FOS spectrum for this star in this wavelength band? NVO Summer School 20088

Data Access: Table Access Protocol and SkyNodes Table Access Protocol –Standardized access to complex queries of remote tables –Currently under development –Uses ADQL and simpler queries SkyNode –SOAP Web-Service based –Sophisticated access to tables –Supports distributed queries –Uses ADQL –Many operational nodes but should eventually be subsumed in TAP. NVO Summer School 20089

10 Query languages SQL: Structured query language. Industry standard to generating and extracting information from tables –Widely supported in free and commercial products (Oracle, Sybase, MySQL, Postgres, …) Astonomical Data Query Language (ADQL) –Enhanced version of SQL to support astronomical queries Positional correlations Complex regions on the sky –Under rapid development

NVO Summer School Semantic content IVOA identifiers –Scheme for providing unique identifiers for any thing that needs to be distinguished. Services, requests, … –ivo://authority/authority_controlled_string#sub-resource –Used in registries and many other protocols Resource metadata –Standardized format for the description of a service, data collection, facility. –XML format based on the Dublin-core metadata descriptions for published resources. –Used inside registries. Uniform Column/Content Descriptors (UCDs) –Standardized names for table columns with relatively high degree of specificity. –pos.eq.ra or phot.flux;em.ir –Used in VOTables and by Cone search and SIA Space/Time Coordinates –Way of specifying points or regions of space-time. –Can be simple or very complex –Used in ADQL and VOEvent

NVO Summer School Discovering Resources Registry –Collection of resources that users can find included Cone Search, SIA, SSA and SkyNodes. –User access via registry access protocol –Registry-registry communication via OAI. –Publishing registries sometimes meant to be seen only by other registries Registry access –How users query the registry –Standard adopted and recently implemented. Open Archive Interface (OAI) –Library community standard –Registry-registry communication to ensure that all registries are up to date. VOEvent –VO protocol for publishing and receiving notice of transient/urgent events –Describes events using STC

NVO Summer School Access, Control and Communication NESSSI –NVO Extensible, Scalable, Secure Service Infrastructure –Provide access to protected resources, especially Grid computational resources. VOSpace –Access to storage resources in a standardized way. –Standard agreed. Some implementations available. –Promotes scripting of VO access. PLASTIC/SAMP –Platform for Astronomical Task InterCommunication (prototype protocol) –Simple Application Messaging Protocol (permanent standard) –Applications publish and receive notifications of events from other applications (e.g., selection of a given object) to enable coordinated actions, e.g. TOPCAT – Aladin –Many PLASTIC services deployed. SAMP protocol currently under review.

Portals NVO Data Discovery Portal: Find and get NVO data quickly. NOAO Portal: Visualize relationships of data. iPortal: NVO on cellphones and iPods. NVO Summer School

Some popular tools WCSFixer: Web interface to correct errors in geometry of image. WESIX: Find objects in image then cross-correlate with other catalogs TOPCAT: Java based tool to get, manipulate and display tables. Aladin: Java based tool to get, manipulate and display images VOPlot/VOStat: Plotting and statistics for VOTables OpenSkyQuery: Query and cross-correlate many VO datasets NVO Summer School

Miscellaneous Jargon Web Service: Web-based application intended for use by programs (possibly in addition to interactive use) REST: Representational State Transfer ~ Using stateless interfaces to access Web. Similar to GET based CGI. SOAP: Simple Object Access Protocol –Not so simple XML-based method for Web services. NVO Summer School

How does it work together? Example: VOEventnets use of DataScope to gather information on recent events: – Use first HTML feed to get link to event (from earlier today) Click on View data link. NVO Summer School

NVO Summer School Immediate access to data near a recent event using DataScope VOTable FITS Cone Search Protocol Simple Image Access (SIA) Protocol VO Registry V OClient Resource Metadata Registry Access Protocols Uniform Column Descriptors (UCDs) Space-Time Coordinates (STC) IVOA Identifiers VOEvent

NVO Summer School Event is detected by VOEvent publisher who publishes the event. VOEvent notification received by CalTech VOEvent consumer. STC position of VO event noted and used to initiate DataScope request at HEASARC. DataScope sends request to VO Registry at ST ScI to find appropriate services. DataScope sends out Cone and SIA (soon SSA and SkyNode) requests to registered services and gets back VOTables of results. SIA VOTables index FITS files DataScope sends FITS and VOTables to user or other VO- enabled tools.