Web + VO + Database Technologies = HLA Footprints STScI: Gretchen Greene, Steve Lubow, Brian McLean, Rick White and the HLA Team JHU: Alex Szalay and Tamas.

Slides:



Advertisements
Similar presentations
Web Services for the Virtual Observatory Alex Szalay, Tamas Budavari, Tanu Malik, Jim Gray, and Ani Thakar SPIE, Hawaii, 2002 (Living in an exponential.
Advertisements

NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Discovery and Exploration in the VO Chris Miller NOAO/CTIO La Serena, Chile T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
The NVO Data Discovery Portal Tom McGlynn NASA/GSFC.
Footprint Service Specification NVO Summer School 2008 Gretchen Greene (thanks to Tamas Budavari and Francois Bonnarel) T HE US N ATIONAL V IRTUAL O BSERVATORY.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
Remote Visualisation System (RVS) By: Anil Chandra.
Overview of Current and Forthcoming GALEX Search Capabilities and Data Products Current Search Options New GALEX Fluxes gPhoton.
Name Title Company Microsoft SharePoint 2010 The business collaboration platform for the Enterprise and the Web.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Web GIS Oregon Explorer Marc G Rempel Oregon State University The Valley Library Oregon Explorer
20 January 2004ESS Technical Colloquium1 NVO Infrastructure Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
The KB on its way to Web 2.0 Lower the barrier for users to remix the output of services. Theo van Veen, ELAG 2006, April 26.
Geographic Information Systems
Enterprise Search With SharePoint Portal Server V2 Steve Tullis, Program Manager, Business Portal Group 3/5/2003.
The Web 2.0 and the NOAO NVO Portal Christopher J. Miller Data Products Program CTIO/NOAO.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Managing Data Interoperability with FME Tony Kent Applications Engineer IMGS.
Hubble Legacy Archive Lee Quick - TIPS meeting July 19, 2012 Goals Data History Current Work Demo.
Upcoming Enhancements to the HST Archive Mark Kyprianou Operations and Engineering Division Data System Branch.
Digitized Sky Survey Update Brian McLean : Archive Sciences Branch / Operations and Engineering Division.
A Scalable Application Architecture for composing News Portals on the Internet Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta Famagusta.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
VO & Astro-Wise & others A.Belikov OmegaCEN
Dec 2, 2014 Hubble Legacy Archive and Hubble Source Catalog Rick White & Brad Whitmore Current teams: HLA: Michael Dulude, Mark Kyprianou, Steve Lubow,
Dec 2, 2014 MAST Data Discovery Portal Tom Donaldson Tony Rogers.
Developing Reporting Solutions with SQL Server
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Innovations in the Multimission Archive at STScI (MAST) M. Corbin, M. Donahue, C. Imhoff, T. Kimball, K. Levay, P. Padovani, M. Postman, M. Smith, R. Thompson.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Science with the Virtual Observatory Brian R. Kent NRAO.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
IVOA Interop Pune, A.Micol/ESO An Archive in the VOSphere Experimenting with VOVIEW and SAMP Data Providers mind User Experience A.Micol/ESO,
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Enhancing Science with the Hubble Legacy Archive Bologna, January 29, 2008 Brad Whitmore OUTLINE The potential for enhanced archival science What is the.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
Reporting and Analysis With Microsoft Office. Reporting and Analysis Business User Reporting & Analysis OLAP Data Warehouse.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Nov MAST Data Discovery Portal Tom Donaldson The new website for accessing MAST data.
The European Hubble Space Telescope Legacy Archive Wolfram Freudling.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Web based spectrum databases and utilities László Dobos Tamás Budavári István Csabai MAGPOP kick-off meeting, January Cassis.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Faculty meeting - 13 Dec 2006 The Hubble Legacy Archive Harald Kuntschner & ST-ECF staff 13 December 2006.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
Introduction to ASP.NET development. Background ASP released in 1996 ASP supported for a minimum 10 years from Windows 8 release ASP.Net 1.0 released.
Hydroinformatics Lecture 15: HydroServer and HydroServer Lite The CUAHSI HIS is Supported by NSF Grant# EAR CUAHSI HIS Sharing hydrologic data.
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
MSSL Astrogrid Workshop
CUAHSI HIS Sharing hydrologic data
Geographic Information Systems
Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta
Google Sky.
Footprint Service Specification
Presentation transcript:

Web + VO + Database Technologies = HLA Footprints STScI: Gretchen Greene, Steve Lubow, Brian McLean, Rick White and the HLA Team JHU: Alex Szalay and Tamas Budavari NVO

Astronomical Application Archival Research is a value added product to observation planning as well as data mining Has HST observed in this location of the sky? Which wavelength?, how long?, what instrument?, what was the exact coverage with respect to object XYZ? Show the coverage for a high level product, e.g. Hubble Deep Field, GOODS mosaics, ALL overlapping ACS exposures of a specific field I have a transient even (e.g. VOEvent notification), what is the coverage in HST? How does HST coverage compare to another observatory coverage? Large scale distributed spatial queries NVO search portal

HST Footprints in the HLA HLA Footprints are spatially precise geometric descriptions of the HST observed areas in the sky Current holdings include reprocessed ACS fields (~20% of the completed observations), all sky WFPC2 and STIS In transition are NICMOS, remaining ACS, FOS & GHRS Collaborations in process with NICMOS grism spectra, SPITZER…. Accessible via web client or programmatic interfaces

Widespread Footprint Development GALEX (STScI ) NOAO VO Portal Aladin (via APT) IVOA (International Virtual Observatory) note for Footprint Overlay specification VOServices (JHU) Sky section or image plane: pans, zooms, downloads data. The ( GALEX) MAP - (adaptable to other missions)

Web components Web portal built on a suite of web services (SOAP, http) using SOA Reusable components mostly in form of XML User requirements reduced significantly Network access & a browser (FIREFOX) No installation required Technologies are independent of platform and consistent with everyday lifestyle XML, XSLT processors, Javascript, ASPX Performance on the web client looks favorable accept delay or switch to server side processing for large scale requests Javascript security issues require proxy management

IFRAME HLA Web Portal - Footprints SQL Server Footprint DB (with HTM) IIS Web Server Javascript UI manager (state and form control) Object Parser XML Instance ASPX + JS VO Cone Search VOTable SOAP STC Web Services IFRAME VOClients GOOGLE APT SQL Server DSS DB (with HTM) RA,Dec,Radius

Virtual Observatory Footprints are built on IVOA standard STC XML data model (Space Time Coordinate) Regions, Convexes, Reference Frames + much much more Data Access Layer services are built on standard VO protocols Cone Search Simple Image Access (SIA) XML across the wire in VOTable or STC format VO client applications can access HLA footprint programmatic services: Datascope, Registry, Aladin, GOOGLE? IVOA note on Footprint Overlay Specification

Database => Performance Key Microsoft SQL Server Client development DOES NOT have to be on WINDOWS Virtualization tools (Parallels, Remote Desk Top) FreeTDS SQL scripts manage footprint computation of STC table objects/fields Build and populate the different levels of representation HTM (Hierarchical Triangulated Mesh) integrated for spatial search index Coordinate based searching Accessed via stored procedures and user defined functions Bounding circles for each region convex have htm ids

DB Schema STC DB Tables map to XML elements in the schema HLA Science table associates regions to science metadata tags (target, exposure, dataset, filter, PI …)

JHU Spherical Library Spherical geometry library Exact equations for highly accurate region definitions, leverages HTM STC elements are class types (region, convex, halfspace…) C# Assembly (SQL Server dll ) Operations for combining regions Unions (outlines) Intersections (overlaps) Mathematical Solutions Area Complex regions can be made disjoint into convexes

Hierarchical Representations Exposures (Level 1) Stacks (Level 1 – visualization optimization) Combined sequential exposures (Level 2) Groups (Level 3 & 4) Mosaics, weight maps, use-defined, custom constrained Fractals Performance Issues for crowded overlaps HST unique distribution sparse ALL-SKY

Exposure Stacks Many cases where exposures lie on top of each other (form a stack) Can reduce overhead by graphically representing exposures in a stack by a single member exposure Define stacks using coarse- grained HTM matching for aperture vertices.

Visualization library C# library with building canvas, frame, scaling and drawing methods using GDI DSS background image access using spherical projection and tiling algorithms ASPX is ~ html with C# class associated. ASP controls for basic web gui features Javascript for interactive mouse and cursor state Event handling between the graphics and table paging control for selection

Challenges Ahead Enhanced capabilities for visualization Completion of IVOA standard footprint services Community exchange of STScI Footprint schema Validation of footprint representations between existing tools (Starview/APT, HLA, external…) Development of higher level product respresentations (MOSAICS, user-defined…) Storing Region binary blob representations