The Virtual Solar Observatory – An Operational Resource for Heliophysics Informatics Frank Hill & The VSO Team.

Slides:



Advertisements
Similar presentations
VOEvent & Solar Physics: Solar transient events Dec. 5, 2005.
Advertisements

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Science Archives Workshop - April 25, Page 1 Archive Policies and Implementation: A Personal View from a NASA Heliophysics Data Policy Perspective.
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
Using Sakai to Support eScience Sakai Conference June 12-14, 2007 Sayeed Choudhury Tim DiLauro, Jim Martino, Elliot Metsger, Mark Patton and David Reynolds.
1 A Virtual Observatory for Space Weather? R.D. Bentley (UCL/MSSL) Chris Harvey (CDPP) Second European Space Weather Workshop ESTEC, 18 November 2005.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Operating a Virtual Observatory Raymond J. Walker, Jan Merka, Todd A. King, Thomas Narock, Steven P. Joy, Lee F. Bargatze, Peter Chi and James Weygand.
SpaceGRID and EGSO Satu Keski-Jaskari Maria Vappula Parallal Computing – Seminar
Virtual Observatory Single Sign-on U.S. National Virtual Observatory National Center for Supercomputing Applications Ray Plante, Bill Baker.
The Emerging Heliophysics Informatics Infrastructure J. Ireland ADNET Systems, Inc. / NASA-GSFC.
Karen TianHMI/AIA Science Teams Meeting February 13-17, 2006 Virtual Solar Observatory VSO provides a unified view of data from diverse solar sources
Astronomical GRID Applications at ESAC Science Archives and Computer Engineering Unit Science Operations Department ESA/ESAC.
SOLAR ORBITER Archive status Pedro Osuna Solar Orbiter Archive Scientist SOWG#7 – 6-9 July 2015.
F. I. Suárez-Sol á 1, E. González-Suárez 1, I. González-Hernández 1, A.R. Davey 2,J. Hourcl é 3, VSO Team 1 National Solar Observatory, Tucson AZ – 2 Harvard-Smithsonian.
ILWS and Data Services D. G. Sibeck, Aaron Roberts NASA/GSFC Ray Walker UCLA.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
EGY Meeting March Page 1 The Data Policy for NASA's Heliophysics Science Missions & the eGY Geoscience Information Commons D. A. Roberts.
1 OPeNDAP/ECHO Demo Integrating and Chaining services September, 2006 CEOS WGISS 22 Annapolis, MD.
Sun-Earth Connection MO&DA Programs - March 26, Page 1 What NASA needs from us? Presented to the Workshop: VOs in Space and Solar Physics
VSO Programmatic Interface Authors: Igor Suárez Solá Joe Hourclé Alisdair Davey VSO Team.
Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.
2004/12/02Slide Number 1 of 15 Exposure Time Calculator (ETC) as a Web Service Donald McLean 2004 Technology Open House.
GONG data and pipelines: Present & future. Present data products 800x800 full-disk images, one per minute, continuous (0.87 average duty cycle) Observables:
Thomas C. Stein PDS Geosciences Node Washington University in St. Louis 1MS Supporting Active Surface Missions and Adding Value.
What is the VSO? (and what isn’t it?). The VSO …  Allows you to search multiple archives in a single search  Keeps you from needing to keep track of.
The Future of Helioseismology. NSF Senior Review Has recommended that GONG be closed one year after successful SDO/HMI commissioning unless outside funding.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
The Virtual Solar Observatory (VSO) Huairou Solar Observating Station National Astronomical Observatories Chinese Academy of Sciences Ganghua Lin.
What’s Inside The Small Box? The Virtual Solar Observatory.
SPASE: Metadata Interoperability in the Great Observatory Environment Jim Thieman Todd King Aaron Roberts Joe King AGU Joint Assembly May 23, 2006.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
VSO Integration with netDRMS Joseph A. Hourclé and the VSO Team HMI : 2009 Sept 08.
SPASE and the VxOs Jim Thieman Todd King Aaron Roberts.
VSO Status Update HDMC Meeting 9 June Vision To allow solar physicists to identify and search for data even if they don't know it exists. Make.
William Thompson L-3 Communications NASA Goddard Space Flight Center STERE The STEREO Science Center.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
2003 Dec 16 J.B. Gurman A bit of (really boring) history First attempts organized c by K. Reardon and L. Sanchez-Duarte as the “Whole Sun Catalog”
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Event and Feature Catalogs in the Virtual Solar Observatory Joseph A. Hourclé and the VSO Team SP54A-07 : 2008 May 30.
The Virtual Heliospheric Observatory and Distributed Data Processing T.W. Narock 1,2, A. Szabo 2, A. Davis 3 1. L3 Communications,
Virtual Space Physics Observatory (VSPO) (vspo in Google) 22 May 2006 Overview D. Aaron Roberts NASA GSFC.
Solar and STP with AstroGrid Silvia Dalla School of Physics & Astronomy, University of Manchester A PPARC funded project.
EGY Meeting March Page 1 NASA's Space Science (mostly Heliophysics) Virtual Observatories and Informatics D. A. Roberts C. P. Holmes J. H.
Harokopio University of Athens – Department of Informatics and Telematics HAROKOPIOUNIVERSITY A Distributed Architecture for Building Federated Digital.
VxO Kickoff Meeting - May 22, 2006 The Evolving Heliophysics Data Environment: “VxO Kickoff” Chuck Holmes Joe Bredekamp May 22, 2006.
A Perspective on the Electronic Geophysical Year Raymond J. Walker UCLA Presented at eGY General Meeting Boulder, Colorado March 13, 2007.
STEREO and the Virtual Heliospheric Observatory Tom Narock 1,2 Adam Szabo 1 Jan Merka 2 (1) NASA/Goddard Space Flight Center (2) L3 Communications, GSI.
ESA Scientific Archives and Virtual Observatory Systems Science Archives and VO Team Research and Scientific Support Department.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
STEREO Science Center SWG – November 2005 William Thompson NASA Goddard SFC Code Greenbelt, MD
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
The Virtual Heliospheric Observatory VHO. The VHO Team Adam Szabo (lead)NASA/GSFC Andrew DavisCaltech George HoJHU/APL Justin KasperMIT Jan MerkaU. Maryland,
Sun-Earth Connection MO&DA Programs - February Page 1 SS Implementing the Data Environment for the Living-with-a-Star era Charles P Holmes Joseph.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Heliophysics MO&DA Program - November 13, Page 1 Notes from the Heliophysics MO&DA Program STEREO SWG Meeting Chuck Holmes “Director, Heliophysics.
Information Management in a Non-Bibliograpic Environment: Scientific Data Joseph A. Hourclé 2007-Nov-20 FLICC
MSSL Astrogrid Workshop
Archiving of solar data Luis Sanchez Solar and Heliospheric Archive Scientist Research and Scientific Support Department.
improve the efficiency, collaborative potential, and
Moving towards the Virtual Observatory Paolo Padovani, ST-ECF/ESO
HAO/SCD: VO, metadata, catalogs, ontologies, querying
Google Sky.
Presentation transcript:

The Virtual Solar Observatory – An Operational Resource for Heliophysics Informatics Frank Hill & The VSO Team

The VSO Team Rick Bogart Alisdair Davey Joe Gurman Frank Hill Joe Hourclé Piet Martens Kevin Reardon Igor Suárez-Solá George Dimitoglou Karen Tian Steve Wampler Keiji Yoshimura

Many VxOs Virtual observatories are popular. Night-time: IVOA, NVO, etc. going to VAO Solar: VSO Heliospheric: VHO Space Physics: VSPO Magnetospheric (2): VMO

VSO History First concept: Whole sun catalog (Fleck, Bentley) Unsuccessful proposal efforts NASA funded in 2001 to replace the GFSC SDAC Initial development Operational version 1.0 released in 2004 Now at version 1.4

Design Requirements Distributed Search for and access multiple missions/observatories/wavelengths without intimate knowledge of the dataorganization (e.g. by physical observable and/or mission/instrument) Provide access to analysis software, instrumentdescriptions, &c. that enable use in scientific research Given the funding level, had to draw a “small box” around a small set of attributes useful for doing science

The original small box

VSO design

Essential technical features SOAP (simple object access protocol) Rapid prototyping Central registry of data provider holdings Replication of registry Simple data model Proxies for providers without data bases API, especially for IDL –Perl with SOAP:Lite –Java using Axis –C or C++ using gSOAP –Plus a WSDL document describing the API Three main nodes (GSFC, MSU, NSO)

What VSO does not provide Data mining (knowledge discovery) Remote processing: left for EGSO, CoSEC, but still missing Grid computing (as opposed to data grids) Access control (ever) –We wanted only to be in the business of helping data providers to give data away, not preventing its access

Data Sets MLSO RHESSI Yohkoh Digitized plates since 1915 GOES-12 SOLIS, FTS, O-SPAN, GONG Nancay, Pic Du Midi SOHO, TRACE, STEREO, Hinode MDI, GONG, Mt. Wilson, TON COMING SOON: SDO 59 instruments, 27 observatories, 14 archives

Interface

Data return page

Shopping Cart Carts are permanently stored, retrievable, and citable – searches can be replicated.

API Provides link between VSO and other systems: IDL/SolarSoft, COSEC, EGSO, HelioScope, AstroGrid, Aladin, VO. (But AstroGrid has just been cut)

New developments Currently in development –Additional catalogs (e.g. filaments) –Improved data return page for large data sets Future –Spatial location search (non-full disk images) –SDO –Better integration of data return –Interoperability with other VxOs and distributed analysis systems when they are available Always adding data sets

Operational experience Uptake by established senior staff is slow to non-existent Greater usage by young scientists Approximately 50 searches per day

Lessons Learned Design for easy maintenance You won’t have full funding forever Keep the central logic as simple as possible Handle special cases as wrappers around the problem component Your data model will change Be careful about outthinking yourself

URLS