AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.

Slides:



Advertisements
Similar presentations
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations Sep 2006, Moscow, Russia Simple Line.
Advertisements

IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.
Publishing catalogues: HIPASS and SUMSS Australian Virtual Observatory 2003 Workshop 17th-18th November 2003 Sydney David Barnes, Brett Beeson, Travis.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Ch-11 Project Execution and Termination. System Testing This involves two different phases with two different outputs First phase is system test planning.
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 27 September 2006 HELAS Workshop Nice.
Matthew Cechini Raytheon - EED ID: IN31C-07.  ECHO Metadata Overview  Introduction  Problem Space  Solutions ISO Lessons Learned – Perceived.
A PPARC funded project Tony Linde Programme Manager eScience meets eFrameworks 28 th April 2006 NeSC, Edinburgh.
AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid and Euro-VO Technology Centre Project.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
2 - Declared in dataSet Table 3 - Described in attribut Table 1 - A table of data (here HIRES data from Clementine) SITools is based on a concept of services:
ADASS, London Sep 23-26, 2007 VOExplorer : Visualising Data Discovery in the Virtual Observatory Jonathan Tedds University of Leicester/AstroGrid/ EuroVO.
25 September 2007eSDO and the VO, ADASS 2007Elizabeth Auden Accessing eSDO Solar Image Processing and Visualisation through AstroGrid Elizabeth Auden ADASS.
Karen TianHMI/AIA Science Teams Meeting February 13-17, 2006 Virtual Solar Observatory VSO provides a unified view of data from diverse solar sources
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness and Peter Fox CSCI Week 9, October 27, 2008.
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 21 September 2006 AHM 2006 Nottingham.
Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb
2003 April 151 Data Centres: Connecting to the Real World Clive Page.
S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
NERC DataGrid Vocabulary Server Access Vocabulary Workshop, RAL, February 25, 2009.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Solar Terrestrial Physics: ESA SpaceGRID Chris Perry, Rutherford Appleton Laboratory 21st March 2003.
Tero Oittinen Sampo Team Department of Astronomy University of Helsinki,Finland Using ESO Reflex to access astronomical WebServices by The Sampo.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness TA Weijing Chen Semantic eScience Week 10, November 7, 2011.
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness and Joanne Luciano With Peter Fox and Li Ding CSCI Week 10, November.
How to Adapt existing Archives to VO: the ISO and XMM-Newton cases Research and Scientific Support Department Science Operations.
GONG data and pipelines: Present & future. Present data products 800x800 full-disk images, one per minute, continuous (0.87 average duty cycle) Observables:
ESAVO/European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Isa Barbarisi Beijing, May 2007 VOSpec new functionalities.
Solar-B Global DataGrid Update for AstroGrid SAG 10 RALMSSL Tim Folkes Elizabeth Auden Jens Jensen Paul Lamb Matthew WildMatthew Whillock Len Culhane Elizabeth.
1 MSCS 237 Overview of web technologies (A specific type of distributed systems)
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.
Solar and STP science with AstroGrid Silvia Dalla School of Physics & Astronomy, University of Manchester A PPARC funded project.
Uwe SchindlerGES 2007 – May 2-4, 2007 Data Information Service based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler 1, Benny Bräuer.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
VSO Status Update HDMC Meeting 9 June Vision To allow solar physicists to identify and search for data even if they don't know it exists. Make.
SolarFlows Dr. Gabriele Pierantoni (TCD). Contents What is Heliophysics ? How could workflows help ? Some examples What we are doing...
AstroGrid Usability & Docs, JBO, 6 th Dec 2005 Jonathan Tedds Leicester University AstroGrid Usability & Documentation Usability –Documentation –Infrastructure.
Virtual Observatories, Press Release Images, and Web Services Dr. Frank Summers Space Telescope Science Institute November 3, 2005.
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Event and Feature Catalogs in the Virtual Solar Observatory Joseph A. Hourclé and the VSO Team SP54A-07 : 2008 May 30.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia.
Solar and STP with AstroGrid Silvia Dalla School of Physics & Astronomy, University of Manchester A PPARC funded project.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Evanthia Hatziminaoglou, ESO - Garching Virtual Observatory Info-Workshop, SOFIA January 2008 VO Tools Overview.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
The Virtual Solar Observatory – An Operational Resource for Heliophysics Informatics Frank Hill & The VSO Team.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
AstroGrid and the Virtual Observatory John Taylor Institute for Astronomy.
MSSL Astrogrid Workshop
Working with MAVEN Data
NRAO VLA Archive Survey
Standard Query Language for VO
Data Virtualization Tutorial: JSON_TABLE Queries
Google Sky.
Presentation transcript:

AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project

Start time End time Helioscope  Solar  STP  Catalogues  STP/time lagged Retrieving solar system data: Helioscope

Helioscope - Lite Returns FITS for solar and flat files in ‘native’ format for time series (ASCII, CDF…) Data from 2 main archives : VSO (Virtual Solar Observatory) and CDAW space physics archive using: -API provided by VSO -SOAP interface to CDAW Note: at this stage requests are not in standard form, but hard coded Short term solution – users easily get data – typically already have software dealing with specific format

Astroscope / Helioscope Astroscope is based on SIAP (Simple Image Access Protocol): POS, SIZE are mandatory parameters: EG: It’s convoluted to use POS, SIZE for Solar System objects. Define a Simple Time-range Access Protocol that returns a votable listing files (either images or time series) within specified time range Mandatory parameters: START, END, FORMAT Ok also for Astronomy time based queries, eg by having optional parameters POS, SIZE. Other optional parameter could be INSTRUMENT

Helioscope - votable Returns time series data in a common format - votable DSA plugin that converts from ASCII, CDF to votable. If request spans more than 1 flat file, joins time series into a single votable Provide a framework where the data holders can specify what the local format is, and how translation to Votable should be done. NOTE: Votable does not have a url pointing to a data file any longer- the votable contains the data points themselves!

Identifying time series column in Votable In the votable containing time series data, the time field needs to be identified. 2 possible ways: (1) Introducing a datetime type in votable or (2) using a combination of UCD and Unit attributes. These are some current valid UCD words related to time: (from: ) Q | time | Time Q | time.event | Duration of an event or phenomenon Q | time.event.end | End time of event or phenomenon Q | time.event.start | Start time of event or phenomenon Q | time.obs | Observation on-time, duration Q | time.obs.end | End time of observation Q | time.obs.start | Start time of observation Q | time.resolution | Time resolution Q | time.scale | Timescale

Viewing time series TOPCAT required features: -automatic conversion from ISO time format to numeric values (column identified by UCD + Unit) -stackplot capability

Summary: Helioscope-IVOA Work towards Helioscope-lite has started IVOA work: time UCDs, Simple Time-Range Access Protocol Define a way to identify time column in votable DSA plugin / way for data centers to provide time series data as VOT Topcat support for time series

CTIP model – mode A Available to all AG users as parametrised workflow Mode B – will allow automatic fetching of Kp and F10.7 from RAL – working – being fine tuned before release

CTIP model – mode A – output & documentation Future CTIP developments: convection maps from Superdarn as input – mode C,D,… Documentation on output files – example plotting programs

STP science case workflow

STP science case results