SOLAR ORBITER Archive status Pedro Osuna Solar Orbiter Archive Scientist SOWG#7 – 6-9 July 2015.

Slides:



Advertisements
Similar presentations
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations Sep 2006, Moscow, Russia Simple Line.
Advertisements

SLAP: Simple Line Access Protocol v0.5
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
Fujitsu Laboratories of Europe © 2004 What is a (Grid) Resource? Dr. David Snelling Fujitsu Laboratories of Europe W3C TAG - Edinburgh September 20, 2005.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Snejina Lazarova Senior QA Engineer, Team Lead CRMTeam Dimo Mitev Senior QA Engineer, Team Lead SystemIntegrationTeam Telerik QA Academy SOAP-based Web.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Information System Design IT60105 Lecture 3 System Requirement Specification.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
8/28/2005ECEN5543 Req Elicitation1 Targets of Requirements Engineering ECEN 5543 SW Engineering of Standalone Programs University of Colorado, Boulder.
Solar Orbiter SOWG 5| Richard Carr| Low Latency Pipeline Hosting and Delivery Architecture | Slide 1 ESA UNCLASSIFIED – For Official Use Solar Orbiter.
SOLAR ORBITER SOC Test Plans Nana Bach SOWG#7 – 6-9 July 2015.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC Welcome and Logistics.
TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.
K-12 Web Content Development Process
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
EGY Meeting March Page 1 The Data Policy for NASA's Heliophysics Science Missions & the eGY Geoscience Information Commons D. A. Roberts.
Web Services Description Language CS409 Application Services Even Semester 2007.
Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Web Content and Supporting Tools.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado Spectroscopic lines in the VO context Mar 2007, ESAC, Madrid,
OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Overview Michael Meisinger Life Cycle Architecture Review.
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.
© 2006 DTP PMC; made available under the EPL v1.0 | July 12, 2006 | DTP Enablement Project Creation Review Creation Review: Eclipse Data Tools Platform.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Introduction / Context.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
Workshop on How to Publish Data in VO ESAC, June 25-June Tips & tricks by the Ivoa Document Coordinator Bruno Rino
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Science ESAC Cluster Final Archive Pedro Osuna Head of the Science Archives and VO Team Science Operations Department CAA-CFA Review Meeting.
SOAP-based Web Services Telerik Software Academy Software Quality Assurance.
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
Mantid Stakeholder Review Nick Draper 01/11/2007.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Lecture 4 Mechanisms & Kernel for NOSs. Mechanisms for Network Operating Systems  Network operating systems provide three basic mechanisms that support.
1 BROOKHAVEN SCIENCE ASSOCIATES High Level Applications Infrastructure and Current Status Guobao Shen, Lingyun Yang* Controls Group & Accelerator Physics.
The Virtual Heliospheric Observatory and Distributed Data Processing T.W. Narock 1,2, A. Szabo 2, A. Davis 3 1. L3 Communications,
Djc -1 Daniel J. Crichton NASA/JPL 9 May 2006 CCSDS Information Architecture Working Group.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro Osuna VOSpec Kyoto May 2005 VOSpec: A Tool to Handle VO-Compatible.
GLAST Science Support CenterAugust 10, 2004 Users’ Committee Meeting The Project Data Management Plan David Band – GSSC.
Coordination Portal/Data sources L2:Data access & Handling Points to be raised : - Downloading data sources/data via the Portal…keeping visibility of data.
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NGDC CLASS Developers Meeting July 14th, 2008 Simple NOAA Archive Access Portal.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
The Virtual Solar Observatory – An Operational Resource for Heliophysics Informatics Frank Hill & The VSO Team.
PRESENTATION OF THE TEST REGISTRY AND REPOSITORY (TRR) ON JOINUP 23 OCTOBER 2015 Roch Bertucat, ENGISIS.
IPDA Architecture Project International Planetary Data Alliance IPDA Architecture Project Report.
ACES User Interface Workshop #1 Prototype Inspection 22. November 2011.
1 TTnet An eLearning Resources Guide for training teachers and trainers
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
IPDA Standards Identification Project - Report B Gopala Krishna Elizabeth Rye Dan Crichton Steve Hughes Dave Heather Navita Thakkar.
Instrument Teams to SOC Test Specifications
AIDA Fourth Technology Forum
Archiving of solar data Luis Sanchez Solar and Heliospheric Archive Scientist Research and Scientific Support Department.
Richard Carr, ESAC, January 2015
aspects of archive system design
SOC-Instrument Team interfaces
Persistent Identifiers Implementation in EOSDIS
Concluding Remarks Paolo Padovani Head, Virtual Observatory Project Office, ESO, Garching bei München, Germany & EURO-VO Facility Centre.
Waveform Generator Update– September ‘06
Object-Oriented Design
Databases, Web Pages and Archives
Connected Vehicle Reference Implementation Architecture (CVRIA)
IEEE MEDIA INDEPENDENT HANDOVER
Waveform Generator Update– September ‘06
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Presentation transcript:

SOLAR ORBITER Archive status Pedro Osuna Solar Orbiter Archive Scientist SOWG#7 – 6-9 July 2015

Outline of presentation Solar Orbiter (SOAR) Archive Plan PI-SOC interfaces and products’ definitions Data Product Description Document (DPDD) Template SOAR User Requirements Document SOAR Archive Interoperability SOWG#7 – ESAC – 6-9 July 2015

Outline of presentation Solar Orbiter (SOAR) Archive Plan PI-SOC interfaces and products’ definitions Data Product Description Document (DPDD) Template SOAR User Requirements Document SOAR Archive Interoperability SOWG#7 – ESAC – 6-9 July 2015

Solar Orbiter Archive Plan 1.High level planning of Solar Orbiter Archive 2.Draft version 0.2 available at the SOWG#7 pages 3.Version checked by SOC and Project Scientist 4.Further inputs on Instrument Products will be filled in when available 5.SOL-SGS-PL-009_Archive_PlanSOL-SGS-PL-009_Archive_Plan SOWG#7 – ESAC – 6-9 July 2015

Outline of presentation Solar Orbiter (SOAR) Archive Plan PI-SOC interfaces and products’ definitions Data Product Description Document (DPDD) Template SOAR User Requirements Document SOAR Archive Interoperability SOWG#7 – ESAC – 6-9 July 2015

PI-SOC Interfaces and Products SOWG#7 – ESAC – 6-9 July 2015

Outline of presentation Solar Orbiter (SOAR) Archive Plan PI-SOC interfaces and products’ definitions Data Product Description Document (DPDD) Template SOAR User Requirements Document SOAR Archive Interoperability SOWG#7 – ESAC – 6-9 July 2015

DPDD Template 1.To be filled in by the Instrument Teams (ITs) 2.Detailed description of all products required for Data Archiving and Distribution 3.Describes the Science data that will be sent from the ITs to the SOC 4.Similar DPDD templates exist for Low Latency data (see presentation by Anik and Andrew) 5.Archive Data Model depends on the product definitions (specially on metadata) 6.Very bare initial archive data model given to the Archives Development Team for Proof of Concept (see Archive Plan). 7.SOL-SGS-OTH _DPDDTSOL-SGS-OTH _DPDDT 8.SOL-SGS-OTH-[RPW]-DPDD (example partially filled in)SOL-SGS-OTH-[RPW]-DPDD SOWG#7 – ESAC – 6-9 July 2015

Archive bare initial Data Model SOWG#7 – ESAC – 6-9 July 2015

Outline of presentation Solar Orbiter (SOAR) Archive Plan PI-SOC interfaces and products’ definitions Data Product Description Document (DPDD) Template SOAR User Requirements Document SOAR Archive Interoperability SOWG#7 – ESAC – 6-9 July 2015

SOAR User Requirements Document (URD) 1.Detailed requirements document given to the Archives Development Team for implementation 2.Stems from System Requirements, and adds more functionalities gathered from the community 3.Under iteration with Project Scientist before distribution to community for further evolution 4.Internal “Support Activities” created within SOC pages to ensure that all System Requirements related to Archiving are taken care of: a.SOAR-SA Archive User Requirements b.SOAR-SA Archive Roadmaps c.SOAR-SA Archive Releases Lifecycle d.SOAR-SA Archive Testing e.SOAR-SA Archive Status Reporting f.SOAR-SA Support NASA on creation of copy of the SOAR contents g.SOAR-SA Helpdesk for support on SOAR usage and data exploitation h.SOAR-SA Solar Orbiter Web Pages i.SOAR-SA SR to URD Traceability Matrix SOWG#7 – ESAC – 6-9 July 2015

Outline of presentation Solar Orbiter (SOAR) Archive Plan PI-SOC interfaces and products’ definitions Data Product Description Document (DPDD) Template SOAR User Requirements Document SOAR Archive Interoperability SOWG#7 – ESAC – 6-9 July 2015

Archive Interoperability 1.Interoperability options include: a.Machine to Machine interface b.Application to Application interface 2.Machine to Machine interface available in all ESAC archives through so called “Archive InterOperability” (AIO) system. REST interface and command line access provided through it. Can provide IVOA-TAP capabilities ( IVOA: International Virtual Observatory Alliance; TAP: Table Access Protocol ) 3.Application to Application interface available to IVOA SAMP-enabled applications (SAMP: Simple Application Messaging Protocol). 4.ESAC archives are SAMP-enabled (currently mostly interoperating with TOPCAT, Aladin, VOSpec) 5.Precedents for Solar Physics community SAMP-enabled applications tested with SolarSoft and Jhelioviewer – looks promising(Laszlo et al. IEEE Conf; thanks to Daniel M. for reference)Laszlo et al. IEEE Conf SOWG#7 – ESAC – 6-9 July 2015

Machine to Machine interoperability example (from Cluster – CAIO) 1.REST interface accessible through port 80 2.Can also be called from the “Command Line” 3.Call to service (for data and metadata) very easy to adapt for inclusion in your IDL, MATLAB, Python, etc. routines (see examples of IDL and MATLAB snippets)examples 4.Feel free to explore the Cluster AIO as en example of the future capabilities of SOAR AIOCluster AIO SOWG#7 – ESAC – 6-9 July 2015

Comments/Questions? Thank you!