1. 2008-06-26Gerard Lemson Theory in the VO and the SimDB specification Euro-VO DCA workshop Garching, June 26, 2008 Feedback questionnaire

2. 2008-06-26Gerard Lemson Overview Theory in the VO Definition Motivation Issues Standardisation for theory Existing standards Theory interest group: SimDB and SimDAP Prototype implementations

3. 2008-06-26Gerard Lemson What theory? Simulation resultss raw, “Level-0” data Post-processing, Level-1 products halo catalogues theoretical spectra... Synthetic observations (Level 2) virtual telescope Analysis (Level 3?) correlation functions power spectra... Services related to these This talk, focus on LARGE simulations and post-processing products 3+1D, spatial/temporal “micro-physics” simulations under discussion, sometimes already supported.

4. 2008-06-26Gerard Lemson Detailed observations electron density gas pressure gas temperature Courtesy Alexis Finoguenov, Ulrich Briel, Peter Schuecker, (MPE)

5. 2008-06-26Gerard Lemson Require detailed models Courtesy Volker Springel

6. 2008-06-26Gerard Lemson Observations in the VO Most VO efforts concentrate on observational data sets simple observables: photons detected at a certain time from a certain area on the sky long history of archiving pre-existing standards (FITS) valuable over long time (digitising >80 yr old plates) Standards observationally biased common sky: cone search, SIAP, region common objects: XMatch data models: characterisation of sky/time/energy, STC

7. 2008-06-26Gerard Lemson Theory in the VO: issues Simulations not so simple Complex observables, non-standard No standardisation on data formats or metadata Archiving ad hoc, for local use Moore’s law makes useful lifetime relatively short: few years later can do better Current IVOA standards somewhat irrelevant No common sky No common objects New data models required for content, physics, code

8. 2008-06-26Gerard Lemson “Moore’s law” for N-body simulations Courtesy Simon White Millennium Run Mare Nostrum

9. 2008-06-26Gerard Lemson Historical simulations Toomre & Toomre, 1972 Di Matteo, Springel and Hernquist, 2005 Volker Springel

10. 2008-06-26Gerard Lemson Theory in the VO: issues Simulations not so simple Complex observables, non-standard No standardisation on data formats or metadata Archiving ad hoc, for local use Moore’s law makes useful lifetime relatively short: few years later can do better Current IVOA standards somewhat irrelevant No common sky No common objects New data models required for content, physics, code

11. 2008-06-26Gerard Lemson So why bother? Simulations are interesting: For many cases only way to see processes in action Complex observations require sophisticated models for interpretation Bridging gap in specialisations: not everyone has required expertise to create simulations, though they can analyse them. Many use cases do not require the latest/greatest exposure time calculator survey design

12. 2008-06-26Gerard Lemson DAL standards Similarity of products SSAP theory spectra SCS-like mock catalogues SIAP-like visualisation services

13. 2008-06-26Gerard Lemson Other Registry Allows any web service ADQL + TAP theory SkyNode (Rick Wagner) Millennium Run (see later today) Applications VisIVO (see later today) Semantics theory UCDs Vocabularies/ontologies for astronomical objects, physical processes,...

14. 2008-06-26Gerard Lemson SimDB and SimDAP Effort of IVOA theory interest group Originally attempt at S*AP protocol for simulations (SNAP) queryData getData DAL v2: based on data model. queryData in terms of elements in DM getData special attention large datasets no uniform formats see SimDAP presentation (Claudio Gheller)

15. 2008-06-26Gerard Lemson SimDB: Simulation Database Supports discovery of interesting simulation results. and links to (SimDAP)services for accessing them Rich data model describing simulations and post-processing products Focused on 3+1D simulations but easily extended

16. 2008-06-26Gerard Lemson Common questions What was simulated? LSS, galaxy merger, rings of Saturn What physics was included? gravity only, hydrodynamics, chemistry How is the world represented? N bodies, adaptive mesh, spherically symmetric 1D What properties are calculated? position, velocity, mass, temperature, density, chemical abundances How do I get access? etc.

17. 2008-06-26Gerard Lemson SimDB: Data model (in progress)Data model

18. 2008-06-26Gerard Lemson File

19. 2008-06-26Gerard Lemson Storage

20. 2008-06-26Gerard Lemson Results of Experiments

21. 2008-06-26Gerard Lemson Experiments

22. 2008-06-26Gerard Lemson Protocol

23. 2008-06-26Gerard Lemson Parameters

24. 2008-06-26Gerard Lemson Target

25. 2008-06-26Gerard Lemson Web service

26. 2008-06-26Gerard Lemson SimDB data modeldata model

27. 2008-06-26Gerard Lemson Complex? Registry data model Spectrum Data Model STC SDSS SkyServer etc.

28. 2008-06-26Gerard Lemson Representations (Generated)* XML Schemas Protocol: PDR code (courtesy Franck LePetit + Laurent Bourges) Simulation: Millennium Run Ideally generated from simulation and post-processing pipe-lines Relational Database Schema Java code HTML * http://code.google.com/p/volute/wiki/TheoryHomehttp://code.google.com/p/volute/wiki/TheoryHome

29. 2008-06-26Gerard Lemson XML fragments (PDR protocol)

30. 2008-06-26Gerard Lemson Representations (Generated)* XML Schemas Protocol: PDR code (courtesy Franck LePetit + Laurent Bourges) Simulation: Millennium Run Ideally generated from simulation and post-processing pipe-lines Relational Database Schema Java code HTML * http://code.google.com/p/volute/wiki/TheoryHomehttp://code.google.com/p/volute/wiki/TheoryHome

31. 2008-06-26Gerard Lemson RDB views (ADQL/TAP interface)

32. 2008-06-26Gerard Lemson RDB tables (generated)

33. 2008-06-26Gerard Lemson Representations (Generated)* XML Schemas Protocol: PDR code (courtesy Franck LePetit + Laurent Bourges) Simulation: Millennium Run Ideally generated from simulation and post-processing pipe-lines Relational Database Schema Java code HTML * http://code.google.com/p/volute/wiki/TheoryHomehttp://code.google.com/p/volute/wiki/TheoryHome

34. 2008-06-26Gerard Lemson SimDB: Implementation Complex data model requires more advanced support Simple HTTP requests insufficient Browsing or full query language needed More registry than S*AP queryData a few central sites (France, Germany, Italy, USA) with advanced access methods

35. 2008-06-26Gerard Lemson (Laurent Bourges)

36. 2008-06-26Gerard Lemson Access Services (in progress) ADQL+TAP relational mapping global-as-view wrapping “REST” XML documents GET and PUT (and DELETE ?) OAI ala Resource Registry harvesting Web Browsing (example)example Fully generated support possible (in progress)

37. 2008-06-26Gerard Lemson Prototypes CNRS GalMER ITVO Trieste: http://wwwas.oats.inaf.it/IA2/ITVOhttp://wwwas.oats.inaf.it/IA2/ITVO Catania: http://itvo.oact.inaf.ithttp://itvo.oact.inaf.it Under development SimCat (UCSD) PDR/SimDB (Paris) Horizon/GalICS (Lyon) GAVO (hydro simulations)

38. 2008-06-26Gerard Lemson Main message SimDB/SimDAP in progress Participate in the IVOA theory interest group If you have a “theory service” whether standard or not: wrap it deploy it register it

39. 2008-06-26Gerard Lemson Thank you. Thanks to Ugo Becciani Laurent Bourges Igor Chillingarian Claudio Gheller Norman Gray Franck LePetit Mireille Louys Patrizia Manzato Rick Wagner Hervé Wozniak