Theory in the German Astrophysical VO Summary: We show results of efforts done within the German Astrophysical Virtual Observatory (GAVO). GAVO has paid.

Slides:



Advertisements
Similar presentations
Building a Mock Universe Cosmological nbody dark matter simulations + Galaxy surveys (SDSS, UKIDSS, 2dF) Access to mock catalogues through VO Provide analysis.
Advertisements

Remote Visualisation System (RVS) By: Anil Chandra.
GridVine: Building Internet-Scale Semantic Overlay Networks By Lan Tian.
General Financial Supply Website & E-Commerce Solutions This presentation will demo the GFS corporate website and On-Line Order Inquiry options available.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Why Environment Matters more massive halos. However, it is usually assumed in, for example, semianalytic modelling that the merger history of a dark matter.
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
Data-Intensive Computing in the Science Community Alex Szalay, JHU.
Distributed Data Analysis & Dissemination System (D-DADS) Prepared by Stefan Falke Rudolf Husar Bret Schichtel June 2000.
Web Programming Language Dr. Ken Cosh Week 1 (Introduction)
Page 1 ISMT E-120 Introduction to Microsoft Access & Relational Databases The Influence of Software and Hardware Technologies on Business Productivity.
Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
Modelling radio galaxies in simulations: CMB contaminants and SKA / Meerkat sources by Fidy A. RAMAMONJISOA MSc Project University of the Western Cape.
Implementation Yaodong Bi. Introduction to Implementation Purposes of Implementation – Plan the system integrations required in each iteration – Distribute.
Millennium Data Dissemination MPA institute seminar1 possible extensions how ambitious can/should we be?
Toledo, MPA access methods and plans With contributions from JHU : Alex Szalay, Jan Vanderberg MPA: Jeremy Blaizot,
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
TIG session 3+Millennium database Millennium Database Overview and some first usage experiences Gerard Lemson and the Virgo Consortium astro-ph/
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
Hello!. International Virtual Observatory Alliance Ajit Kembhavi, IUCAA, Pune.
, Tuorla Observatory 1 Galaxy groups in ΛCDM simulations and SDSS DR5 P. Nurmi, P. Heinämäki, S. Niemi, J. Holopainen Tuorla Observatory E. Saar,
Cosmological simulations in a relational database: modelling and storing merger trees Gerard Lemson, GAVO, Max-Planck-Institut für extraterrestrische Physik,
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
Victoria, May 2006 DAL for theorists: Implementation of the SNAP service for the TVO Claudio Gheller, Giuseppe Fiameni InterUniversitary Computing Center.
4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.
Dissemination of simulations in the Virtual Observatory Gerard Lemson German Astrophysical Virtual Observatory, Max-Planck Institute for extraterrestrial.
Theory in the Virtual Observatory Gerard Lemson, GAVO.
Digital Earth Communities GEOSS Interoperability for Weather Ocean and Water GEOSS Common Infrastructure Evolution Roberto Cossu ESA
Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.
COMU114: Introduction to Database Development 1. Databases and Database Design.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
Wiss. Beirat AIP, ClusterFinder & VO-Methods H. Enke German Astrophysical Virtual Observatory ClusterFinder VO Methods for Astronomical Applications.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
Millennium Data Dissemination databases and other services Millennium Workshop1.
Performance evaluation on grid Zsolt Németh MTA SZTAKI Computer and Automation Research Institute.
State Key Laboratory of Resources and Environmental Information System China Integration of Grid Service and Web Processing Service Gao Ang State Key Laboratory.
CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.
GES 2007, The German Astrophysical Virtual Observatory (GAVO) Knowledge Networking for Astronomy in Germany and abroad Gerard Lemson 1,2, Wolfgang.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Modeling the dependence of galaxy clustering on stellar mass and SEDs Lan Wang Collaborators: Guinevere Kauffmann (MPA) Cheng Li (MPA/SHAO, USTC) Gabriella.
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
Digital Libraries Lillian N. Cassel Spring A digital library An informal definition of a digital library is a managed collection of information,
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Strasbourg, EURO-VO DCA First Board Meeting (GA)VO projects at MPG(E) and participation in VO-DCA (tbcd) Wolfgang Voges, Gerard Lemson.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
1 Analysing Cosmological Simulations in the Virtual Observatory: Designing and Mining the Millennium Simulation Database Gerard Lemson German Astrophysical.
Reproducing the Observed Universe with Simulations Qi Guo Max Planck Institute for Astrophysics MPE April 8th, 2008.
1 « Luxembourg, 18 April 2007 « Virtual Library of Official Statistics « Dissemination Working Group.
FACES General Overview ViRR (Virtueller Raum Reichsrecht) Software Solutions Kristina Büchner and Bastien Saquet Contact:Kristina Buechner:
Copyright © 2016 Pearson Education, Inc. Modern Database Management 12 th Edition Jeff Hoffer, Ramesh Venkataraman, Heikki Topi CHAPTER 11: BIG DATA AND.
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
Introduction to FFI: Why and how FFI was developed Introduction to FFI: Why and how FFI was developed 04/02/2013.
JENAM 2008 Theory Standards for the Virtual Observatory SimDB + SimDAP.
Web Programming Language
Archiving of solar data Luis Sanchez Solar and Heliospheric Archive Scientist Research and Scientific Support Department.
The mock galaxy catalogue for HI survey based on SAMs of galaxy formation 富坚 Guiyang, FRA2015 Shanghai Astronomical Observatory.
Tamas Szalay, Volker Springel, Gerard Lemson
Virtual Observatory for cosmological simulations
12 Product Configurator
Intermountain West Data Warehouse
Observing with Modern Observatories (the data flow)
German Astrophysical Virtual Observatory
Maria Teresa Capria December 15, 2009 Paris – VOPlaneto 2009
Scientific Workflows Lecture 15
Presentation transcript:

Theory in the German Astrophysical VO Summary: We show results of efforts done within the German Astrophysical Virtual Observatory (GAVO). GAVO has paid special attention to the introduction of theory data (simulations) into the Virtual Observatory (VO). The main emphasis of GAVO in this context was to investigate the use of relational database technology in the analysis of results of large scale structure simulations, as well as in their online publication. The former may lead to direct scientific benefits to the owners of the data, the latter leads to benefits to the larger community that gets access to the data in a well defined and standardized manner. We also show prototypes of so called Virtual Telescopes, online services to “observe” simulation results so as to produce results that can be directly, or almost directly, be compared to observations of similar objects as were simulated. Gerard Lemson and Wolfgang Voges, GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching, Germany Fig 2: GAVO web interface for querying the Millennium databases. Results can be obtained in a variety of formats and can be visualised online using the VO-India’s VOPlot facility. Fig 1: Illustration of the merger tree structure of objects (halos/galaxies) in the simulation. The black lines indicate the traditional, descendant pointers. The red lines indicate the pointer structure used in the database model. Abstract [1] The Millennium Run is the largest simulation of the formation of structure within the LCDM cosmogony so far carried out. It uses 1010 particles to follow the dark matter distribution in a cubic region 500h−1Mpc on a side, and has a spatial resolution of 5 h−1kpc. Application of simplified modelling techniques to the stored output of this calculation allows the formation and evolution of the ∼ 10 7 galaxies more luminous than the Small Magellanic Cloud to be simulated for a variety of assumptions about the detailed physics involved. As part of the activities of GAVO we have used a relational database to store the detailed assembly histories both of all the haloes and subhaloes resolved by the simulation, and of all the galaxies that form within these structures for two independent models of the galaxy formation physics. We have created web applications (see Fig. 2) that allow users to query these databases remotely using the standard Structured Query Language (SQL). This allows easy access to all properties of the galaxies and halos, as well as to the spatial and temporal relations between them and their environment. Information is output in table format compatible with standard Virtual Observatory tools and protocols. With this announcement we are making these structures fully accessible to all users. Interested scientists can learn SQL, gain familiarity with the database design and test queries on a small, openly accessible version of the Millennium Run (with volume 1/512 that of the full simulation). They can then request accounts to run similar queries on the databases for the full simulations. Time evolution, merger trees In contrast to most observational database, time evolution is an integral part of simulation results. In the case of the Millennium database, this is embodied in the storage of merger trees of both dark matter halos and galaxies. To store such hierarchical data structures in a relational database we invented a new method that allows fast retrieval of the history (and future) of arbitrary nodes in the tree. As illustrated in Fig.1, it relies on assigning identifiers according to a depth-first ordering of the nodes in a tree and assigning pointers (foreign keys) pointing from each node to the last of its progenitors in that ordering (the red arrows in the figure). As can be easily seen, the complete merger tree for a given node (e.g. the one with ID=1) can be retrieved by the following query: select p.* from halos d, halos p where d.id = 1 and d.id <= p.id and p.id <= d.lastProgenitorId For more details see [2] and the documentation on the website [3]. The Millennium Database References and further links [1] Lemson & the Virgo Consortium, astro-ph/ [2] Lemson & Springel, 2006, ADASS XV, p212 [3] [4] [5] Acknowledgments We thank Alex Szalay and his coworkers for their support in the development of the Millennium Database. We thank Jeremy Blaizot, Klaus Dolag and the Planck group at MPA for their support in the development of the various virtual telescope prototypes. The GAVO is funded by the German Federal Ministry for Education and Research. Fig 5: A first example of a full virtual telescope configuration, the Planck simulator at vo.org/planck. The user can enter cosmological and observer parameters as well as choose from a variety of foregrounds to include. An online “virtual observation” results in maps in standard FITS format, for comparison to real observations or for use in preparation of analysis software. vo.org/planck Fig 3: Two examples of a virtual telescope, one creating mock light-cones through a cosmological simulation, the other creating images of hydro simulations of galaxy clusters Virtual telescope protypes at GAVO Here we show examples of existing web applications that illustrate the concept of the virtual telescope. By modeling the relevant aspects of the real observational configuration, including sources, possible absorbing/emitting/lensing foregrounds as well as the instrumental characteristics, virtual telescopes produce mock images that can be directly compared to real observations, possibly using tools developed for real observations. As such, virtual telescopes form an important ingredient of the so called theory/ observational interface, through which the virtual observatory aims to bridge the gap between observers and theorists. The examples of this page are all available on the GAVO web pages for online execution. Interoperability Within the International VO Alliance (IVOA), GAVO leads the efforts to introduce theory in the IVOA’s standards process. As an example of this serves the “virtual telescope configuration” use case, illustrated in Fig. 4 below. This use case describes a distributed, modular architecture of cooperating components, each modeling a part of a real observation. These are implemented according to standard APIs and interoperate by sending data structures following standard data models. Components here are a photon source (simulation result), foregrounds and virtual telescope. And importantly the “pre-observation image” (POI) which models photons streaming from source to telescope. See [4] for more details and future developments Results Virtual Telescopes Fig 4: Illustration of Virtual telescope use case, used in the IVOA theory interest group [5].