The SKADS sky and databases F. Levrier, R. Wilman, D. Obreschkow, H.-R. Klöckner, S. Rawlings (Oxford Astrophysics) D. Olteanu, S. Young (Oxford e-Research.

Slides:

Advertisements

Similar presentations

The Size, Scale and Structure of the Universe

Advertisements

MAP REDUCE PROGRAMMING Dr G Sudha Sadasivam. Map - reduce sort/merge based distributed processing Best for batch- oriented processing Sort/merge is primitive.

To measure the brightness distribution of galaxies, we must determine the surface brightness of the resolved galaxy. Surface brightness = magnitude within.

Jeroen Stil Department of Physics & Astronomy University of Calgary Stacking of Radio Surveys.

The North American Carbon Program Google Earth Collection Peter C. Griffith, NACP Coordinator; Lisa E. Wilcox; Amy L. Morrell, NACP Web Group Organization:

Lettuce genetic map viewer is written in PHP and uses GD library. The viewer interacts with tables in the relational mySQL database and creates graphical.

LUNARC, Lund UniversityLSCS 2002 Transparent access to finite element applications using grid and web technology J. Lindemann P.A. Wernberg and G. Sandberg.

Status report on Light Simulator Claudia Cecchi Francesca Marcucci Monica Pepe Software meeting Udine January

Pu, Hung-Yi Institute of Astronomy, National Tsing-Hua University The Effects of Photon Path Bending on the Observed Pulse Profile and Spectra of Surface.

A Web service for Distributed Covariance Computation on Astronomy Catalogs Presented by Haimonti Dutta CMSC 691D.

CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Continuous random variables Uniform and Normal distribution (Sec. 3.1, )

Particle Astrophysics & Cosmology SS Chapter 8 Structure Formation.

The Milky Way Center, Shape Globular cluster system

What is the Milky Way Like? Chapter Since we are inside it, we cannot see the whole galaxy Since we are inside it, we cannot see the whole galaxy.

Chapter 14 Our Galaxy The Milky Way Revealed Our Goals for Learning What does our galaxy look like? How do stars orbit in our galaxy?

Intranet and internet based software components. 2 Overview  What are intranet and internet based map applications?  System Requirements  Architecture.

Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.

Leicester, February 24, 2005 VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis. VO-TECH Project. Stage01 Ugo Becciani INAF – Astrophysical.

Overview of Astronomy AST 200. Astronomy Nature designs the Experiment Nature designs the Experiment Tools Tools 1) Imaging 2) Spectroscopy 3) Computational.

Steve Torchinsky SKADS Science Overview Lisbon 2007 Jan 12 SKADS Science Overview.

CASS-2006 (August 2006). The original results and software presented by the author: Jacqueline Keane. IDL implementation.

OCCAM capstone Spring 2015 OCCAM: repository for open-access, collaborative computer architecture research. Too many simulators to test too many parameters.

The ASDC SED Builder Milvia Capalbi (INAF-ASDC) in collaboration with Paolo Giommi (ASI-ASDC), Giulia Stratta (INAF-ASDC), Roberto Primavera (ElsagDatamat)

Search for planetary candidates within the OGLE stars Adriana V. R. Silva & Patrícia C. Cruz CRAAM/Mackenzie COROT /11/2005.

Whirlwind Tour of Hadoop Edward Capriolo Rev 2. Whirlwind tour of Hadoop Inspired by Google's GFS Clusters from systems Batch Processing High.

F. Levrier The SKADS sky databases 4 th SKADS Workshop, Lisbon, 2-3 October 2008 The SKADS sky databases F. Levrier and the Oxford SKADS team.

The Radio Sky Matt Jarvis (not Steve Rawlings!) University of Hertfordshire.

IVC : a simulation and model-fitting tool for optical-IR interferometry Abstract I present a new software tool, called “Interferometry Visibility Computations”

Chapter 25 Galaxies and Dark Matter Dark Matter in the Universe We use the rotation speeds of galaxies to measure their mass:

Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:

F. Levrier (LERMA - ENS) J. Pety (LERMA - IRAM Grenoble) P. Salomé (LERMA - Observatoire de Paris) STAR FORMAT meeting, Heidelberg, 4-5 may 2010 Making.

End to End Simulations. p.2 What’s this ? This is the MUSE datacube of NGC 1068 we just received from ESO Can you remind me how many students we have.

Steve Rawlings2nd SKADS Workshop, Paris, October 2007 Science Simulations Steve Rawlings (Oxford) Richard Wilman, Sadegh Khochfar, Hans- Rainer Klöckner,

Wiss. Beirat AIP, ClusterFinder & VO-Methods H. Enke German Astrophysical Virtual Observatory ClusterFinder VO Methods for Astronomical Applications.

Spin, jet-feedback and black-hole growth Steve Rawlings & Tom Mauch Sub-Department.

How to use galfit (and galphot)

Spiral arms in the milky way galaxy and cosmic rays

GALFA Software Group GALFA-HI –Narrow-band spectral line data cubes of HI emission GALFA-RRL –Narrow-bad spectral line data cubes of recombination lines.

1 Mode Parameter Variations from GONG Ring Diagrams: An Update Rachel Howe, NSO.

Mário Santos1 EoR / 21cm simulations 4 th SKADS Workshop, Lisbon, 2-3 October 2008 Epoch of Reionization / 21cm simulations Mário Santos CENTRA - IST.

Analysis methods for Milky Way dark matter halo detection Aaron Sander 1, Larry Wai 2, Brian Winer 1, Richard Hughes 1, and Igor Moskalenko 2 1 Department.

Robbie Auld1 Simulated HI Observations 4 th SKADS Workshop, Lisbon, 2-3 October 2008 Simulated HI observations Robbie Auld Cardiff University collaborating.

ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.

HACR at Virgo: implementation and results Gabriele Vajente 12 th ILIAS WG1 meeting Geneva, March 29 th -30 th 2007.

Rotation curves and spiral arms in galaxies - observations and theory

Web based spectrum databases and utilities László Dobos Tamás Budavári István Csabai MAGPOP kick-off meeting, January Cassis.

Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.

Copyright © 2010 Pearson Education, Inc. Chapter 16 Galaxies and Dark Matter Lecture Outline.

Steve Rawlings1 DS2-T1 Overview 4 th SKADS Workshop, Lisbon, 2-3 October 2008 Science Simulations (DS2-T1) Overview With thanks to Hans-Rainer Klöckner.

The dependence on redshift of quasar black hole masses from the SLOAN survey R. Decarli Università dell’Insubria, Como, Italy A. Treves Università dell’Insubria,

M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.

Klöckner1 SKADS tools 2 SKA simulation 4 th SKADS Workshop, Lisbon, 2-3 October 2008.

Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –

EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.

AMGA-Bookkeeping Carmine Cioffi Department of Physics, Oxford University UK Metadata Workshop Oxford, 05 July 2006.

Chapter 25 Galaxies and Dark Matter. 25.1Dark Matter in the Universe 25.2Galaxy Collisions 25.3Galaxy Formation and Evolution 25.4Black Holes in Galaxies.

Bootstrapping James G. Anderson, Ph.D. Purdue University.

Michael RupenEVLA Phase II Definition Meeting Aug 23 – 25, EVLA Phase II Scientific Overview Michael P. Rupen.

T-RECS the Tiered Radio Extragalactic Continuum Simulation

A Total Recall of Data Usage for the MWA Long Term Archive

USM Photometric Redshifts for Astro-wise

The JWST Exposure Time Calculator

A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo

Lecture 32- Properties of the Milky Way (cont)

Milky Way and Galaxies.

Databases, Web Pages and Archives

Chapter 14 Spiral Galaxy.

Stellar spectroscopy with XTGRID

Presentation transcript:

The SKADS sky and databases F. Levrier, R. Wilman, D. Obreschkow, H.-R. Klöckner, S. Rawlings (Oxford Astrophysics) D. Olteanu, S. Young (Oxford e-Research Center) DS2-T1 MEETING LISBON JANUARY 7, 2008

ASCII files large quantities of data (~45 Gb) Output from continuum and line simulations Source typeSourcesComponents Radio-quiet AGN36,132,5661 FRI23,853,1343 FRII2,3545 “Normal” galaxies168,046,3301 Starburst galaxies7,267,3821 Example: continuum simulations - 235,301,766 sources

Data distribution and map making Query data based on position, source type, flux limit... Requires database structure (MySQL / PostgreSQL) Continuum simulations database + HI line simulations database For each database : source tables + cluster table Example: continuum simulations database Source tableCluster table Unique source index per substructure NULL values for Q,U,V fluxes Max. number of entries per table: 1,000,000

Making the SKADS continuum sky Read structure information position - size - orientation - reference fluxes Input map parameters region - source types - resolution - frequency - flux limit Query databases Build template image Compute flux Scale template image Paste into full map

Making the SKADS HI line sky (I) First low resolution : synthetic spectra HI flux Synthetic double-peaked shape

Galaxy models made of “clouds” Placed according to density profile Orbiting according to velocity curve 5 galaxy types (spirals and irregulars) 46 inclination values (0-90 degrees) 5 asymptotic velocities Making the SKADS HI line sky (II) Second high resolution : template cubes from R. Boomsma S0-Sab scale / rotate / paste

Map Maker Standalone application in Python / IDL SQL/Python interface FITS output

Central square degree of the continuum simulations Radio-quiet AGNFR IFR II “Normal” galaxiesStarburst

Where we stand, where we’re going Database implementation IDL to python conversion of Map Maker Release of central square degree data in the test phase (~100 Mb) Testing of simulation output (T. Mauch, F. Abdalla, T. Kitching) Hosting of the database server by OeRC Implementation of web interface for database and imaging queries Release of Map Maker Release of the full simulations Interface with a MeqTrees sky model

MeqTrees interfaces with AIPS++ Measurement Sets, but it doesn’t build them from scratch Local MS generator: python interface to a glish script from T. Willis Can use existing configurations or generate random ones Measurement Set Generator