EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC 20071 Spectrum Services 2007 László Dobos (ELTE)

Slides:



Advertisements
Similar presentations
Footprint Service Specification NVO Summer School 2008 Gretchen Greene (thanks to Tamas Budavari and Francois Bonnarel) T HE US N ATIONAL V IRTUAL O BSERVATORY.
Advertisements

Demonstration of VO Tools and Technology Tamás Budavári Johns Hopkins University.
Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science.
Applications of UDFs in Astronomical Databases and Research Manuchehr Taghizadeh-Popp Johns Hopkins University.
Physical Properties of Spectroscopically-Confirmed z>6 Galaxies By Charles Griffin With special thanks to Dr. Eiichi Egami, and Dr. Benjamin Clément NASA.
László Dobos 1,2, Tamás Budavári 2, Nolan Li 2, Alex Szalay 2, István Csabai 1 1 Eötvös Loránd University, Budapest,
National Center for Supercomputing Applications 259 th fastest computer in the world Michael Remijan NCSA –Research Programmer –Web-based Distributed Programming.
GENEVAC: An Application for Calculating, Viewing and Storing Gamma-ray Burst Data Sam Stafford The Ohio State University Department of Physics GRB Temporal.
Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.
SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.
Passage Three Introduction to Microsoft SQL Server 2000.
Numerical Grid Computations with the OPeNDAP Back End Server (BES)
Migale Virtual Instrument to study the evolution of galaxies BulgariaFranceRussia
Upcoming Enhancements to the HST Archive Mark Kyprianou Operations and Engineering Division Data System Branch.
Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.
Spatial Indexing and Visualizing Large Multi-dimensional Databases I. Csabai, M. Trencséni, L. Dobos, G. Herczegh, P. Józsa, N. Purger Eötvös University,
OCLC Online Computer Library Center CONTENTdm ® Digital Collection Management Software Ron Gardner, OCLC Digital Services Consultant ICOLC Meeting April.
New Insight Into the Dust Content of Galaxies Based on the Analysis of the Optical Attenuation Curve.
3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,
AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center.
Toledo, MPA access methods and plans With contributions from JHU : Alex Szalay, Jan Vanderberg MPA: Jeremy Blaizot,
The ASDC SED Builder Milvia Capalbi (INAF-ASDC) in collaboration with Paolo Giommi (ASI-ASDC), Giulia Stratta (INAF-ASDC), Roberto Primavera (ElsagDatamat)
Spatial Indexing of large astronomical databases László Dobos, István Csabai, Márton Trencséni ELTE, Hungary.
What can we learn from the luminosity function and color studies? THE SDSS GALAXIES AT REDSHIFT 0.1.
A Survey of Patent Search Engine Software Jennifer Lewis April 24, 2007 CSE 8337.
2004/12/02Slide Number 1 of 15 Exposure Time Calculator (ETC) as a Web Service Donald McLean 2004 Technology Open House.
Astronomical Spectroscopy and the Virtual Observatory ESAC, March 2007 VO tools and cross-calibration Pedro García-Lario European Space Astronomy.
Copyright © 2006 Knovel Corporation Streamline Your Science and Engineering Research
SDSS Quasars Spectra Fitting N. Kuropatkin, C. Stoughton.
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
Making FITS available in.NET and its Applications Vivek Haridas 1, Tamas Budavari 1, William O'Mullane 1, Alex Szalay 1, Alberto Conti 2, Bill Pence 3,
Indexing and Visualizing Multidimensional Data I. Csabai, M. Trencséni, L. Dobos, G. Herczegh, P. Józsa, N. Purger Eötvös University,Budapest.
ICDL 2004 Improving Federated Service for Non-cooperating Digital Libraries R. Shi, K. Maly, M. Zubair Department of Computer Science Old Dominion University.
Managing the Impacts of Change on Archiving Research Data A Presentation for “International Workshop on Strategies for Preservation of and Open Access.
Gyöngyi Kerekes Eötvös Lóránd University, Budapest MAGPOP 2008, Paris István Csabai László Dobos Márton Trencséni.
SDSS photo-z with model templates. Photo-z Estimate redshift (+ physical parameters) –Colors are special „projection” of spectra, like PCA.
Crossmatch: the NRAO Cross-identifcation Service Jared Crossley Data Archive Access Meeting - Socorro, NM - 5 April 2010.
Sciamachy features and usage with respect to end-users The typical fate of retrieval people dealing with large datasets… C. Frankenberg, SRON team, IUP.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems Photometric parallax estimation using the MILES catalog and BaSeL models István Csabai.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Andrea Laruelo IVOA Interoperability Cambridge September 2007 Mathematical.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Ching-Wa Yip Johns Hopkins University.  Alex Szalay (JHU)  Rosemary Wyse (JHU)  László Dobos (ELTE)  Tamás Budavári (JHU)  Istvan Csabai (ELTE)
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 HIPE Introduction and Setup for SPIRE David Shupe, NHSC/IPAC on behalf of the SPIRE.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
TSS Database Inventory. CIRA has… Received and imported the 2002 and 2018 modeling data Decided to initially store only IMPROVE site-specific data Decided.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Web based spectrum databases and utilities László Dobos Tamás Budavári István Csabai MAGPOP kick-off meeting, January Cassis.
Reproducing the Observed Universe with Simulations Qi Guo Max Planck Institute for Astrophysics MPE April 8th, 2008.
Feb 24-27, 2004ICDL 2004, New Dehli Improving Federated Service for Non-cooperating Digital Libraries R. Shi, K. Maly, M. Zubair Department of Computer.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
ESAVO/European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro Osuna ASVOWS Mar 2007 ESAC Astronomical Spectroscopy.
Page 1 PACS GRITS 17 June 2011 Herschel Data Analysis Guerilla Style: Keeping flexibility in a system with long development cycles Bernhard Schulz NASA.
Session id: Darrell Hilliard Senior Delivery Manager Oracle University Oracle Corporation.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Budapest Group Eötvös University MAGPOP kick-off meeting Cassis 2005 January
June 27-29, DC2 Software Workshop - 1 Tom Stephens GSSC Database Programmer GSSC Data Servers for DC2.
USM Photometric Redshifts for Astro-wise
Spectral classification of galaxies of LAMOST DR3
The JWST Exposure Time Calculator
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
Photometric redshift estimation.
The JWST Exposure Time Calculator
ESAC 2017 JWST Workshop JWST User Documentation Hands on experience
Google Sky.
Bandpass and Spectrum Services for the VO
SVO - ESAVO Use case: Comparison of evolutionary synthesis models
X-ray high resolution spectra in the VO: the case of XMM-Newton RGS
Presentation transcript:

EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE) Tamás Budavári (JHU), István Csabai (ELTE)

VO Spectroscopy Workshop, ESAC MOTIVATIONS SDSS Data Archive Server offers very limited possibility to search among spectra SkyServer has nice search features, but does not contain the spectra Observed spectra are in many formats: –binning –wavelength scale (air / vacuum) –extinction correction –file format

VO Spectroscopy Workshop, ESAC SPECTRUM & FILTER SERVICES Database of spectra Wide range of search possibilities Preprocessing spectra on the fly Data analysis Access to data in many file formats Plot spectra Web interface Web service to program against Filter service: database of optical instrument band-pass curves

VO Spectroscopy Workshop, ESAC 20074

5

6 AVAILABLE SPECTRA Repository of observed and theoretical spectra –SDSS DR1-DR5 (1M spectra in DR5 only) –2dF (250k) –BaSeL stellar library –Bruzual-Charlot stochastic burst model library (100k) 'My Spectrum' is a public repository where users can upload their own measurements or save results of spectrum processing.

VO Spectroscopy Workshop, ESAC SEARCH POSSIBILITIES Cone search - search by coordinates and radius ID search - if you know the database identifier (ie. from SkyServer) Object search - by a list of coordinates Redshift search Advanced search - with many basic options Region search - gives back spectra of objects in a complex, arbitrary area Similarity search - based on PCA

VO Spectroscopy Workshop, ESAC REGION SEARCH The new Footprint Service allows defining complex regions on the sphere Spectrum Services link to the Footprint Service to get region description Spectra observed in the given region can be retrieved from the database

VO Spectroscopy Workshop, ESAC 20079

10 4. SIMILAR SPECTRUM SEARCH Spectra are expanded on a predefined basis PCA (see Ching-Wa's talk) or model spectra Coefficients are stored in a multi-dimensional database Database is indexed by special spatial indices N-Nearest neighbour search in the coefficient space Not necessarily physical, still interesting

VO Spectroscopy Workshop, ESAC GALAXIES

VO Spectroscopy Workshop, ESAC PREPROCESSING TOOLS General functions to convert spectra to the same format to use in analysis Functions: –Correction for galactic extinction –Rest frame –Normalization –Rebinning –Vacuum - Air wavelength conversion Download preprocessed spectra (XML, VOTable, ASCII) Store them in 'MySpectrum' for later use

VO Spectroscopy Workshop, ESAC ANALYSIS TOOLS Composite spectrum: –average, median Convolution with filters from Filter Service synthetic magnitude calculation Continuum and line fitting The new version will be really fast: –Parallel computation on multiple processor –optimized LAPACK libraries

VO Spectroscopy Workshop, ESAC

VO Spectroscopy Workshop, ESAC SUMMARY & FUTURE WORKS Spectrum database and public repository Web site & web service Integration with other VO services: –Filter Service, Footprint Service Preprocessing and analyzis tools Improved line fitting algorithm Make similarity search public Latest VO standard implementation

VO Spectroscopy Workshop, ESAC URLs OF INTEREST Spectrum Services Filter Service Footprint Service

VO Spectroscopy Workshop, ESAC

VO Spectroscopy Workshop, ESAC Distribution of SDSS objects in the space of SDSS galaxy eigenspectra Galaxies Stars QSOs

VO Spectroscopy Workshop, ESAC WEB INTERFACE For interactive use by humans Concept: try the functions on the web page, but use the web service for batch processing Register / login Search and display results in a nice format 'Wizards' to guide users through the pages of many parameters of scientific functions Download spectra in XML, VOTable, ASCII (No implementation of the latest DM yet)

VO Spectroscopy Workshop, ESAC SPEEDING UP SPECTRUM SERVICES Objective: processing hundreds of thousands of spectra Moved to.Net Better computing performance Streamlined processing of spectra –Minimal memory usage –No upper limit for number of spectra Multi-processor support –parallel execution of processing routines Optimized LAPACK integration: –MKL (intel), ACML (AMD)

VO Spectroscopy Workshop, ESAC THE ECOEFF SPACE DR4 galaxy eigenspectra used as basis (Yip et. al 2002) from gappy PCA algorithm All spectra (even stars and QSOs) are expressed on this basis Our method: minimal χ 2 fitting (with masks etc.) Applied to: –SDSS DR5 –Charlot's stochastic 100k spectrum set Objective: find physical parameters very quickly