Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science.

Slides:



Advertisements
Similar presentations
Trying to Use Databases for Science Jim Gray Microsoft Research
Advertisements

SDSS-II Development Projects Bill Boroski SDSS-II First Year Review National Science Foundation August 7, 2006.
1 Galaxy Decomposition Service Yogesh Wadadekar (STScI) Milan Bogosavljević (Caltech) Ashish Mahabal (Caltech)
VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.
Demonstration of VO Tools and Technology Tamás Budavári Johns Hopkins University.
Database Management Using Microsoft Access Xinhua Chen, Ph.D. Chinese Association of Professionals in Science and Technology March 23, 2003.
Module 13: Performance Tuning. Overview Performance tuning methodologies Instance level Database level Application level Overview of tools and techniques.
Applications of UDFs in Astronomical Databases and Research Manuchehr Taghizadeh-Popp Johns Hopkins University.
VO-DAS Chenzhou CUI Chao LIU, Haijun TIAN, Yang YANG, etc National Astronomical Observatories, CAS.
István Csabai Eötvös University Budapest. observation theoryreality Science: early times.
Chapter 13 The Data Warehouse
Haystack: Per-User Information Environment 1999 Conference on Information and Knowledge Management Eytan Adar et al Presented by Xiao Hu CS491CXZ.
1 Visualizer for Firewall Display & Analysis Tool.
László Dobos 1,2, Tamás Budavári 2, Nolan Li 2, Alex Szalay 2, István Csabai 1 1 Eötvös Loránd University, Budapest,
Elisabete da Cunha (ESR – IAP) MAGPOP Mid Term Review – La Palma, MAGPOP ESR at the Institut d’Astrophysique de Paris MAGPOP Mid Term Review La.
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Galaxy Distributions Analysis of Large-scale Structure Using Visualization and Percolation Technique on the SDSS Early Data Release Database Yuk-Yan Lam.
The SDSS is Two Surveys The Fuzzy Blob Survey The Squiggly Line Survey.
Random Forest Photometric Redshift Estimation Samuel Carliles 1 Tamas Budavari 2, Sebastien Heinis 2, Carey Priebe 3, Alex Szalay 2 Johns Hopkins University.
The introduction Goal: - Dust attenuation in starburst galaxies with different SFHs - Dust attenuation of “bulgy” and “disky” systems - Redshift dependence.
1 BrainWave Biosolutions Limited Accelerating Life Science Research through Technology.
Abstract Shortest distance query is a fundamental operation in large-scale networks. Many existing methods in the literature take a landmark embedding.
SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.
Business Intelligence components Introduction. Microsoft® SQL Server™ 2005 is a complete business intelligence (BI) platform that provides the features,
An Educational Project With An Astronomical Network Juan Ángel Vaquerizo Gallego on behalf of CESAR Team Centro de Astrobiología (CSIC-INTA) AstroRob 2013.
Data Mining Techniques
Leicester, February 24, 2005 VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis. VO-TECH Project. Stage01 Ugo Becciani INAF – Astrophysical.
The NASA/NExScI/IPAC Star and Exoplanet Database 14 May 2009 David R. Ciardi on behalf of the NStED Team.
Spatial Indexing and Visualizing Large Multi-dimensional Databases I. Csabai, M. Trencséni, L. Dobos, G. Herczegh, P. Józsa, N. Purger Eötvös University,
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
László Dobos, Tamás Budavári, Alex Szalay, István Csabai Eötvös University / JHU Aug , 2008.IDIES Inaugural Symposium, Baltimore1.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
Toledo, MPA access methods and plans With contributions from JHU : Alex Szalay, Jan Vanderberg MPA: Jeremy Blaizot,
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Spatial Indexing of large astronomical databases László Dobos, István Csabai, Márton Trencséni ELTE, Hungary.
1 The Terabyte Analysis Machine Jim Annis, Gabriele Garzoglio, Jun 2001 Introduction The Cluster Environment The Distance Machine Framework Scales The.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
Nick Draper 05/11/2008 Mantid Manipulation and Analysis Toolkit for ISIS data.
Making FITS available in.NET and its Applications Vivek Haridas 1, Tamas Budavari 1, William O'Mullane 1, Alex Szalay 1, Alberto Conti 2, Bill Pence 3,
E. Solano, R. Gutiérrez, B. Montesinos, C. Morales, J. García, L. Sanz LAEFF-INTA. P.O. Box 50727, Madrid (Spain) Development of a multi-mission.
Indexing and Visualizing Multidimensional Data I. Csabai, M. Trencséni, L. Dobos, G. Herczegh, P. Józsa, N. Purger Eötvös University,Budapest.
Gyöngyi Kerekes Eötvös Lóránd University, Budapest MAGPOP 2008, Paris István Csabai László Dobos Márton Trencséni.
SDSS photo-z with model templates. Photo-z Estimate redshift (+ physical parameters) –Colors are special „projection” of spectra, like PCA.
The VAO is operated by the VAO, LLC. LSST VAO Meeting Robert Hanisch Space Telescope Science Institute Director, Virtual Astronomical Observatory.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems Photometric parallax estimation using the MILES catalog and BaSeL models István Csabai.
VizDB A tool to support Exploration of large databases By using Human Visual System To analyze mid-size to large data.
Ching-Wa Yip Johns Hopkins University.  Alex Szalay (JHU)  Rosemary Wyse (JHU)  László Dobos (ELTE)  Tamás Budavári (JHU)  Istvan Csabai (ELTE)
A Study of the Correlation between Galactic Distance and Morphology Harry Gaebler and Rebecca Jensen- Clem.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Web based spectrum databases and utilities László Dobos Tamás Budavári István Csabai MAGPOP kick-off meeting, January Cassis.
By N.Gopinath AP/CSE.  The data warehouse architecture is based on a relational database management system server that functions as the central repository.
Vince Oliver PhD student of ELTE University Budapest  Assignments within MAGPOP project.
MORPHOLOGICAL ANALYSIS OF SDSS DISC GALAXIES József Varga 1 Supervisor: István Csabai 1 1 Department of Physics of Complex Systems Eötvös University Budapest.
Data Mining What are Data Mining Tools?. Data Mining Tools  Software tools used to query information in a data warehouse  Support the concept of OLAP.
Data Mining Concepts and Techniques Course Presentation by Ali A. Ali Department of Information Technology Institute of Graduate Studies and Research Alexandria.
Budapest Group Eötvös University MAGPOP kick-off meeting Cassis 2005 January
Photometry Data Model v0.2| Jesus Salgado | ESAC | 09 Dec 2010 | IVOA Interop Nara | Pag. 1/13 Photometry DM Working Draft 0.2 Jesus Salgado
István Csabai Dept. of Physics of Complex Systems, Eotvos University, Budapest Big Data Wigner, September 12, 2013.
Demonstration: Tools for large scale bibliometric analysis André Somers | 1 June 25, 2009.
Indexing Multidimensional Data
MATLAB Distributed, and Other Toolboxes
Photometric redshift estimation.
Cross-matching the sky with database server cluster
قاعدة البيانات Database
COSC 6340 Projects & Homeworks Spring 2002
قاعدة البيانات Database
MANAGING DATA RESOURCES
Rick, the SkyServer is a website we built to make it easy for professional and armature astronomers to access the terabytes of data gathered by the Sloan.
Advance Warning of Supermassive Black Hole Mergers
Bandpass and Spectrum Services for the VO
Presentation transcript:

Eötvös University Budapest in the Network

 Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science database technology, SDSS Zsolt Frei: »Galaxy morphology, galaxy mergers, gravitational waves  Students: Norbert Purger, Bence Kocsis, Merse Gáspár, Márton Trencséni, László Dobos, Dávid Koronczay »Working on SDSS related topics  Network student: Oliver Vince (Belgrade) The Team

Focus themes  Development of datamining and visualization techniques – SDSS ‘color space’  Improving photometric redshift estimation  Estimation of physical parameters of galaxies from photometry  Bulge/disk separation of large SDSS galaxies  Virtual Observatory, Spectrum Services

Collaboration with other nodes  JHU: Alex Szalay, Tamas Budavari, Ani Thakar … Virtual observatories, SDSS database, photometric redshift estimation Regular visits for seniors ad students  Paris: Stephane Charlot Spectral synthesis models for photo-z, spectral models in VO Oliver Vince visited Paris, and will visit next year New joint topic involving several nodes: „Optical attenuation law of nearby galaxies”

u g r i z 300 million points in 5+ dimensions 300 million points in 5+ dimensions Datamining: The Color Space

Datamining: Spatial Indexing

Datamining: Speed Up Queries

Datamining: Visualization Adaptively fetch data from database

Datamining:Integration with Database TRADITIONAL APPROACH Flat files, Fortran, C code + Complex manipulation of data - Sequential slow access TRADITIONAL APPROACH Flat files, Fortran, C code + Complex manipulation of data - Sequential slow access SQL DATABASES Oracle, MS SQL Server, … + Organize, efficiently access data - Hard to implement complex algorithms - Multidimensional indexing (OLAP) is limited to categorical data SQL DATABASES Oracle, MS SQL Server, … + Organize, efficiently access data - Hard to implement complex algorithms - Multidimensional indexing (OLAP) is limited to categorical data MULTIDIMENSIONAL INDEXING B-tree, R-tree, K-d tree, BSP-tree … + Many for low D, some for high D + Fast, tuned for various problems - Implemented mostly as memory algorithms, maybe suboptimal in databases MULTIDIMENSIONAL INDEXING B-tree, R-tree, K-d tree, BSP-tree … + Many for low D, some for high D + Fast, tuned for various problems - Implemented mostly as memory algorithms, maybe suboptimal in databases VISUALIZATION Tools using OpenGL, DirectX + Fast - Using files, some tools access database, but not interactive VISUALIZATION Tools using OpenGL, DirectX + Fast - Using files, some tools access database, but not interactive INTEGRATE Implement in SQL Server use for astronomical data-mining and for fast interactive visualization INTEGRATE Implement in SQL Server use for astronomical data-mining and for fast interactive visualization Joint Eötvös & JHU publication at the Conference on Innovative Data Systems Research

Photometric redshift estimation Find k nearest neighbors Use polinomial regression Estimate redshift 1M galaxies with known photometry and redshift 100M galaxies with known ugriz photometry, but no redshift ugriz redshift

 Joint work between JHU & Eötvös  Photometric redshift calculated for 300M SDSS objects  Included in SDSS DR5 Catalog and Data Release paper  Application: targeting MgII absorbers  collaboration between MPA & Eötvös  network postdoc Vivienne Wild involved Photometric redshift estimation

Virtual Observatory: Spectrum & Filter Services  Developed by Eötvös student Laszlo Dobos & JHU researcher Tamas Budavari  Several joint publications  Collaboration with IAP researcher Stephane Charlot to include spectral synthesis models

Network events  MAGPOP Virtual Observatory Workshop - Budapest, Hungary, April  MAGPOP Summer School - Budapest, Hungary, August  Hosting the webpage