Datamining VizieR and SDSS

Slides:



Advertisements
Similar presentations
Trying to Use Databases for Science Jim Gray Microsoft Research
Advertisements

An Ontology and Semantic Web Application with Responsive Dissemination Features Sara Dexter, Michael Knapp, Bob McLaughlin, David Gibson.
Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
May 18, 2006IVOA Interoperability Meeting Fine-grained vs. Coarse-grained Registries or How much detail about a resource should be stored in a registry?
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
May IVOA Interop Meeting1 STScI/JHU Registry Status Gretchen Greene Wil OMullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
A few notes on JVOQL François Ochsenbein. JVOQL: a few questions FROM clause: not clear how to specify the list e.g. FROM clause: not clear how to specify.
08/06/2001ZEUS Consulting SA1 REGNET E-Business Data Management Kostas Giotopoulos.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
Lehrstuhl Informatik III: Datenbanksysteme Grid-based Data Stream Processing in e-Science 1 Richard Kuntschke 1, Tobias Scholl 1, Sebastian Huber 1, Alfons.
Information Retrieval in Practice
OFFICE OF THE ACCOUNTANT-GENERAL QUERIES PORTAL Presenter: David Krywanio| National Treasury: Office of the Accountant-General | 28 August 2014 RISK FORUM.
Overview of Search Engines
Prototype & Design Computer Inputs. How to Prototype & Design Computer Inputs Step 1: Review Input Requirements Step 2: Select the GUI Controls Step 3:
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
GAVO – after one year H.-M. Adorf & the GAVO team.
Advantages and disadvantages of current reference and digital objects linking models in scientific information space Radovan Vrana, M.Sc. Department of.
Case Study ProsperaSoft’s global sourcing model gives the maximum benefit to customers in terms of cost savings, improved quality, access to highly talented.
Design of a Search Engine for Metadata Search Based on Metalogy Ing-Xiang Chen, Che-Min Chen,and Cheng-Zen Yang Dept. of Computer Engineering and Science.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Document Management Services Jim Metzger, Harland FS John Liston, ASC.
IVOA Interoperability MeetingBoston, 2004/05/23-28 IVOA plenary session UCD R. Williams, S. Derriere, and the UCD folks.
Workshop Garching, June 27 – July Statistical Cross-Matching Across Distributed Archives H.-M. Adorf & GAVO Team MPI f. extraterrestrische Physik.
Quick Start Guide: Filters Learn about: 1.What filters Are & Their Functionality 2.How to Create A Filter.
2003 May 24Clive Page Implementation of XMATCH function.
CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.
Query Previews in Networked Information systems - K.Doan, C.Plaisant, B.Shneiderman Department of Computer Science University of Maryland, College park.
This presentation demonstrates the transition from the traditional menu structure to a more GUI look. Our objectives were to allow for quick access to.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Labcheck Next Generation Quick Start Guide Filters.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
AstroGrid Usability & Docs, JBO, 6 th Dec 2005 Jonathan Tedds Leicester University AstroGrid Usability & Documentation Usability –Documentation –Infrastructure.
Búsqueda en SharePoint 2010: una introducción. Quick, easy, powerful search (for free!) Complete intranet search High-end search delivered through SharePoint.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
WINDOW SEARCH SERVER Topics  Topology  High-level Architecture  Performance  WSS vs. MOSS Search Comparison  Search Server 2008.
Web-based Front End for Kraken Jing Ai Jingfei Kong Yinghua Hu.
May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.
Requirements for Specification of workflows in CLARIN Scenario design driven.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
Introduction to Enterprise Search Corey Roth Blog: Twitter: twitter.com/coreyrothtwitter.com/coreyroth.
Make it easy for customers. Add Sitelinks AdWords Sitelinks. Increasing choice and relevancy in your Search ads.
SAM projects status Robert Illingworth 29 August 2012.
Is non-unicity of utype/ucds a problem? The problem: is it possible to query some IVOA database directly from UCDs or Utypes? Select * from ivoa_table.
TDG-Scholar 2.0 Nicolás Amador Griñolo Agustín Domínguez Alvera.
Information Retrieval in Practice
A Generic Toolkit for Electronic Editions of Medieval Manuscripts
MS Access Forms, Queries, Reports Matt Martin
Search Engine Architecture
Upstream User Interface October, 31, 2017
Accessing Spatial Information from MaineDOT
Microsoft Word Forms Tutorial
Using Shiny to Efficiently Process Survey Data Carl Ganz, Akbar Akbari Esfahani, Hongjian Yu & Ninez Ponce UCLA Center for Health Policy Research Company.
قدرات النظم السياسية المعاصرة مرحلة الدكتوراه
Some remarks on Portals and Web Services
European Network of e-Lexicography
REPORT QUERY BUILDER featuring: Report Query Viewer.
Design Analysis.
States… Associative Property Examples Non-Examples.
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
Spanish VO Principal Investigator
Human Computer Interaction Lecture 14 HCI in Software Process
By Rajanikanth B Eclipse IDE Overview By Rajanikanth B
Successful Data Curation for Large Data Archives
Presentation transcript:

Datamining VizieR and SDSS Experiences with distributed querying, XMatch and SED extraction Hans-Martin Adorf, GL, Julius Adorf Wolfgang Voges, Stephanie Komossa

General architecture (before ADQL and SkyNode)

Features Uses list upload services iso separate cone searches Input list can contain physical properties Parallel queries to VizieR and SDSS Uses VizieR mirrors Uses XMatch for further refinement Can use alternative positions for XMatch, for example proper motion corrected GUI control center Feedback from science projects using it

Issues Requires custom metadata for implementing XMatch Error columns Catalogue wide errors Resolution multiple matches XMatch can help, up to a limit Catalogue problems (USNO example) Link to original data Is XMatch syntax sufficient for all use cases? Error in SkyNode doc Choice of astrometric columns up to user ? Systematic errors Non-isotropic errors Performance improvement Need to deal with “combinatorial explosion” Find available and fast mirrors Use of SEDs requires knowledge of apertures Unit/filter conversion