SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.

Slides:

Advertisements

Similar presentations

Microsoft Research Microsoft Research Jim Gray Distinguished Engineer Microsoft Research San Francisco SKYSERVER.

Advertisements

Trying to Use Databases for Science Jim Gray Microsoft Research

Web Services for the Virtual Observatory Alex Szalay, Tamas Budavari, Tanu Malik, Jim Gray, and Ani Thakar SPIE, Hawaii, 2002 (Living in an exponential.

1 Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research

Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research

© Copyright 2008 All rights reserved 2 VO-India Project Started in 2002 as a collaboration between IUCAA and Persistent Systems Ltd. Part of International.

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.

VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.

Demonstration of VO Tools and Technology Tamás Budavári Johns Hopkins University.

Global Hands-On Universe meeting July 15, 2007 Authentic Data in the Classroom with the Sloan Digital Sky Survey Jordan Raddick (Johns Hopkins University)

Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.

MAST/GALEX Tutorial February, 2007 Version 4.3 (Referencing all GR2/GR3 products)

László Dobos 1,2, Tamás Budavári 2, Nolan Li 2, Alex Szalay 2, István Csabai 1 1 Eötvös Loránd University, Budapest,

Federated Service Oriented Information Management Ahmet Sayar

AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid and Euro-VO Technology Centre Project.

Web + VO + Database Technologies = HLA Footprints STScI: Gretchen Greene, Steve Lubow, Brian McLean, Rick White and the HLA Team JHU: Alex Szalay and Tamas.

October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.

CASJOBS: A WORKFLOW ENVIRONMENT DESIGNED FOR LARGE SCIENTIFIC CATALOGS Nolan Li, Johns Hopkins University.

Toward Automatic Processing and Indexing of Microfilm.

© Copyright 2000 M. Rodriguez-Martinez, All Rights Reserved Automatic Deployment of Application-Specific Metadata and Code in MOCHA Manuel Rodriguez-Martinez.

Leicester, February 24, 2005 VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis. VO-TECH Project. Stage01 Ugo Becciani INAF – Astrophysical.

Digitized Sky Survey Update Brian McLean : Archive Sciences Branch / Operations and Engineering Division.

GALEXView Demo T. Rogers, B. Shiao, P. Brown, P. McCauley, A. Conti, M. Smith, S. Tseng, A. Volpicelli StSci/MAST.

Data-Intensive Science at Johns Hopkins University Institute for Data-Intensive Engineering and Science (IDIES) Johns Hopkins University Jordan Raddick.

OSN Archive: Current status and future implementations José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First.

Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.

The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.

Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.

F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,

DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.

Science Archive for Sky Surveys Data Providers and the VO - NeSC 2003 March Wide Field Astronomy Unit Institute for Astronomy.

Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.

NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.

JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),

Public Access to Large Astronomical Datasets Alex Szalay, Johns Hopkins Jim Gray, Microsoft Research.

Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:

EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)

Making FITS available in.NET and its Applications Vivek Haridas 1, Tamas Budavari 1, William O'Mullane 1, Alex Szalay 1, Alberto Conti 2, Bill Pence 3,

P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.

Sexy Science User Interfaces June 17, 2011 GRITS III, Pasadena, CA John Good.

MAST Users Group – June 29, 2007 MAST Team:  cmo Pat Brown  cmo Alberto Conti  Tony Rogers  Bernie Shiao  Myron Smith  Shui-Ay Tseng  *A. Volpicelli.

The Sloan Digital Sky Survey ImgCutout: The universe at your fingertips Maria A. Nieto-Santisteban Johns Hopkins University

Web Services for the National Virtual Observatory Tamás Budavári Johns Hopkins University.

The International Virtual Observatory Alliance (IVOA) interoperability in action.

Ching-Wa Yip Johns Hopkins University.  Alex Szalay (JHU)  Rosemary Wyse (JHU)  László Dobos (ELTE)  Tamás Budavári (JHU)  Istvan Csabai (ELTE)

EMBL-EBI MSD Search and Visualization tools Jawahar Swaminathan.

May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,

1 Overview Finding and importing data sets –Searching for data –Importing data_.

May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.

German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.

Virtual Observatories, Press Release Images, and Web Services Dr. Frank Summers Space Telescope Science Institute November 3, 2005.

12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.

Web based spectrum databases and utilities László Dobos Tamás Budavári István Csabai MAGPOP kick-off meeting, January Cassis.

We will start shortly…. DiView II DiView II Software Presented by: Daniele Posenato.

William O’Mullane/ Tannu Malik - JHU IVOA Cambridge May 12-16, 2003 SkyQuery.Net SKYQUERY Federated Database Query System (using WebServices)

Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.

1 Workflows Access and Massage VO Data José Enrique Ruiz on behalf of the Wf4Ever Team IVOA INTEROP SPRING MEETING 2013 HEIDELBERG, MAY16th 2013.

Spatial Searches in the ODM. slide 2 Common Spatial Questions Points in region queries 1.Find all objects in this region 2.Find all “good” objects (not.

How to use the GALEX SkyNode*

Standard Query Language for VO

Prototype Web Services Using SDSS DR1

Rick, the SkyServer is a website we built to make it easy for professional and armature astronomers to access the terabytes of data gathered by the Sloan.

Populating a Data Warehouse

Efficient Catalog Matching with Dropout Detection

Bandpass and Spectrum Services for the VO

Presentation transcript:

SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe

SC4DEVO-1Tamás Budavári (JHU)2 Outline SDSS Primer Technology Web Services Data Access Images Spectra Catalog Higher Level

SC4DEVO-1Tamás Budavári (JHU)3 SDSS Imaging Survey 2.5m telescope Apache Point, NM 5 photometric bands Drift scan operation Photo pipeline 100,000,000 galaxies Automated reduction Catalog archive server

SC4DEVO-1Tamás Budavári (JHU)4 NGC 2068

SC4DEVO-1Tamás Budavári (JHU)5 UGC 3214

SC4DEVO-1Tamás Budavári (JHU)6 NGC 6070

SC4DEVO-1Tamás Budavári (JHU)7 SDSS Spectropscopy Two spectrographs Red and blue part Optical fibers 640 in each bundle Plugged manually Automatic reduction 2D and 1D pipelines Catalog archive server

SC4DEVO-1Tamás Budavári (JHU)8

SC4DEVO-1Tamás Budavári (JHU)9 Developing Web Services We chose the.NET Framework The C# programming language Extensive class library (for free) Simple and efficient database access Fast imaging and graphics routines Rapid development in Visual Studio Very easy Web Services programming Use CVS for versioning

SC4DEVO-1Tamás Budavári (JHU)10 Custom Tools and Packages CFITSIO Wrapper for CFITSIO by Vivek Haridas (JHU) Access to FITS tables and images from C# XML Web Services return FITS in attachment Scientific Plotting Using TeeChart Lite Fast plotting of online data

SC4DEVO-1Tamás Budavári (JHU)11 Available Web Services SDSS Web Services Field Finder and SIAP SDSS Image Cutout Spectrum and Filter Services Scientific Catalog Archive DensityMap Services Other Relevant Services NED Services Wrapper Cosmic Distances

SC4DEVO-1Tamás Budavári (JHU)12 SDSS Fields and SIA Field Images Search for fields (HTM) Get all info, e.g. WCS Returns links to FITS Simple Image Access Wrapper on top of Fields Returns links in VOTable

SC4DEVO-1Tamás Budavári (JHU)13 SDSS Image Cutout Build JPEG mosaics For given (RA, Dec) Arbitrary zoom levels Overplot catalog data Overplot geometry MapQuest like navigation List of objects Proper WS JPEG returned in DIME or byte array

SC4DEVO-1Tamás Budavári (JHU)14 Spectrum Services Public repository 500,000 spectra (2B row) Spatial search and more Register & submit yours Web site On-the-fly plotting Building composites Web services More options and tools

SC4DEVO-1Tamás Budavári (JHU)15 SDSS Catalog Services CasJobs Access to a 1TB of data 80M unique galaxies Queue system for SQL MyDB 500MB remote DB Upload and extract Web services Web site interface Command-line client

SC4DEVO-1Tamás Budavári (JHU)16 SDSS DensityMap Services A SQL query to image converter Select x,y,f and build color coded f(x,y) image

SC4DEVO-1Tamás Budavári (JHU)17 Other Services Wrapper for NED Name resolver function Search by coordinate Available from Cosmic Distances Various distance measures Using ΛCDM cosmology NED ned = new NED(); ObjInfo o = ned.ObjByName(“m101”); /* Use o.ra, o.dec, etc… */ Distance d = new Distance(); float z=0.1, h=0.7, m=0.3, l=0.7; float r = d.Luminosity(z,h,m,l);

SC4DEVO-1Tamás Budavári (JHU)18 Consuming Web Services

SC4DEVO-1Tamás Budavári (JHU)19 Conclusions SDSS Web Services … … provide access to scientific data and tools … are (very) easy to consume … are being used :-) Development coordinated w/ IVOA Open SkyQuery for federating archives SDSS Open SkyNode