Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Slides:



Advertisements
Similar presentations
Microsoft Research Microsoft Research Jim Gray Distinguished Engineer Microsoft Research San Francisco SKYSERVER.
Advertisements

Trying to Use Databases for Science Jim Gray Microsoft Research
1 Online Science The World-Wide Telescope as a Prototype For the New Computational Science Jim Gray Microsoft Research
Viewing and Features ShowSky - a Jini aware Applet/API astronomical archive discovery tool Object Design and Implementation Guide Star Catalog-II Jini.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
GMD German National Research Center for Information Technology Darmstadt University of Technology Perspectives and Priorities for Digital Libraries Research.
ESO-ESA Existing Activities Archives, Virtual Observatories and the Grid.
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Canadian Virtual Observatory Project David Schade Canadian Astronomy Data Centre Herzberg Institute for Astrophysics National Research Council Canada.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
Building a Framework for Data Preservation of Large-Scale Astronomical Data ADASS London, UK September 23-26, 2007 Jeffrey Kantor (LSST Corporation), Ray.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
David Schade Canadian Astronomy Data Centre Data Services Curation Practice and User Metrics.
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
Hubble Legacy Archive Lee Quick - TIPS meeting July 19, 2012 Goals Data History Current Work Demo.
MAHI Research Database Project Status Report August 9, 2001.
GAUDI Ground-based Asteroseismology Uniform Database Interface E. Solano Bases de données en spectroscopie stellaire. Paris.
The NASA/NExScI/IPAC Star and Exoplanet Database 14 May 2009 David R. Ciardi on behalf of the NStED Team.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Research paper: Web Mining Research: A survey SIGKDD Explorations, June Volume 2, Issue 1 Author: R. Kosala and H. Blockeel.
A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.
Dec 2, 2014 Hubble Legacy Archive and Hubble Source Catalog Rick White & Brad Whitmore Current teams: HLA: Michael Dulude, Mark Kyprianou, Steve Lubow,
July 16, 2004P. Padovani, NEON Archive School Science with Multi- Archival Data Paolo Padovani (ST-ECF/ESO) Astrophysical Virtual Observatory Science Manager.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Tero Oittinen Sampo Team Department of Astronomy University of Helsinki,Finland Using ESO Reflex to access astronomical WebServices by The Sampo.
Science Archive for Sky Surveys Data Providers and the VO - NeSC 2003 March Wide Field Astronomy Unit Institute for Astronomy.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
AVO Status June 2002 Status M. Dolensky. AVO Status June 2002 WA0 - European Initiatives Enabling a Virtual Observatory for Europe EVOE –Submitted expression.
Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.
Science with the Virtual Observatory Brian R. Kent NRAO.
Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.
F. Genova, Berlin 7, Paris, 2 December 2009 The astronomical information network.
July 16, 2004P. Padovani, NEON Archive School Science with multi-wavelength Archival Data Paolo Padovani (ESO) Virtual Observatory Systems Department &
Strasbourg astronomical Data Centre (DS) Françoise GENOVA.
10 June 2002Towards an International VO - Garching bei Munchen 1 ASTRO-WISE An Astronomical Wide-field Imaging System for Europe Konrad Kuijken, Edwin.
CRISP & SKA WP19 Status. Overview Staffing SKA Preconstruction phase Tiered Data Delivery Infrastructure Prototype deployment.
European New HST & MMI Demo Nacho León María Arévalo Jonas Haase Jesús Salgado Deborah Baines Bruno Merín ESAC 20 January 2015.
AstroWise((G)A)VO Meeting 6 May 2004 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise.
1 10-June-2004Andy Lawrence : PPARC data curation panel meeting AstroGrid, Data Centres, & Edinburgh What is curation ? Data Centres in the VO era Data.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Virtual Survey System sept 04 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise a Virtual.
The Virtual Observatory Europe and the VO: the Astrophysical Virtual Observatory and the EURO-VO Astrophysical Virtual Observatory and the EURO-VO Paolo.
Enhancing Science with the Hubble Legacy Archive Bologna, January 29, 2008 Brad Whitmore OUTLINE The potential for enhanced archival science What is the.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
March 1st, 2006Prospective PNG PNG: Databases - Virtual Observatory.
Data Archives: Migration and Maintenance Douglas J. Mink Telescope Data Center Smithsonian Astrophysical Observatory NSF
SolarFlows Dr. Gabriele Pierantoni (TCD). Contents What is Heliophysics ? How could workflows help ? Some examples What we are doing...
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
The European Hubble Space Telescope Legacy Archive Wolfram Freudling.
F. Genova, VO as a Data Grid, 2003/06/301 Interoperability of astronomy data bases Françoise Genova, CDS.
WP8 – Assessment of emerging technologies EuroVO-AIDA – First periodic review – 24 April 2009 Françoise Genova, Project Coordinator WP8 Assessment of emerging.
The business logic engine for Microsoft IIS Speaker T.M. Arnett.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
Gijs Verdoes Kleijn Edwin Valentijn Marjolein Cuppen for the Astro-WISE consortium.
1 « Luxembourg, 18 April 2007 « Virtual Library of Official Statistics « Dissemination Working Group.
F. Genova, AstroNET meeting, Poitiers The Astrophysical Virtual Observatory.
Faculty meeting - 13 Dec 2006 The Hubble Legacy Archive Harald Kuntschner & ST-ECF staff 13 December 2006.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
February 12, 2002Tom McGlynn ADEC Interoperability Technical Working Group Report.
Ideas on Opening Up GEOSS Architecture and Extending AIP-5 Wim Hugo SAEON.
aspects of archive system design
Building a worldwide interoperable data infrastructure for astronomy: the International Virtual Observatory Alliance SciDataCon 2016, Denver, 13/Sept/2016.
Data Centres in the Virtual Observatory Age
Moving towards the Virtual Observatory Paolo Padovani, ST-ECF/ESO
Databases, Web Pages and Archives
Google Sky.
INAF Long Term Preservation
Executive Sponsor: Tom Church, Cabinet Secretary
Presentation transcript:

Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet

Virtual Observatories: June 10-14, 2002 Canadian Virtual Observatory The Canadian Virtual Observatory is a reality –IT WORKS –CVO is funded by National Research Council Canada and the Canadian Space Agency $4.3 million over 3-5 years –Design: Working CVO architecture –Content: WFPC2 associations pipeline, 12,000 images and 18.6 million sources

Virtual Observatories: June 10-14, 2002 CVO system components User interface –Database exploration with constraints API based on JAVA/JINI –Others could use our API to access our system effectively Content –WFPC2 images and catalogues CADC infrastructure –Database servers –Processing –Storage –Web servers

Virtual Observatories: June 10-14, 2002 VoPix VoProc VoSrc VO Architecture Archive Web interface to archive Archives publish to the VO Pat Dowler at ADASS

Virtual Observatories: June 10-14, 2002 VoPix VoProc VoSrc VO Architecture An idealized representation of pixel data free from archive-specific descriptors Instances of processing Classes of processing Source measurements free from archive-specific descriptors

Virtual Observatories: June 10-14, 2002 Drill down Scientists must be able to drill down from a catalogue entry: –Processing details –Pixels –Input parameters –Raw pixels Measurements reproducible Data integrity –Data Verification procedures –Online documentation –Refereed publications VO Architecture

Virtual Observatories: June 10-14, 2002 VoObj Object catalogues combine multi- wavelength sources into an object identification Production of object catalogues is a science process. The master object catalogue is a representation of the state of our astrophysical knowledge. Science Project VO Architecture Object catalogues

Virtual Observatories: June 10-14, 2002 VO Architecture Pixels sample Energy Space Time Processing table links back to archive

Virtual Observatories: June 10-14, 2002 VO Architecture Source Table

Virtual Observatories: June 10-14, 2002 WFPC2 associations, stacks, source catalogues What we have now –12,300 stacks in 6 filters –18.6 million sources What we will have this year –25,000 stacks –30 million sources –Object catalogues Content

Virtual Observatories: June 10-14, 2002 WFPC2 catalogues Sextractor (Bertin) for object detection/photometry

Virtual Observatories: June 10-14, 2002 How do we do it WFPC2 associations (ST-ECF/CADC collaboration) New storage/processing environment –20 AMD 1.5 GHz for processing –18 Terabytes for storage We can do 25,000 stacks and extract 30 million sources in a few weeks Processing and storage hardware

Virtual Observatories: June 10-14, 2002 Future CVO : this year CVO Prototype released to the public July 15 Release CVO Phase II near the end of 2002 –Add 2MASS catalogues Explore inter-operability prototype (2MASS) Explore ACS collaboration with STScI, ST-ECF, CADC Increase WFPC2 content –25,00 stacked images –30 million sources with high-quality imaging Object Catalogues

Virtual Observatories: June 10-14, 2002 Future CVO Develop the functionality of the CVO Link with other interesting pixel/catalogue datasets Generate more high-quality VO content CFHT Legacy Surveys –Partnership with CFHT,TERAPIX, CDS –Science: Supernovae, Weak Lensing, Kuiper Belt –500 nights/5years: Wide and deep components –50 million objects with high-quality imaging –Processed image products and catalogues –100 Terabyte project CFHT Legacy Surveys