The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO.

Slides:



Advertisements
Similar presentations
Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
Advertisements

IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
DM WORKING GROUP MADRID OCT WG STATUS Spectral DM: document updated and reformatted Spectral DM Java library prototype nearly ready Characterization:
Time-Series Analysis of Astronomical Data
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
2009/02/03Meunier et al., Symposium CoRoT EXODAT: Exo-Planet Information System : Evolutions J.-C. Meunier †, M. Deleuil †, C. Moutou †, H. Deeg,
A Systematic Exploration of the Time Domain
The Transient Universe: AY 250 Spring 2007 Existing Transient Surveys: Optical II: Robot Telescopes Geoff Bower.
Building a Framework for Data Preservation of Large-Scale Astronomical Data ADASS London, UK September 23-26, 2007 Jeffrey Kantor (LSST Corporation), Ray.
Brandon C. Kelly Harvard-Smithsonian Center for Astrophysics.
Astro-DISC: Astronomy and cosmology applications of distributed super computing.
The NASA/NExScI/IPAC Star and Exoplanet Database 14 May 2009 David R. Ciardi on behalf of the NStED Team.
Roy Williams Andrew Drake, Matthew Graham, Ashish Mahabal California Institute of Technology Skyalert and Event Processing.
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
1 Radio Astronomy in the LSST Era – NRAO, Charlottesville, VA – May 6-8 th LSST Survey Data Products Mario Juric LSST Data Management Project Scientist.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Virtual Observatory & LIGO Roy Williams California Institute of Technology.
Science with the Virtual Observatory Brian R. Kent NRAO.
Intraday variability of Sgr A* at radio wavelengths: A Day in the Life of Sgr A* Doug Roberts Northwestern University Adler Planetarium & Astronomy Museum.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
CoRoT fields before CoRoT – Processing of Large Photometric Databases Zoltán Csubry Konkoly Observatory Budapest, Hungary Hungarian CoRoT Day Budapest,
LSST Alert Management VOEvent Meeting Tucson, AZ December 5-6, 2005 Robyn Allsman,LSSTC/NOAO Maria Nieto-Santisteban, JHU Ray Plante, NCSA Tim Axelrod,
Long-term monitor on Mrk 421 using ARGO-YBJ experiment S.Z Chen (IHEP/CAS/China, On behalf of the ARGO-YBJ collaboration  1. Introduction.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
26 October 2005HST Calibration Workshop1 The National Virtual Observatory and HST T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US National Virtual.
Astro / Geo / Eco - Sciences Illustrative examples of success stories: Sloan digital sky survey: data portal for astronomy data, 1M+ users and nearly 1B.
LSST AGN TODO Items Gordon Richards (Drexel University)
LSST: Preparing for the Data Avalanche through Partitioning, Parallelization, and Provenance Kirk Borne (Perot Systems Corporation / NASA GSFC and George.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
The CoRoT ground-based complementary archive The CoRoT ground-based complementary archive Monica Rainer, Ennio Poretti M. Rosa Panzera, Angelo Mistò INAF.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
The VAO is operated by the VAO, LLC. LSST VAO Meeting Robert Hanisch Space Telescope Science Institute Director, Virtual Astronomical Observatory.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Astronomy, Petabytes, and MySQL MySQL Conference Santa Clara, CA April 16, 2008 Kian-Tat Lim Stanford Linear Accelerator Center.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclayGSFC, 29 June 2005 Four main functions: Find unknown.
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
LSST and VOEvent VOEvent Workshop Pasadena, CA April 13-14, 2005 Tim Axelrod University of Arizona.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
F. Genova, VO as a Data Grid, 2003/06/301 Interoperability of astronomy data bases Françoise Genova, CDS.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
The VAO is operated by the VAO, LLC. Ashish Mahabal Ciro Donalek Matthew Graham Ray Plante George Djorgovski.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Jovan Aleksić Serbia Level 1 Transient events (variable and moving objects) Level 2 Static objects (catalogs, images) Level 3 User services.
Tim Pearson US Planck Data Analysis Review 9-10 May 2006 US Planck Data Analysis Review Source Extraction Tim Pearson.
E. Solano. GAIA Meeting, Menorca, Oct 2009 GAIA and the Virtual Observatory Enrique Solano, LAEX/CAB (INTA-CSIC) Spanish VO Principal Investigator.
Determination of radio spectra from catalogues and identification of Gigahertz peaked sources (GPS) from the Virtual Observatory Bernd Vollmer, S. Derriere,
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
EXPLORE/OC: Photometry Results for the Open Cluster NGC 2660 K. von Braun (Carnegie/DTM), B. L. Lee (Toronto), S. Seager (Carnegie/DTM), H. K. C. Yee (Toronto),
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
Bayesian Template-Based Approach to Classifying SDSS-II Supernovae from 3-Year Survey Brian Connolly Photometric Supernova ID Workshop 3/16/12.
HELIO: Discovery and Analysis of Data in Heliophysics Robert Bentley, John Brooke, André Csillaghy, Donal Fellows, Anja Le Blanc, Mauro Messerotti, David.
Period Determination Study of Selected RV Tauri Stars Mark Kelly, Dr. Pamela Gay (Advisor) Centre for Astrophysics and Supercomputing Swinburne University.
T. Axelrod, NASA Asteroid Grand Challenge, Houston, Oct 1, 2013 Improving NEO Discovery Efficiency With Citizen Science Tim Axelrod LSST EPO Scientist.
From LSE-30: Observatory System Spec.
The INES Archive in the era of Virtual Observatories
sourceIdentify and identification strategies for LAT sources
Tackling the Disk/Jet Connection in AGN: Timing Analysis Methods and
Portfolios THE US NATIONAL VIRTUAL OBSERVATORY
Google Sky.
The SMARTS Southern HK Project
Presentation transcript:

The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO

July 5, 2012Matthew J. Graham 2 Time domain requirements Stakeholder perspective: Many observed phenomena are short-lived Scientific returns depend on:  detection  timely and well-chosen follow-up A system needs to: Fully process data as they stream from telescopes Compare with previous data from same region of sky Reliably detect any changes Classify and prioritize detections for followup

July 5, 2012Matthew J. Graham 3 VAO at the heart of the time domain Identified early (2001) as prime arena for VO applications Two-track approach:  Transient events (VOEvent) (see Williams et al.)  Publish, disseminate, and archive event notifications  Time series data  Describe, represent and access from different archives  Characterize  Classify Letter of cooperation with LSST  Standards and mechanisms for distributing transient event notices  Accessing LSST databases and images with VO-compliant interfaces

July 5, 2012Matthew J. Graham 4 Interoperable time series - I Common set of data access protocols: Common data formats:  VOTable  FITS  CSV NameDescription Simple Cone Search (SCS)Retrieve all objects within a region Simple Image Access (SIA)Retrieve all images within a region Simple Spectral Access (SSA)Retrieve all spectra within a region Simple Line Access (SLA)Retrieve spectral line data Simulations (SIMDAL)Retrieve simulations Table Access (TAP)Retrieve tabular data

July 5, 2012Matthew J. Graham 5 Interoperable time series - II Common data models with pointer mechanism (Utype): VOEvent  Describes observations of transient astronomical events  Who, What, Where/When, How, Why Spectral  Describes generalized spectrophotometric sequences  Basis for Spectrum, SED and TimeSeries DMs TimeSeries  Describes any observed or derived quantity that varies with time  Light curve (time series with one photometric band)  Multi-band time series  Time series with variable time sample bin sizes  Associated metadata such as period, target variability amplitude, and derived SNR

July 5, 2012Matthew J. Graham 6 Data providers CRTSHATNet Kepler CoRoT

July 5, 2012Matthew J. Graham 7 VAO Time Series Search Tool

July 5, 2012Matthew J. Graham 8 Event and source cross-identification VAO Cross-Comparison Tool  Up to 1 million sources against common source catalogs Constructing time histories from sets of individual observations  Bayesian formalism (Budavari)

July 5, 2012Matthew J. Graham 9 Synoptic surveys Transitive set of associations for n sources from a set of m observations scales as O(nm 2 ): Master catalog with per night updates of associations Full revisions still needed periodically Schemes needed – spatial indexing not sufficient SurveySourcesObs/sourceAssociations PQDR1~10 million~15~4 billion CRTS~500 million~250~20 trillion Next genBillions~1000> Quadrillions

July 5, 2012Matthew J. Graham 10 Source characterization Popular activity:  Richards et al. (2011), Dubath et al. (2011), Shin et al. (2009),… Variety of (fast) characterizing measures:  Moments  Flux ratios  Shape ratios (e.g., fraction of curve below median)  Variability indices (e.g., Stetson K, von Neumann, Abbé)  Periodicity measures:  base frequencies + harmonics  amplitudes and phases  Specific class indicators (e.g., quasar index)  Wavelets  Singular value decomposition  Segmentation methods and pattern analysis  Discretization (e.g., SAX, Persist) Defines high-dimensional (representative) feature space Noisy, irregularly sampled data can lead to false features

July 5, 2012Matthew J. Graham 11 Relevant features Richards et al. 2011

July 5, 2012Matthew J. Graham Sparsity and heterogeneity of available data make this a very challenging problem Real-time vs. archival Decision trees:  Blazars, CVs and RR Lyrae: ~90% completeness, ~9% contamination Probabilistic structure function  2D distribution of (Δm, Δt) for all possible epoch pairs  >90% completeness 12 Source classification

July 5, 2012Matthew J. Graham 13 Summary VAO is developing an interoperable framework to:  connect partner providers of both data and analysis resources  expose them as an integrated whole for wider community use Community call for collaborative proposals:  Access to data related to VAST (PI: T. Murphy)  Access to databases of AAVSO (PI: M. Templeton) Cooperative work with LSST Complementary efforts on real-time and archival characterization and classification, particularly based around CRTS