Voeventnet.caltech.edu VOEventNet By Matthew J. Graham (Caltech)

Slides:



Advertisements
Similar presentations
Microsoft Research Microsoft Research Jim Gray Distinguished Engineer Microsoft Research San Francisco SKYSERVER.
Advertisements

Trying to Use Databases for Science Jim Gray Microsoft Research
Common Instrument Middleware Architecture and Federation of Instrument Resources for X-ray Crystallography Rick McMullen Indiana University.
Hooking up a meta-network with VOEvent Robert White Stuart Evans W. Thomas Vestrand James Wren Przemyk Wozniak Los Alamos National Laboratory Alasdair.
The Thinking Telescopes Project, RAPTOR, and the TALONS Communication System.
Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group.
VOEvent Wrap-up Rob Seaman For Roy Williams IVOA InterOp, Trieste 23 May 2008.
18 May 2006 IVOA - Victoria: Registry 51 New resource types from VOEvent Matthew J. Graham Caltech T HE US N ATIONAL V IRTUAL O BSERVATORY.
11 Nov 2009IVOA Garching: Apps II1 Crowdsourcing and the VO Matthew J. Graham (Caltech, NVO) et Roy Williams, Andrew Drake, George Djorgovski Ashish Mahabal,
Palomar-Quest and other modern surveys Some slides borrowed from G. Djorgovsky Arne Henden Director, AAVSO
3 September 2004NVO Coordination Meeting1 Grid-Technologies NVO and the Grid Reagan W. Moore George Kremenek Leesa Brieger Ewa Deelman Roy Williams John.
The NVO for Schools, Informal Science Centers, Planetaria, including and Remote and Local Telescopes: The National Virtual Observatory and Hands-On Universe.

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
1 Galaxy Decomposition Service Yogesh Wadadekar (STScI) Milan Bogosavljević (Caltech) Ashish Mahabal (Caltech)
VOEvent NVO Summer School September 2006 Roy Williams NVO.Caltech Alasdair Allen Joshua Bloom Andrew Drake Matthew Graham Rob Seaman Robert White.... and.
27 June 2005 National Virtual Observatory 1 The National Virtual Observatory: Publishing Astronomy Data Robert J. Hanisch US National Virtual Observatory.
Liverpool John Moores University & University of Exeter eScience Telescopes for Astronomical Research
Lehrstuhl Informatik III: Datenbanksysteme Grid-based Data Stream Processing in e-Science 1 Richard Kuntschke 1, Tobias Scholl 1, Sebastian Huber 1, Alfons.
The rise of the robots… Alasdair Allan School of Physics, University of Exeter Alasdair Allan School of Physics, University of Exeter.
A Heterogeneous Telescope Network Alasdair Allan Tim Naylor Eric Saunders University of Exeter Iain Steele Chris Mottram Liverpool John Moores University.
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
Vestrand Real Time Transient Detection with RAPTOR: Exploring the Path Toward a “Thinking” Telescope Tom Vestrand on behalf of the RAPTOR Team Los Alamos.
5-6 Dec 2005 VOEvent II Workshop1 VOEvent Specification, v1.0 T HE US N ATIONAL V IRTUAL O BSERVATORY Rob Seaman, National Optical Astronomy Observatory,
Developments at Palomar S. R. Kulkarni California Institute of Technology.
Vanilla TCP? Alasdair Allan. IVOA Interop Meeting, May Why TCP? Traditional and still the best Because we’ve always done it that way –not always.
Vestrand 2 nd Zwicky Workshop Thinking Telescopes, RAPTOR, and GRB Follow-up by Tom Vestrand Los Alamos National Laboratory.
Mining quasars from the Palomar-QUEST survey SC4DEVO (Caltech: Jul 2004) Ashish Mahabal, Caltech (+ Djorgovski, Graham, Williams …) (+Yale, NCSA,
The Transient Universe: AY 250 Spring 2007 Existing Transient Surveys: Optical II: Robot Telescopes Geoff Bower.
The Palomar QUEST Variability Survey Charles Baltay Yale University.
Science Applications of Montage: An Astronomical Image Mosaic Engine ESTO G. Bruce Berriman, John Good and Anastasia Laity.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
VOEvent An Information Infrastructure for Immediate Astronomical Events a Working Group of the International.
Digitized Sky Survey Update Brian McLean : Archive Sciences Branch / Operations and Engineering Division.
Why Build Image Mosaics for Wide Area Surveys? An All-Sky 2MASS Mosaic Constructed on the TeraGrid A. C. Laity, G. B. Berriman, J. C. Good (IPAC, Caltech);
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Roy Williams Andrew Drake, Matthew Graham, Ashish Mahabal California Institute of Technology Skyalert and Event Processing.
The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO.
National Center for Supercomputing Applications Observational Astronomy NCSA projects radio astronomy: CARMA & SKA optical astronomy: DES & LSST access:
1 New Frontiers with LSST: leveraging world facilities Tony Tyson Director, LSST Project University of California, Davis Science with the 8-10 m telescopes.
1 Radio Astronomy in the LSST Era – NRAO, Charlottesville, VA – May 6-8 th LSST Survey Data Products Mario Juric LSST Data Management Project Scientist.
Science with the Virtual Observatory Brian R. Kent NRAO.
The rise of the robots… Alasdair Allan School of Physics, University of Exeter Alasdair Allan School of Physics, University of Exeter.
Exploration of the Time Domain S. G. Djorgovski VOEvent Workshop, CACR, Caltech, April 2005.
1 Hot-Wiring the Transient Universe Santa Barbara CA May 12, 2015 LSST + Tony Tyson UC Davis LSST Chief Scientist.
Implementing an Observational Grid Eric Saunders Alasdair Allan Tim Naylor University of Exeter Iain Steele Chris Mottram Liverpool John Moores University.
LSST Alert Management VOEvent Meeting Tucson, AZ December 5-6, 2005 Robyn Allsman,LSSTC/NOAO Maria Nieto-Santisteban, JHU Ray Plante, NCSA Tim Axelrod,
Making the Sky Searchable: Automatically Organizing the World’s Astronomical Data Sam Roweis, Dustin Lang &
Event Infrastructure Alasdair Allan University of Exeter Alasdair Allan University of Exeter Robert R. White Los Alamos National Laboratories The eSTAR/TALONS.
VOEvent IVOA Interop May 2006 Roy Williams NVO.Caltech..... and many others image of Cas A.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
Authors: Rob Seaman, National Optical Astronomy Observatory, USA Roy Williams, California Institute of Technology, USA Scott Barthelmy,
Research Networks and Astronomy Richard Schilizzi Joint Institute for VLBI in Europe
EScience May 2007 From Photons to Petabytes: Astronomy in the Era of Large Scale Surveys and Virtual Observatories R. Chris Smith NOAO/CTIO, LSST.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
Some Grid Science California Institute of Technology Roy Williams Paul Messina Grids and Virtual Observatory Grids and and LIGO.
Actionable Intelligence from Multisourced Events Roy Williams Caltech with S.G.Djorgovski, C. Donalek, A. Drake, M. Graham, A. Mahabal, R. Seaman (NOAO).
The RAPTOR (RAPid Telescopes for Optical Response) telescopes and GeV/TeV gamma-ray astronomy vestrandAspen Meeting---Galactic GeV/TeV sources.
LSST and VOEvent VOEvent Workshop Pasadena, CA April 13-14, 2005 Tim Axelrod University of Arizona.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Ray Plante for the DES Collaboration BIRP Meeting August 12, 2004 Tucson Fermilab, U Illinois, U Chicago, LBNL, CTIO/NOAO DES Data Management Ray Plante.
VOEvent Sky Event Reporting Metadata Authors: Rob Seaman, National Optical Astronomy Observatory, USA Roy Williams, California Institute of Technology,
Followup Observations in the Swift Era S. R. Kulkarni California Institute of Technology.
MMT Observation Database for Light Curve Analysis Vladimir Agapov Presentation for the WG1 session 33rd IADC meeting, Houston.
Gamma-Ray Bursts with the ANTARES neutrino telescope S. Escoffier CNRS/CPPM, Marseille.
A Target of Opportunity Observing System for NOAO Rob Seaman Data Products Program 29 April 2008.
Optical Survey Astronomy DATA at NCSA
Portfolios THE US NATIONAL VIRTUAL OBSERVATORY
Google Sky.
VOEvent client software
Presentation transcript:

voeventnet.caltech.edu VOEventNet By Matthew J. Graham (Caltech)

VOEvent II 6 December 2005 What is VOEventNet? Real-time astronomy with a rapid-response telescope grid A peer-to-peer cyberinfrastructure to enable rapid and federated observations of the dynamic night sky A network of telescopes and computers working synergistically, under the watchful eye of humans, to find and study interesting astronomical events A transportation of events to interested subscribers, automatically in seconds or minutes after discovery

VOEvent II 6 December 2005 What is VOEventNet? $600k 3 year NSF-funded project under the DDDAS (Dynamic Data- Driven Applications Systems) initiative involving Caltech, UC Berkeley and LANL Personnel: ^ really Roy Williams (PI) Joshua Bloom George Djorgovski Shri Kulkarni Thomas Vestrand Matthew Graham Ashish Mahabal Andrew Drake Derek Fox Przemek Wozniak

VOEvent II 6 December 2005 Event Synthesis Engine Pairitel Raptor PQ next-day pipelines catalog Palomar-Quest known variables known asteroids SDSS 2MASS PQ Event Factory remote archives baseline sky eStar VOEventNet GRB satellites VOEvent database Palomar 60 Architecture

VOEvent II 6 December 2005 Palomar-Quest Survey Synoptic sky survey using the 48 Palomar Samuel Oschin Schmidt telescope and the 112-CCD, 161-Megapixel Quest II camera Collaboration between Caltech, Yale/Indiana U., NCSA, and JPL; et al. VO compliance/standards built in from the start Two modes: drift scan with UBRI/rizz or multiple repeated snapshots in one filter ~70GB of data/night deg 2 observed a minimum of 8 times with baselines minutes to years

VOEvent II 6 December 2005 A 152 ft 20 ft mural produced for Griffith Observatory from PQ survey BRI images A swath of swath through the center of the Virgo cluster, sampled at 0.4 arcsec/pixel, giving a 136,800 18,000 pixel image Computed at CACR using HyperAtlas and a custom data cleaning pipeline Reproduced on 114 steel-backed porcellain plates, expected to last many decades Will be seen by millions of visitors Associated website will include NVO outreach Real PQ data: The Big Picture

VOEvent II 6 December 2005 The Big Picture: detail

VOEvent II 6 December 2005 The Big Picture: Tile C12 (M87) Zoom-in The Big Picture: more detail

VOEvent II 6 December 2005 Transients in the Big Picture Tile b Cantabia

VOEvent II 6 December 2005 Event Synthesis Engine Pairitel Raptor PQ next-day pipelines catalog Palomar-Quest known variables known asteroids SDSS 2MASS PQ Event Factory remote archives baseline sky eStar VOEventNet GRB satellites VOEvent database Palomar 60 Architecture

VOEvent II 6 December 2005 Palomar-Quest Event Factory Real-time pipeline to process raw data streaming from telescope: Remove detector signatures including glitches masquerading as transient events: meteors, airplanes, glints from satellites and junk, etc. Apply basic photometric and astrometric calibration Extract detected sources and measure attributes Compare with baseline data (catalogs/images) to identify new, transient or highly variable sources Compare with dbs of known variables, asteroids, etc.

VOEvent II 6 December 2005 Event Synthesis Engine Pairitel Raptor PQ next-day pipelines catalog Palomar-Quest known variables known asteroids SDSS 2MASS PQ Event Factory remote archives baseline sky eStar VOEventNet GRB satellites VOEvent database Palomar 60 Architecture

VOEvent II 6 December 2005 Event Synthesis Engine New input arrives from PQ/elsewhere: Establish event portfolio to archive and federate all subsequent data and analysis Send initial event notification to subscribers Launch query against external dbs via NVO Classify and prioritize: Evaluate likelihood probabilities of event being associated with possible astrophysical sources using machine learning techniques (Thinking Telescope) Evaluate urgency of desired follow-up Send out VOEvent

VOEvent II 6 December 2005 Event Synthesis Engine Pairitel Raptor PQ next-day pipelines catalog Palomar-Quest known variables known asteroids SDSS 2MASS PQ Event Factory remote archives baseline sky eStar VOEventNet GRB satellites VOEvent database Palomar 60 Architecture

VOEvent II 6 December 2005 VOEventNet Communication Fabric Author Publisher (aggregator): Stores packet and assigns identifier Distributes to subscribers based on pre-defined criteria using one-way web services Two dbs - Caltech for PQ and Los Alamos for Raptor - harvest each other Subscriber: Gets event from publisher, evaluates it and causes scheduling in telescope observing queue or an archive search

VOEvent II 6 December 2005 Event Cycling An event can be injected back into the same decision/classification engine that published it but supplemented with data from elsewhere Events dynamically cycle through follow-up observation and computation (no humans in loop) with subscribers make judgments and adding value until convergence

VOEvent II 6 December 2005 Robotic Telescopes RAPTOR Stereoscopic sky monitoring with follow- up fovea telescope PAIRITEL Meter-class IR follow-up P60 Principal follow-up facility for PQ Events eSTAR

VOEvent II 6 December 2005 Timeline Year one - proof-of-concept system consisting of: Source of VOEvents A VOEvent store Basic event discriminator Robotic telescopic capable of responding to VOEvent: P60 and Pairitel Year two - prototype system Year three - production system