LSST Alert Management VOEvent Meeting Tucson, AZ December 5-6, 2005 Robyn Allsman,LSSTC/NOAO Maria Nieto-Santisteban, JHU Ray Plante, NCSA Tim Axelrod,

Slides:



Advertisements
Similar presentations
VO/IVOA and The Astronomy Community Dave De Young NOAO.
Advertisements

VOEvent An Information Infrastructure for Immediate Astronomical Events Roy Williams NVO co-director.
A.Micol IVOA Registry REGISTRY WG Mar 2003 A Science Case (and 1000 Questions) for the IVOA Registry.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
ImageComparer A VO tool for variability searches The Team: Colin Aspin, Oliver Fraser, Nathaniel Paust, Rafael Santos.
Astronomical works with students Irina GUSEVA St Petersburg - Central (Pulkovo) Astronomical Observatory of the Russian Academy of Sciences - St Petersburg.
OULE3 - Time Domain Implementation & Validation Phase Isobel Hook Jean-Philippe Beaulieu 1.
Service Manager for MSPs
Page 1© Crown copyright 2006 Registry technology & case study implementation J. Tandy, D. Thomas - November 2006.
Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.
Time Series Photometry; Some Musings Steve B. Howell, NASA Ames Research Center.
MobiShare: Sharing Context-Dependent Data & Services from Mobile Sources Efstratios Valavanis, Christopher Ververidis, Michalis Vazirgianis, George C.
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
Xyleme A Dynamic Warehouse for XML Data of the Web.
The Transient Universe: AY 250 Spring 2007 Existing Transient Surveys: Optical I: Big Apertures Geoff Bower.
Section 15-1GLAST Ground System Design Review August 18&19, 2004 ISOC Organization ISOC Manager R Cameron Commanding, H&S Timeline Planning Command Generation.
Detection of Terrestrial Extra-Solar Planets via Gravitational Microlensing David Bennett University of Notre Dame.
1 HOT-WIRING THE TRANSIENT UNIVERSE | SANTA BARBARA, CA | MAY 12-15, 201 Name of Meeting Location Date - Change in Slide Master LSST Alert Production Pipelines.
[ §4 : 1 ] 4. Requirements Processes II Overview 4.1Fundamentals 4.2Elicitation 4.3Specification 4.4Verification 4.5Validation Software Requirements Specification.
Distributing Images: Cross-enterprise Document Sharing for Imaging (XDS-I) Access to Radiology Information (ARI) Retrieve Information for Display (RID)
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
GAUDI Ground-based Asteroseismology Uniform Database Interface E. Solano Bases de données en spectroscopie stellaire. Paris.
The NASA/NExScI/IPAC Star and Exoplanet Database 14 May 2009 David R. Ciardi on behalf of the NStED Team.
Roy Williams Andrew Drake, Matthew Graham, Ashish Mahabal California Institute of Technology Skyalert and Event Processing.
The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO.
1 FINAL DESIGN REVIEW | TUCSON, AZ | OCTOBER 21-25, 2013 Name of Meeting Location Date - Change in Slide Master Catalogs Framework Andrew Connolly Simulations.
SOS EGEE ‘06 GGF Security Auditing Service: Draft Architecture Brian Tierney Dan Gunter Lawrence Berkeley National Laboratory Marty Humphrey University.
1.View Description 2.Primary Presentation 3.Element Catalog Elements and Their Properties Relations and Their Properties Element Interfaces Element Behavior.
1 Radio Astronomy in the LSST Era – NRAO, Charlottesville, VA – May 6-8 th LSST Survey Data Products Mario Juric LSST Data Management Project Scientist.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
1 FINAL DESIGN REVIEW | TUCSON, AZ | OCTOBER 21-25, 2013 Name of Meeting Location Date - Change in Slide Master Catalogs Framework Andrew Connolly Simulations.
Science with the Virtual Observatory Brian R. Kent NRAO.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
Event Management & ITIL V3
1 Hot-Wiring the Transient Universe Santa Barbara CA May 12, 2015 LSST + Tony Tyson UC Davis LSST Chief Scientist.
Astronomical Spectroscopy and the Virtual Observatory ESAC, March 2007 VO tools and cross-calibration Pedro García-Lario European Space Astronomy.
DC2 Post-Mortem/DC3 Scoping February 5 - 6, 2008 DC3 Goals and Objectives Jeff Kantor DM System Manager Tim Axelrod DM System Scientist.
CBSOR,Indian Statistical Institute 30th March 07, ISI,Kokata 1 Digital Repository support for Consortium Dr. Devika P. Madalli Documentation Research &
1 System wide optimization for dark energy science: DESC-LSST collaborations Tony Tyson LSST Dark Energy Science Collaboration meeting June 12-13, 2012.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
Copyright © 2012, SAS Institute Inc. All rights reserved. ANALYTICS IN BIG DATA ERA ANALYTICS TECHNOLOGY AND ARCHITECTURE TO MANAGE VELOCITY AND VARIETY,
Test and Integration Robyn Allsman LSST Corp DC3 Applications Design Workshop IPAC August , 2008.
Quality Assurance Benchmark Datasets and Processing David Nidever SQuaRE Science Lead.
The VAO is operated by the VAO, LLC. LSST VAO Meeting Robert Hanisch Space Telescope Science Institute Director, Virtual Astronomical Observatory.
Data Analysis Software Development Hisanori Furusawa ADC, NAOJ For HSC analysis software team 1.
1 CORE DATA PROCESSING SOFTWARE PLAN REVIEW | SEATTLE, WA | SEPTEMBER 19-20, 2013 Name of Meeting Location Date - Change in Slide Master Data Release Processing.
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
Gaia Science Alerts in Italy Bologna, Catania, Napoli, Teramo, … Padova Massimo Turatto INAF Osservatorio Astronomico di Padova L’Italia in Gaia - Roma.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
LSST and VOEvent VOEvent Workshop Pasadena, CA April 13-14, 2005 Tim Axelrod University of Arizona.
The Large Synoptic Survey Telescope Project Bob Mann LSST:UK Project Leader Wide-Field Astronomy Unit, Edinburgh.
Ray Plante for the DES Collaboration BIRP Meeting August 12, 2004 Tucson Fermilab, U Illinois, U Chicago, LBNL, CTIO/NOAO DES Data Management Ray Plante.
Pan-STARRS PS1 Published Science Products Subsystem Presentation to the PS1 Science Council August 1, 2007.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
MMT Observation Database for Light Curve Analysis Vladimir Agapov Presentation for the WG1 session 33rd IADC meeting, Houston.
Jovan Aleksić Serbia Level 1 Transient events (variable and moving objects) Level 2 Static objects (catalogs, images) Level 3 User services.
IPHAS Early Data Release E. A. Gonzalez-Solares IPHAS Consortium AstroGrid National Astronomy Meeting, 2007.
GENIUS Kick-Off meeting December 4th 2013 WP-620 Simulated catalogue data Francesc Julbe UB – IEEC, Barcelona.
1 LSST Town Hall 227 th meeting of the AAS 1/7/2016 LSST Town Hall 227 th meeting of the AAS 1/7/16 Large Synoptic Survey Telescope Town Hall Beth Willman.
VOEvent and the Registry Introducing VOEventStream and VOEventService Roy Williams Caltech.
1 Software Testing and Quality Assurance Lecture 17 - Test Analysis & Design Models (Chapter 4, A Practical Guide to Testing Object-Oriented Software)
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
McGraw-Hill/Irwin© 2008 The McGraw-Hill Companies, All Rights Reserved Chapter 17 Object-Oriented Design and Modeling Using the UML.
June 27-29, DC2 Software Workshop - 1 Tom Stephens GSSC Database Programmer GSSC Data Servers for DC2.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
From LSE-30: Observatory System Spec.
Optical Survey Astronomy DATA at NCSA
Observing with Modern Observatories (the data flow)
Presentation transcript:

LSST Alert Management VOEvent Meeting Tucson, AZ December 5-6, 2005 Robyn Allsman,LSSTC/NOAO Maria Nieto-Santisteban, JHU Ray Plante, NCSA Tim Axelrod, LSSTC/Steward Observatory

VOEvent Meeting December 5-6, 2005 Tucson, AZ 2 LSST Alert Management Data Pipeline Detectable Transients Alert and Notification Categories Nomenclature Triggers and Notification LSST VOEvent Contents LSST Alerts and the VOEvent Specification

VOEvent Meeting December 5-6, 2005 Tucson, AZ 3 Applications Layer - Scope Data Acquisition Infrastructure Image Processing Pipeline Detection Pipeline Association Pipeline Image Archive Source Catalog Object Catalog Alert Archive Deep Detect Pipeline Deep Object Catalog VO Compliant Interface Middleware Classification Pipeline Moving Object Pipeline Calibration Pipeline End User Tools Alert Processing Eng/Fac Data Archive x “Nightly” at Base Facility and Archive Center x “Archive” Periodically at Archive Center Only Common Pipeline Components

VOEvent Meeting December 5-6, 2005 Tucson, AZ 4 Data Pipeline Functions Image Processing Pipeline is responsible for producing –Calibrated science images Astrometric calibration (WCS) Photometric calibration –Subtracted images –Stacked images Detection Pipeline is responsible for producing –The Source Catalog, which contains parameters of all sources found in an image: location, brightness, shape Association Pipeline is responsible for associating sources found at different times and (sometimes) locations, producing –The Object Catalog, which contains parameters of all astronomical objects: lightcurves, colors, proper motions, … Object Classifier, design TBD, is responsible for periodically (re)classifying all objects in the Object Catalog

VOEvent Meeting December 5-6, 2005 Tucson, AZ 5 Detectable Astrophysical Transients We are limited mostly by –Time sampling –Photometric accuracy (goal is 1%) We will not see (for example) –Low amplitude pulsating WD's (photometry) –Exoplanet transits (photometry and time sampling) –Microlensing caustic crossing events (time sampling) We will see –Many classes of periodic variables with amplitude > 1% –Many microlensing events –Novae –SNe, QSO's, … –As well as “middle of nowhere” transients (eg transients found by DLS)

VOEvent Meeting December 5-6, 2005 Tucson, AZ 6 Classification of Events The LSST data pipeline will attempt to classify variable objects based on –Position in CMD –Lightcurve shape –Motion, and orbital elements, if applicable The classifier pipeline will play a key role in identifying “events” –If the object is already in the catalog, an event occurs relative to the object's previous behavior (an event is not simply a change in flux) –Not so useful for new objects, but still possible to locate in CMD

VOEvent Meeting December 5-6, 2005 Tucson, AZ 7 Transient Rates Astrophysical rates - stars –Roughly 5% of stars are variable at the 1% level or more –A typical LSST image contains roughly 2.5e5 stars –Rate from typical images are 1e7 per night –An exceptional LSST image (LMC, bulge) contains up to 4e6 stars Astrophysical rates – extragalactic supernovae –SN rate about 1 / 200 yr / galaxy –Changing flux from each visible for at least 30 d –A typical LSST (unstacked) image contains roughly 4e5 galaxies –Rate is about 1e5 per night

VOEvent Meeting December 5-6, 2005 Tucson, AZ 8 Dealing With High Event Rates LSST will detect transients at rate of O(1e5 – 1e6 / night) –No group of humans can look at these individually –No followup facility can look at more than a negligible fraction –We need to filter these by a large factor to make them useful Excluding known variable objects results in the biggest reduction – but still leaves large noise rate Noise rates can be reduced by simply increasing the detection threshold – but at the cost of missing real information We need to carefully consider use cases, and make use of simulations, to find a way forward

VOEvent Meeting December 5-6, 2005 Tucson, AZ 9 How can a customer specify an interesting class of event? An “Event” is more than a change in flux –“Notify me of all Cepheids that change period by more than 5%” –“Notify me of all transients > 5σ with no corresponding catalogued object” –“Notify me of any newly discovered solar system object with a > 15AU and confidence > 0.9” We need a flexible semantics for event filters –SQL query on the object catalog is not quite enough(?) –Need to include temporal logic so that past behavior can be referenced(?)

VOEvent Meeting December 5-6, 2005 Tucson, AZ 10 Alert and Notification Categories Micro-change alerts –Triggered by small changes in flux –Could swamp pipeline and network if used indiscriminately Restricted to, and for, approved science missions Restricted to tightly bounded regions –Example: trying to capture pre-SN conditions Baseline change alerts –Triggered by an exceptional change Thresholds set to minimize false positive alerts –Example: change in flux; change in position Data product change alerts –Triggered by addition or, possibly, refinement in data product –Example: new image in area of interest, new/re- classification

VOEvent Meeting December 5-6, 2005 Tucson, AZ 11 Nomenclature Author (aka Pipelines) generates alerts and provides them to Event Repository Event Repository Service (aka Producer) provides alerts to Distribution Service Distribution Service –Queries Event Repository Service for alerts satisfying a Notification Request and forwards them to requestor OR receives alerts from Events Repository Service, determines matching Requests for Notification and then forwards…. –Queries Data Products Repository for DPChanges corresponding to a Notification Request and forwards them to requestor Subscription Service receives and validates User Requests for Notification Request for Notification defines the user’s constraints on when to be notified of a trigger-able event, and delivery mechanism.

VOEvent Meeting December 5-6, 2005 Tucson, AZ 12 Alert and Notification Scenario Subscription Service Author (Pipelines) Distribution Service Event Repository Service Data Products Repository Service Event Repository Data Products Repository Insider’s Backdoor to Thresholds Notification Constraints Trigger Thresholds

VOEvent Meeting December 5-6, 2005 Tucson, AZ 13 Triggers Micro-change and Baseline Trigger-able events –are determined solely by the Project Baseline trigger thresholds –are determined by the Project Micro-change trigger thresholds –are determined by privileged Subscribers Data Product Change notification –is harvested from the Data Products Repository –is expected to be periodic, not real-time

VOEvent Meeting December 5-6, 2005 Tucson, AZ 14 Triggers and Notification Author (Pipeline) defines suite of allowable constraints –when registering the alert service at the VORegistry Subscription service uses that info –when validating a new subscription request Distribution service uses that info –when determining who should receive an alert Distribution Service queries –Event Repository for micro-change & baseline alerts –DP Archive for data product alerts

VOEvent Meeting December 5-6, 2005 Tucson, AZ 15 LSST VO Event contents Who, Where/When Trigger Type Additional data depending on Trigger Type –e.g. flux, flux change; trajectory, anticipated trajectory LSST Object Id Previous Object Classification, if one exists Reference Links to –LSST VO Event web page –LSST Object web page – for on-the-fly generation of: Image cut-out Lightcurve Cone search centered on object Attributes

VOEvent Meeting December 5-6, 2005 Tucson, AZ 16 LSST Alerts and the VO Event Spec We want to leverage on VO Event Development What we will support –Alert generation and archiving –Threading of VOEvents on an Object –Authenticated subscription for backdoor threshold criteria What we don’t currently see as necessary –Retractions –if we make a major error, would probably use an IAU Circular or equivalent What we hope to be provided by VO Open Software Consortium by 2010 –Subscription Service –Distribution Service