Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group.

Slides:



Advertisements
Similar presentations
Trying to Use Databases for Science Jim Gray Microsoft Research
Advertisements

World Wide Telescope mining the Sky using Web Services Information At Your Fingertips for astronomers Jim Gray Microsoft Research Alex Szalay Johns Hopkins.
The Thinking Telescopes Project, RAPTOR, and the TALONS Communication System.
Kyoto Interop meeting, 17 May A VOTable application: Solar System objects in the VO J. Berthier 1, F. Vachier 1, V. Lainey 1, W. Thuillot 1, J.-E.
Voeventnet.caltech.edu VOEventNet By Matthew J. Graham (Caltech)
Palomar-Quest and other modern surveys Some slides borrowed from G. Djorgovsky Arne Henden Director, AAVSO
1. 2 Joy Nichols, Jennifer Lauer, Doug Morgan, and Beth Sundheim Harvard-Smithsonian Center for Astrophysics Eric Martin Northrop Grumman Space Technology.

Sep 8, NVO Summer School1 WCSFixer A Web-Enabled IRAF Plate Solver Mike Fitzpatrick, NOAO T HE US N ATIONAL V IRTUAL O BSERVATORY.
1 Galaxy Decomposition Service Yogesh Wadadekar (STScI) Milan Bogosavljević (Caltech) Ashish Mahabal (Caltech)
Astronomical works with students Irina GUSEVA St Petersburg - Central (Pulkovo) Astronomical Observatory of the Russian Academy of Sciences - St Petersburg.
John Cunniffe Dunsink Observatory Dublin Institute for Advanced Studies Evert Meurs (Dunsink Observatory) Aaron Golden (NUI Galway) Aus VO 18/11/03 Efficient.
Scientific Data Mining Principles and applications with astronomical data. Amos Storkey Institute for Adaptive and Neural Computation Division of Informatics.
Grid Astronomy with Image Federation Roy Williams Michael Feldmann California Institute of Technology.
Overview of Current and Forthcoming GALEX Search Capabilities and Data Products Current Search Options New GALEX Fluxes gPhoton.
Brian Schmidt The Research School of Astronomy and Astrophysics Mount Stromlo & Siding Spring Observatories.
A NEW CTE PHOTOMETRIC CORRECTION FORMULA FOR ACS Marco Chiaberge TIPS meeting 05/16/2012.
Vestrand Real Time Transient Detection with RAPTOR: Exploring the Path Toward a “Thinking” Telescope Tom Vestrand on behalf of the RAPTOR Team Los Alamos.
P.Tisserand Rencontres du Vietnam Final results on galactic dark matter from the EROS-2 microlensing survey ~ images processed - 55 million.
Detection of Kuiper Belt Objects By Stellar Occultation George Georgevits (UNSW) Will Saunders (AAO) Michael C.B. Ashley (UNSW)
The Novel Method for Identifying Fast Optical Transients The Application of Multi-Exposure Plates for OT/GRBs analyses René Hudec 1 and Lukáš Hudec 2 1.
1 Earth’s Atmosphere & Telescopes Whether light is absorbed by the atmosphere or not depends greatly on its wavelength. Earth’s atmosphere can absorb certain.
Palomar Transient Factory Data Flow Jason Surace IPAC/Caltech.
Developments at Palomar S. R. Kulkarni California Institute of Technology.
Star-Forming Galaxies in a Nearby Group: Abell Instituto de Astrofísica de Andalucía-CSIC Reverte-Payá 1, D.; Vílchez 1, J. M. & Iglesias-Páramo.
OT and the Systematic Automated All-sky Search for Bright Optical Transients Lior Shamir & Robert J. Nemiroff Abstract Real-time detection of bright.
Mining quasars from the Palomar-QUEST survey SC4DEVO (Caltech: Jul 2004) Ashish Mahabal, Caltech (+ Djorgovski, Graham, Williams …) (+Yale, NCSA,
A Web service for Distributed Covariance Computation on Astronomy Catalogs Presented by Haimonti Dutta CMSC 691D.
Session 3: Web Site Design J 394 – Perancangan Situs Web Program Studi Manajemen Universitas Bina Nusantara.
Acknowledgments I wish to thank the Department of Physics & Astronomy (MSUM), Drs. Juan Cabanela, Matthew Craig, Linda Winkler, Ananda Shastri, and Steve.
Finding Advertising Keywords on Web Pages Scott Wen-tau YihJoshua Goodman Microsoft Research Vitor R. Carvalho Carnegie Mellon University.
The KPNO 4m “Mayall” Telescope Arjun Dey (NOAO). National Optical Astronomy Observatory Mission: provide the best ground-based astronomical capabilities.
Digitized Sky Survey Update Brian McLean : Archive Sciences Branch / Operations and Engineering Division.
Why Build Image Mosaics for Wide Area Surveys? An All-Sky 2MASS Mosaic Constructed on the TeraGrid A. C. Laity, G. B. Berriman, J. C. Good (IPAC, Caltech);
Purpose The purpose of this project was to analyze the data from the telescope to verify the relationship between period of rotation and diameter of the.
Application of Gravitational Lensing Models to the Brightest Strongly Lensed Lyman Break Galaxy – the 8 o’clock arc E. Buckley-Geer 1, S. Allam 1,2, H.
EADS DS / SDC LTIS Page 1 7 th CNES/DLR Workshop on Information Extraction and Scene Understanding for Meter Resolution Image – 29/03/07 - Oberpfaffenhofen.
National Center for Supercomputing Applications Observational Astronomy NCSA projects radio astronomy: CARMA & SKA optical astronomy: DES & LSST access:
1 New Frontiers with LSST: leveraging world facilities Tony Tyson Director, LSST Project University of California, Davis Science with the 8-10 m telescopes.
Exploration of the Time Domain S. G. Djorgovski VOEvent Workshop, CACR, Caltech, April 2005.
Sensing for Robotics & Control – Remote Sensors R. R. Lindeke, Ph.D.
Making the Sky Searchable: Automatically Organizing the World’s Astronomical Data Sam Roweis, Dustin Lang &
Palomar Transient Factory Data Flow Jason Surace IPAC/Caltech.
Patrizia Ferrero 3rd Integral Bart Work Shop Chocerady - November 1-3, Fast dissemination of GRB afterglow information Patrizia Ferrero (IASF-BO,
CORNISH Workshop Leeds April Ed Churchwell U. Wisconsin.
1 System wide optimization for dark energy science: DESC-LSST collaborations Tony Tyson LSST Dark Energy Science Collaboration meeting June 12-13, 2012.
Aldo Dell'Oro INAF- Observatory of Turin Detailed analysis of the signal from asteroids by GAIA and their size estimation Besançon November 6-7, 2003.
Hyperatlas Coregistered Federated Imagery Roy Williams Bruce Berriman George Djorgovski John Good Reagan Moore Caltech CACR Caltech IPAC Caltech Astronomy.
Initial Results from the Chandra Shallow X-ray Survey in the NDWFS in Boötes S. Murray, C. Jones, W. Forman, A. Kenter, A. Vikhlinin, P. Green, D. Fabricant,
ACS/WFC CTE correction for point source photometry Marco Chiaberge ACS Team STScI.
The RAPTOR (RAPid Telescopes for Optical Response) telescopes and GeV/TeV gamma-ray astronomy vestrandAspen Meeting---Galactic GeV/TeV sources.
August 10, 2004 Apache Point Observatory, NM FINDING SUPERNOVAE IN A SLICE OF PI Dennis J. Lamenti San Francisco State University.
LSST and VOEvent VOEvent Workshop Pasadena, CA April 13-14, 2005 Tim Axelrod University of Arizona.
A Search For New Planets Matthew Livas Science, Discovery, and the Universe Computer Science Introduction My capstone was to observe.
25s detection of the Sy1 galaxy NGC3516 The Palermo BAT survey project Application to a sample of SDSS LINERs V. La Parola, A.Segreto, G. Cusumano, V.
WebWatcher A Lightweight Tool for Analyzing Web Server Logs Hervé DEBAR IBM Zurich Research Laboratory Global Security Analysis Laboratory
Gamma-Ray Bursts with the ANTARES neutrino telescope S. Escoffier CNRS/CPPM, Marseille.
Source catalog generation for DC2 Aim (in order of priority): 1.Improve on source detection algorithm and error box. 2.Provide a list of source identifications.
1 Unbiased All-Sky Search (Michigan) [as of August 17, 2003] [ D. Chin, V. Dergachev, K. Riles ] Analysis Strategy: (Quick review) Measure power in selected.
MSW - July The Establishment of Astrometric Calibration Regions And the determination of positions for objects much fainter than existing reference.
Astronomy 1020 Stellar Astronomy Spring_2016 Day-3.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
GSPC -II Program GOAL: extend GSPC-I photometry to B = V ˜ 20 add R band to calibrate red second-epoch surveys HOW: take B,V,R CCD exposures centered at.
Data Science Interview Questions 1.What do you mean by word Data Science? Data Science is the extraction of knowledge from large.
VIRTUAL OBSERVATORIES of the FUTURE June 2000 Caltech Solar System Surveys Steven H. Pravdo Jet Propulsion Laboratory.
Validation of HLA Source Lists Feb. 4, 2008 Brad Whitmore 1.Overview 2.Plots 3.Summary.
Low-latency Selection of Gravitational-wave Event Candidates
Presented by: Kevin Beaulieu & Dustin Crabtree
Portfolios THE US NATIONAL VIRTUAL OBSERVATORY
Nicolas Rothbacher University of Puget Sound
Presentation transcript:

voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Transients from NEAT data Extensible: PQ (+ other surveys) Complimentary to other approaches (e.g. catalog domain) Brief update on Solar System objects/Variables associated with VOEvent error ellipses

NEAT NEAT is a program to look for Near Earth Asteroids (Mike Brown et al.) o Palomar observatory o 48-inch Oschin Schmidt telescope o Palomar-QUEST camera CCDs o Point and shoot mode

The Palomar-Quest (PQ) and NEAT Surveys P48 done with the Yale/IU Quest CCD camera at the Palomar 48 Oschin Schmidt telescope

The NEAT mode o Triplets 20 or 90 minutes apart o Single filter (R) used o Subroutine looks for possible transients o Lot of junk ensuring real candidates are retained o Several tens per night

Process flow A NEAT tar file arrives nightly Script detects new arrival - springs in to action Valid candidates identified and transformed on to a web page - tentatively it is: Alerts sent off for most promising ones

First attempt o Take a triplet o Obtain catalogs using sextractor o Throw out extended objects o Compare seeing based object numbers o Check if central object shows big magnitude swing

Data Flow NEAT.tar Files MEFs Images IRAF SExtractor Catalog Matching Possible Transien t? FITS Files 1, 2 & 3 Catalogs 1, 2 & 3 Filter Against Documented Sources, etc. Generate Report, Send Alerts. Database Figure 1. Transient Discovery Flowchart History Extraction (010)… Filter against Seeing

Transient Criteria Object history, h i Visibility/seeing, v i Stellarity, s i Detected? D j j th Candidate is ranked by probability, p j Image 1Image 2Image 3Possible Transient (Best case)

Complicating Factors Faint stars near detection threshold CCD defects Satellites, airplanes Crowded fields Asteroids Known variables

Example artifacts o CCD defects o Reflections o Grazing CRs o Partially uncorrected bad columns o unknowns

More artifacts

Some reasons o Sextractors S/G classification is not the best o In crowded areas and with variable seeing sextractor gets easily confused

Modifications o Better statistics - sigma clipping to determine typical variation (non- intrinsic) o Use checkimage and the extent of object it defines to better estimate the magnitude o Obtain stellarity measure independently

Result o Much better clean-up o A very small fraction of possibly real candidates get thrown out o Smaller proportion of contaminants o Script now ready as a blackbox to unleash transients o Advanced cog-sci still needed to assign significance values to events

Specimen

And couple more

Complimentary work Current work is clearly extensible to other surveys, and especially our own Drift Scan data from the Palomar- QUEST survey. o Basic work based on mosaicing carried out for the Griffith Observatory picture has been started o Being extended using HyperAtlas o To be real time in the near future

Asteroids in the Big Picture Tile b Cantabia

The Big Picture A 152 ft 20 ft mural produced for Griffith Observatory from PQ survey BRI images A swath of swath through the center of the Virgo cluster, sampled at 0.4 arcsec/pixel, giving a 136,800 18,000 pixel image Computed at CACR using HyperAtlas and a custom data cleaning pipeline Reproduced on 114 steel-backed porcellain plates, expected to last many decades Will be seen by millions of visitors Associated website will include NVO outreach

The Big Picture: Tile C12 (M87) Zoom-in

Big Picture - Detail

Catalog domain Another complimentary area is the catalog domain o Started a basic program using single epoch catalogs from the Yale pipeline o Awaiting new and improved catalogs from Caltech pipeline which is now up and running o This is next day stuff …

Examples (Priya Kollipara)

Conclusions for part I We are ready to start producing events. Lots of them. It is now important to have ways to Attach significance values to different Events. (Entities like aggregators will not be intelligent unless we make them so)

Event Synthesis Engine Pairitel Palomar 60 Raptor PQ next-day pipelines catalog Palomar-Quest known Variables known asteroids SDSS 2MASS PQ Event Factory remote archives baseline sky eStar VOEventNet VOEventNet: a Rapid-Response Telescope Grid VOEvent database

Solar system objects/Variables Known asteroids and variables can masquerade as transients. These can easily be eliminated by overplotting the error ellipse with solar system objects and variables. o Get epoch, coordinates, error ellipse o Get solar system objects, variables and a sky survey image o Allow overplotting of other possibly interesting source types like X-ray and radio sources.

bin/grand_aladin3.cgi Currently uses aladin. Images from DPOSS for northern sky and DSS for southern sky could be used ent/ ent/ has the collective list

GUI (RESTful) String DateTime SIAP like

Output

Currently as cgi Directly callable Can consume feeds directly Events stored as an HTML page

Current tentative URLs NEAT VOEvents: Solar System objects/Variables: bin/grand_aladin3.cgi bin/grand_aladin3.cgi