(and especially Robert Lupton and Dustin Lang)

Slides:



Advertisements
Similar presentations
Antony Lewis Institute of Astronomy, Cambridge
Advertisements

Announcements •Homework due Tuesday. •Office hours Monday 1-2 instead of Wed. 2-3.
Thomas A. Stewart Literacy Test (OSSLT) Prep Guide 2013
Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen, but we don’t know which particular outcome.
3-D Computer Vision CSc83020 / Ioannis Stamos  Revisit filtering (Gaussian and Median)  Introduction to edge detection 3-D Computater Vision CSc
November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
Edges and Contours– Chapter 7
1 MULTI-WAVELENGTH, MULTI-EPOCH HERITAGE OF STRIPE 82 | PRINCETON, NJ | MARCH 17, 2014 Name of Meeting Location Date - Change in Slide Master LSST Reprocessed.
Lecture 07 Segmentation Lecture 07 Segmentation Mata kuliah: T Computer Vision Tahun: 2010.
Tracking Multiple Occluding People by Localizing on Multiple Scene Planes Professor :王聖智 教授 Student :周節.
The REGLENS method Rachel Mandelbaum STEP Workshop 2007 Collaborators: Christopher Hirata, Uros Seljak.
ELT Stellar Populations Science Near IR photometry and spectroscopy of resolved stars in nearby galaxies provides a way to extract their entire star formation.
Aperture Photometry Not too dependent on the particular psf shape Works well when in “clean” fields – not many nearby stars, and smooth sky background.
Deblending E. BertinDES Munich meeting 05/ Deblending in DESDM E.Bertin (IAP)
Segmentation Divide the image into segments. Each segment:
Tal Mor  Create an automatic system that given an image of a room and a color, will color the room walls  Maintaining the original texture.
Filtering Course web page: vision.cis.udel.edu/cv March 5, 2003  Lecture 9.
Neighborhood Operations
Model-fitting E. BertinDES Munich meeting 05/ Automated model fitting in DESDM E.Bertin (IAP)
Science Impact of Sensor Effects or How well do we need to understand our CCDs? Tony Tyson.
HW 2 Discussion Remember, everything is still an illusion.
Peter Capak Associate Research Scientist IPAC/Caltech.
Methods in Gravitational Shear Measurements Michael Stefferson Mentor: Elliott Cheu Arizona Space Grant Consortium Statewide Symposium Tucson, Arizona.
Progress Report on PSFs and Pixels Jay Anderson, Elena Sabbi, Kailash Sahu, and Matthew Bourque TIPS Feb 19, 2015.
Cosmological studies with Weak Lensing Peak statistics Zuhui Fan Dept. of Astronomy, Peking University.
Making the Sky Searchable: Automatically Organizing the World’s Astronomical Data Sam Roweis, Dustin Lang &
Image Processing Edge detection Filtering: Noise suppresion.
03/05/03© 2003 University of Wisconsin Last Time Tone Reproduction If you don’t use perceptual info, some people call it contrast reduction.
G52IVG, School of Computer Science, University of Nottingham 1 Edge Detection and Image Segmentation.
EECS 274 Computer Vision Segmentation by Clustering II.
1 System wide optimization for dark energy science: DESC-LSST collaborations Tony Tyson LSST Dark Energy Science Collaboration meeting June 12-13, 2012.
How Standard are Cosmological Standard Candles? Mathew Smith and Collaborators (UCT, ICG, Munich, LCOGT and SDSS-II) SKA Bursary Conference 02/12/2010.
December 9, 2014Computer Vision Lecture 23: Motion Analysis 1 Now we will talk about… Motion Analysis.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
Weak Lensing 2 Tom Kitching. Recap Lensing useful for Dark energy Dark Matter Lots of surveys covering 100’s or 1000’s of square degrees coming online.
Data Analysis Software Development Hisanori Furusawa ADC, NAOJ For HSC analysis software team 1.
Counting individual galaxies from deep mid-IR Spitzer surveys Giulia Rodighiero University of Padova Carlo Lari IRA Bologna Francesca Pozzi University.
Conversion of Stackfit to LSST software stack Status as of Feb 20, 2012.
23 November Md. Tanvir Al Amin (Presenter) Anupam Bhattacharjee Department of Computer Science and Engineering,
April 2001 OPTICON workshop in Nice 1 PSF-fitting with SExtractor Emmanuel BERTIN (TERAPIX)
April 2001 OPTICON workshop in Nice 1 The PSF homogenization problem in large imaging surveys Emmanuel BERTIN (TERAPIX)
CSC321 Introduction to Neural Networks and Machine Learning Lecture 3: Learning in multi-layer networks Geoffrey Hinton.
Boosted Particle Filter: Multitarget Detection and Tracking Fayin Li.
MOS Data Reduction Michael Balogh University of Durham.
Photometric Redshifts: Some Considerations for the CTIO Dark Energy Camera Survey Huan Lin Experimental Astrophysics Group Fermilab.
CSE 6367 Computer Vision Image Operations and Filtering “You cannot teach a man anything, you can only help him find it within himself.” ― Galileo GalileiGalileo.
Luminous Red Galaxies in the SDSS Daniel Eisenstein ( University of Arizona) with Blanton, Hogg, Nichol, Tegmark, Wake, Zehavi, Zheng, and the rest of.
The LSST Data Processing Software Stack Tim Jenness (LSST Tucson) for the LSST Data Management Team Abstract The Large Synoptic Survey Telescope (LSST)
6. Population Codes Presented by Rhee, Je-Keun © 2008, SNU Biointelligence Lab,
July 21, 2004 Natalia Kuznetsova NICMOS Analysis of ACS ● Data Inventory ● Calibration ● Bad pixel mask ● Extracting photometry ● Next steps 1.
Source catalog generation for DC2 Aim (in order of priority): 1.Improve on source detection algorithm and error box. 2.Provide a list of source identifications.
Machine Vision Edge Detection Techniques ENT 273 Lecture 6 Hema C.R.
Selection and Characterization of Interesting Grism Spectra Gerhardt R. Meurer The Johns Hopkins University Gerhardt R. Meurer The Johns Hopkins University.
Introduction to Scale Space and Deep Structure. Importance of Scale Painting by Dali Objects exist at certain ranges of scale. It is not known a priory.
Digital Aperture Photometry ASTR 3010 Lecture 10 Textbook 9.5.
Problem Set 2 Reconstructing a Simpler World COS429 Computer Vision Due October (one week from today)13 th.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
All-sky source search Aim: Look for a fast method to find sources over the whole sky Selection criteria Algorithms Iteration Simulations Energy information.
Course : T Computer Vision
Chapter 10 Image Segmentation
Jean Ballet, CEA Saclay GSFC, 31 May 2006 All-sky source search
Cosmology and Galaxies Level 3 Requirements
Shapelets shear measurement methods
Machine Learning Basics
Convolutional Networks
DM Plans for Crowded Stellar Fields
Source catalogue generation
Basics of Photometry.
Presentation transcript:

(and especially Robert Lupton and Dustin Lang) Deblending Jim Bosch for Data Management (and especially Robert Lupton and Dustin Lang)

There Will Be Blends LSST will go deep: LSST is on the ground: We’ll detect fainter objects. We’ll see the low surface brightness wings of everything. LSST is on the ground: Even under the best conditions, image quality won’t be as good as what we’d get from space

There Will Be Blends From David Kirkby (in prep)

Kinds of Blends

Space and Ground HST WFC3 F125 Subaru HSC i

Case 1: Unknown Unknowns If sources are so close we can’t tell they’re blended, there’s nothing the DM pipelines can do. Data from space could help, but using this will likely be Level 3. Mostly, we’ll have to deal with these statistically in the science analysis.

Space and Ground HST WFC3 F125 Subaru HSC i

Case 2: Known Unknowns We believe there may be more than one source in a particular region. We want to measure the properties of the sources in as if they were isolated. Simultaneous model-fitting is one option, but it may not be the best one. Some popular measurements (e.g. aperture fluxes, image moments) require that we actually try to split up the pixels. We don’t have good models for some kinds of sources (e.g. galaxies).

Deblending Stars This is easy, if we have a good PSF model: just fit models simultaneously. Because stars (at any given epoch) are completely represented by positions and fluxes, there’s no need to do additional measurements. If we don’t have enough isolated stars to build a PSF model, we need a crowded field code.

Deblending Galaxies Unlike stars, we don’t have good models for galaxies. This is clearly bad new for bright, well-resolved galaxies. It might also be bad news for faint or poorly-resolved galaxies.

The SDSS Deblender: a Starting point

The SDSS Deblender: Detection In each band, we smooth the image, then detect above-threshold regions (Footprints). We then grow these regions by the size of the smoothing kernel. Within each Footprint, we find one or more Peaks. SDSS

The SDSS Deblender: Merging/Culling We compute the spatial union of all the Footprints from different bands, epochs, smoothing kernels. Within each Footprint, we merge all the Peaks from the different detection images, culling those that appear to represent the same source.

The SDSS Deblender: Symmetric Templates true source profiles pixel values 𝑧 templates 𝑇 For each Peak 𝑖 and pixel 𝑥, create a template 𝑇 𝑖,𝑥 that is the minimum of the pixel value 𝑧 𝑥 and its reflection about the peak 𝑧 ~𝑥 . Do a linear fit for the amplitudes 𝛼 𝑖 of all templates by minimizing: 𝑥 𝑧 𝑥 − 𝑖 𝛼 𝑖 𝑇 𝑖,𝑥 2 Compute deblended pixel values: 𝑧 𝑥,𝑖 ∗ = 𝛼 𝑖 𝑇 𝑖,𝑥 𝑧 𝑥 𝑗 𝛼 𝑗 𝑇 𝑗,𝑥 residuals deblended pixels 𝑧 ∗

The SDSS Deblender: Symmetric Templates 𝒛 𝒙 𝒛 ~𝒙 SDSS

The SDSS Deblender: Heuristics If the dot product of any two templates is close to one, drop one of them. If a template looks a lot like the PSF model, use the PSF model as the template instead. Put limits on how sharp a template’s features can be.

The SDSS Deblender: Measurement We call the outputs of the deblender HeavyFootprints: they’re Footprints that also hold the pixels of the deblended children. When we measure a source, we replace every other source’s Footprint with noise first. In addition to measuring the child sources, we also measure the parents (because we might have been wrong about it being a blend, or the deblender may have done more harm than good).

Features of the SDSS Deblender We can run any measurement algorithm we can run on isolated sources. Flux is conserved as it is split up. No simple assumptions about galaxy morphology: not only is 180˚ rotation a weak constraint, it’s only enforced on the templates, not the deblended pixels.

Weaknesses of the SDSS Deblender Only Peaks are shared between bands; no good way to generate reasonable templates for drop-out sources. No way to account for multiple epochs with different PSF. Doesn’t handle uncertainty rigorously. Vetted on a survey with a much less severe blending problem.

What next?

Detection for LSST Detection will happen on multiple coadds: different bands (or weighted combinations of bands) different smoothings (i.e. morphological filters) ...and difference images. We need to merge these detections in order to deblend consistently. We need to transfer the deblender outputs back to images with different bands, PSFs, WCSs, and observation dates.

Going Multi-Epoch We can convolve templates derived in one band or image with a difference kernel to generate one appropriate for a different band or image. We can use point-source templates for drop-outs. We can use PSF-convolved analytic models as templates.

...or Simultaneous Fitting? We’re going to use simple galaxy models for many of our most important measurements; do we gain anything (or lose anything!) by redistributing pixel flux using a more flexible model first? Can we make galaxy models flexible enough to make model biases unimportant? Flux redistribution with templates may still be useful as a starting point – it’s a lot faster than a high-dimensional nonlinear fit.

More on Galaxy Modeling What should we let vary between bands? How flexible should models be? If they’re very flexible, how do we handle low SNR sources? Can we afford to sample rather than fit? If we need priors, where do they come from? Do we fit a star model and a galaxy model to everything? Come to the breakout session at 1:30pm today!

Using Colors? There’s a lot more information in the spectral dimension that could be used in deblending. We don’t want to bias downstream algorithms (e.g. photo-zs) or make it less likely to find new and interesting objects that don’t have “normal” colors.

SDSS functionality visit images simultaneous fitting final models coaddition image subtraction preliminary models coadd images replace neighbors with noise, measure difference images detect SDSS functionality detect Footprints & Peaks generate templates, reapportion pixel fluxes Footprints & Peaks merge/cull coadd Heavy Footprints Footprints & Peaks

The LSST Prototype Deblender The LSST DM Stack includes a limited reimplementation of the SDSS Deblender. We don’t have any code for the peak merge/cull stage, so we can’t deblend across multiple bands in a consistent way. We don’t have some of the heuristics that were used in SDSS.

What We Don’t Know Can Hurt Us The presence of a LRG affects the measurement of the properties of sources arcminutes away. This is because undetected galaxies cluster with the galaxies we do detect, and that upsets the measurement algorithms in a systematic way. Error in measurements of simulated galaxies injected into real data. Huff and Graves (2014)