Antony Lewis Institute of Astronomy, Cambridge

Slides:



Advertisements
Similar presentations
CMB Power spectrum likelihood approximations
Advertisements

DATA & STATISTICS 101 Presented by Stu Nagourney NJDEP, OQA.
Evolving Edge detection Final project by Rubshtein Andrey ( )
Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
Mean, Proportion, CLT Bootstrap
Copyright © 2009 Pearson Education, Inc. Chapter 29 Multiple Regression.
Digital Image Processing Lecture 11: Image Restoration Prof. Charlene Tsai.
AP Statistics – Chapter 9 Test Review
1Ellen L. Walker Edges Humans easily understand “line drawings” as pictures.
Chapter 8-3 Markov Random Fields 1. Topics 1. Introduction 1. Undirected Graphical Models 2. Terminology 2. Conditional Independence 3. Factorization.
The REGLENS method Rachel Mandelbaum STEP Workshop 2007 Collaborators: Christopher Hirata, Uros Seljak.
Chapter 8 Estimating Single Population Parameters
Chapter 7 Introduction to Sampling Distributions
Model Fitting Jean-Yves Le Boudec 0. Contents 1 Virus Infection Data We would like to capture the growth of infected hosts (explanatory model) An exponential.
Image processing. Image operations Operations on an image –Linear filtering –Non-linear filtering –Transformations –Noise removal –Segmentation.
Problem Sets Problem Set 3 –Distributed Tuesday, 3/18. –Due Thursday, 4/3 Problem Set 4 –Distributed Tuesday, 4/1 –Due Tuesday, 4/15. Probably a total.
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
Power Laws Otherwise known as any semi- straight line on a log-log plot.
End of Chapter 8 Neil Weisenfeld March 28, 2005.
Chapter 7 Estimation: Single Population
Today Today: Chapter 8, start Chapter 9 Assignment: Recommended Questions: 9.1, 9.8, 9.20, 9.23, 9.25.
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Tal Mor  Create an automatic system that given an image of a room and a color, will color the room walls  Maintaining the original texture.
A P STATISTICS LESSON 9 – 1 ( DAY 1 ) SAMPLING DISTRIBUTIONS.
The Statistical Properties of Large Scale Structure Alexander Szalay Department of Physics and Astronomy The Johns Hopkins University.
Hypothesis Testing. Distribution of Estimator To see the impact of the sample on estimates, try different samples Plot histogram of answers –Is it “normal”
1 Patch Complexity, Finite Pixel Correlations and Optimal Denoising Anat Levin, Boaz Nadler, Fredo Durand and Bill Freeman Weizmann Institute, MIT CSAIL.
Thomas Kitching Bayesian Shape Measurement and Galaxy Model Fitting Thomas Kitching Lance Miller, Catherine Heymans, Alan Heavens, Ludo Van Waerbeke Miller.
Realistic images, containing a known shear (distortion) signal. Animations show 0-10% distortion in 1% steps (much bigger than ~2% real signal). Simulated.
Chap 20-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 20 Sampling: Additional Topics in Sampling Statistics for Business.
PROBABILITY (6MTCOAE205) Chapter 6 Estimation. Confidence Intervals Contents of this chapter: Confidence Intervals for the Population Mean, μ when Population.
Chapter 4 Statistics. 4.1 – What is Statistics? Definition Data are observed values of random variables. The field of statistics is a collection.
University of Ottawa - Bio 4118 – Applied Biostatistics © Antoine Morin and Scott Findlay 08/10/ :23 PM 1 Some basic statistical concepts, statistics.
Methods in Gravitational Shear Measurements Michael Stefferson Mentor: Elliott Cheu Arizona Space Grant Consortium Statewide Symposium Tucson, Arizona.
Optimizing DHCAL single particle energy resolution Lei Xia 1 CALICE Meeting LAPP, Annecy, France September 9 – 11, 2013.
Learning Lateral Connections between Hidden Units Geoffrey Hinton University of Toronto in collaboration with Kejie Bao University of Toronto.
Copyright © 2012 Pearson Education. All rights reserved © 2010 Pearson Education Copyright © 2012 Pearson Education. All rights reserved. Chapter.
1 Chapter 7 Sampling Distributions. 2 Chapter Outline  Selecting A Sample  Point Estimation  Introduction to Sampling Distributions  Sampling Distribution.
Sampling Methods and Sampling Distributions
BUS216 Spring  Simple Random Sample  Systematic Random Sampling  Stratified Random Sampling  Cluster Sampling.
Weak Lensing 2 Tom Kitching. Recap Lensing useful for Dark energy Dark Matter Lots of surveys covering 100’s or 1000’s of square degrees coming online.
Conversion of Stackfit to LSST software stack Status as of Feb 20, 2012.
BCS547 Neural Decoding. Population Code Tuning CurvesPattern of activity (r) Direction (deg) Activity
STEP4 Konrad Kuijken Leiden. Back to basics? STEP1,2,3 –‘end-to-end’ tests for constant-shear images –What causes discrepancies? Selection bias PSF modelling.
CONFIDENCE INTERVALS.
1 Chapter 9: Sampling Distributions. 2 Activity 9A, pp
Summarizing Risk Analysis Results To quantify the risk of an output variable, 3 properties must be estimated: A measure of central tendency (e.g. µ ) A.
Sampling and estimation Petter Mostad
Week 6. Statistics etc. GRS LX 865 Topics in Linguistics.
Lecture 8 Source detection NASSP Masters 5003S - Computational Astronomy
Lecture 5 Introduction to Sampling Distributions.
Statistics Outline I.Types of Error A. Systematic vs. random II. Statistics A. Ways to describe a population 1. Distribution 1. Distribution 2. Mean, median,
" Fitting methods with direct convolution for shear measurements." STEP Workshop August 2007 M. Shmakova.
STAR SVT Self Alignment V. Perevoztchikov Brookhaven National Laboratory,USA.
Measuring shear using… Kaiser, Squires & Broadhurst (1995) Luppino & Kaiser (1997)
MATH Section 4.4.
Week 21 Statistical Assumptions for SLR  Recall, the simple linear regression model is Y i = β 0 + β 1 X i + ε i where i = 1, …, n.  The assumptions.
Comparison of MC and data Abelardo Moralejo Padova.
Confidence Intervals and Sample Size. Estimates Properties of Good Estimators Estimator must be an unbiased estimator. The expected value or mean of.
Statistics for Business and Economics 8 th Edition Chapter 7 Estimation: Single Population Copyright © 2013 Pearson Education, Inc. Publishing as Prentice.
Sampling Distributions Chapter 18. Sampling Distributions A parameter is a number that describes the population. In statistical practice, the value of.
Introduction to emulators Tony O’Hagan University of Sheffield.
Measuring Cosmic Shear Sarah Bridle Dept of Physics & Astronomy, UCL What is cosmic shear? Why is it hard to measure? The international competition Overview.
NASSP Masters 5003F - Computational Astronomy Lecture 4: mostly about model fitting. The model is our estimate of the parent function. Let’s express.
Chapter 10 Confidence Intervals for Proportions © 2010 Pearson Education 1.
Parameter versus statistic
General Features of Fitting Methods
Basics of Photometry.
Shears from shapelets Konrad Kuijken Leiden.
Digital Image Processing Lecture 11: Image Restoration
Presentation transcript:

Antony Lewis Institute of Astronomy, Cambridge

KK99 Try to find valid (robust) but non-optimal method Baseline for comparison that any good valid method should be able to beat. May help to identify important issues. In general need to have consistent galaxy model to get the correct answers. [All (?) existing models except KK99 do not use a consistent galaxy model]. On average galaxies have circular symmetry: easy to model. Simple priors obvious (e.g. smooth probably monotonic function) By Central Limit Theorem, measured averaged galaxy also has Gaussian distribution: know statistical model. Fit PSF-convolved sheared radially-symmetric averaged galaxy to stacked image Use splines to model average shape accurately. Well determined because lots of galaxies used to make average. For constant shear only need averaged PSF (varies due to pixels even in Great08) Sub-optimal but well-defined method for low noise that seems to work (possible small calibration error) Maybe hope gives ideas for new separate galaxy method where galaxy modelling errors cancel

Problems with noise With noise, centroid cannot be determined accurately: have to account for galaxy-dependent error in centroid estimate. Shear -> centroid error aligned with shear -> calibration error [sim bias from PSF, + other effects?] Can estimate centroid error and circularize it to eliminate some of the bias. But model no longer strictly valid – only approximate Currently no attempt made to tune weights, some obvious room for improvement.

GREAT08 feedback Web sites well set up and lots of useful information. Challenge appears to be well defined (modulo assumptions about galaxies) without being too easy. Files too large to be convenient (I had at most 200GB free on a disk, so had to use two; days spent downloading and shuffling files around + file corruptions, ssh connection problems, etc…) Unable to test well on noisy images due to not enough test images with same shear [hard to tell if differences due to random or systematic effects]. Making own similar simulations too time consuming. Properties of PSF worryingly idealized (i.e. no dipole, qualitatively different from reality, even if known and constant) How do you know even in principle how well we should be able to do?

Retrospective GREAT08 wish list Provide results for some known method (e.g. KSB): - many good methods will be iterative, e.g. provisional estimates useful for weighting galaxies in unbiased way. Save lots of time by providing results from known method. - can speed convergence by starting near known-good parameters - useful for sanity checks on things going wildly wrong At least one set of more galaxies to beat down noise for testing Source code (minus parameters) for the simulations for confidence in validity - when youre code doesnt work, very easy to doubt that simulations have been done correctly e.g. is high-enough sub-pixel resolution used, are stamps cut after rather than before PSF convolution, are galaxies occurring in mirror-image pairs, etc. Some feedback in leaderboard about what errors are due to (e.g. in my case probably a calibration-like error, |gamma| too large: i.e. error dominated by plates with largest shears) [Ps. Are fixed star images linked from site?]