MIPS Enhancer MIPS_Enhancer Overview MIPS Data Processing and Calibration Workshop April 12, 2004.

Slides:



Advertisements
Similar presentations
Measures of Central Tendency and Variation 11-5
Advertisements

A NEW CTE PHOTOMETRIC CORRECTION FORMULA FOR ACS Marco Chiaberge TIPS meeting 05/16/2012.
Image Processing Tutorial
Spectral Combination Software Jerry Kriss 5/8/2013.
MIPS Data Processing for SINGS George J. Bendo & Chad Engelbracht (A ''George's Adventures in Learning OpenOffice'' Presentation)
Mark Nelson Rendering algorithms Fall 2013
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Whoever North American.
Analysis of chip with 100 events, July 2001 Variation in pixel to pixel average ADC values (fixed pattern noise) Pixel ADC value event to event repeatability.
SJC - 109/29/05IRAC Calibration Workshop Status of IRAC Artifact Corrector Sean Carey.
15 Jan 2004 SINGS Tucson Meeting - DAD 1 SL and LL visualizations.
Business Statistics: A Decision-Making Approach, 7e © 2008 Prentice-Hall, Inc. Chap 3-1 Business Statistics: A Decision-Making Approach 7 th Edition Chapter.
Regression III: Robust regressions
1 Business 260: Managerial Decision Analysis Professor David Mease Lecture 1 Agenda: 1) Course web page 2) Greensheet 3) Numerical Descriptive Measures.
Basics: Notation: Sum:. PARAMETERS MEAN: Sample Variance: Standard Deviation: * the statistical average * the central tendency * the spread of the values.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 3-1 Introduction to Statistics Chapter 3 Using Statistics to summarize.
Chapter 3, Part 1 Descriptive Statistics II: Numerical Methods
C&A 10April06 1 Point Source Detection and Localization Using the UW HealPixel database Toby Burnett University of Washington.
Business Statistics BU305 Chapter 3 Descriptive Stats: Numerical Methods.
October, 2004ADASS XIV O1.31 Hires: Super-resolution for the Spitzer Space Telescope Charles Backus Velu Velusamy Tim Thompson John Arballo Description.
Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.
Unit 4 – Probability and Statistics
Vocabulary for Box and Whisker Plots. Box and Whisker Plot: A diagram that summarizes data using the median, the upper and lowers quartiles, and the extreme.
Chapter 12 Spatial Sharpening of Spectral Image Data.
MGQ 201 WEEK 4 VICTORIA LOJACONO. Help Me Solve This Tool.
NGC 6217 in DSI mode with F658N Mosaic before new superbias why we don’t release images until after SMOV! ACS CCD monitoring and pipeline calibration review.
Chapter 3 – Descriptive Statistics
HIFI Tutorial 3: Getting some basic science out A.P.Marston ESAC 27 June 2013.
Descriptive statistics Describing data with numbers: measures of variability.
Objectives Vocabulary
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
STAT 280: Elementary Applied Statistics Describing Data Using Numerical Measures.
JAVA-GAMUT and V.AveLib Update Michael Birch – Presented by Balraj Singh McMaster University, Canada IAEA-NSDD Meeting, Vienna April 20-24, 2015.
Lecture 3 Describing Data Using Numerical Measures.
Robust Real-time Face Detection by Paul Viola and Michael Jones, 2002 Presentation by Kostantina Palla & Alfredo Kalaitzis School of Informatics University.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-202 (for Hipe 8.0) Level 0 to Level 2 processing: From raw data to calibrated.
What’s in a sum? Simon Dawes CMHAS. Should you stack frames using Mean, Median or Sum?
ACS Drizzling Overview J. Mack; DA Training 10/5/07 Distortion Dither Strategies MultiDrizzle ‘Fine-tuning’ Data Quality Photometry.
Image processing Fourth lecture Image Restoration Image Restoration: Image restoration methods are used to improve the appearance of an image.
Chapter 12 B+ Trees CS 157B Spring 2003 By: Miriam Sy.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
Quantitative data. mean median mode range  average add all of the numbers and divide by the number of numbers you have  the middle number when the numbers.
Foundations of Math I: Unit 3 - Statistics
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-201 (for Hipe 12.0) Level 1* to Level 2 processing: The High-Pass Filter pipeline.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
ACS/WFC CTE correction for point source photometry Marco Chiaberge ACS Team STScI.
What are the effects of outliers on statistical data?
Copyright © 2011 Pearson Education, Inc. Describing Numerical Data Chapter 4.
Calo preparation for 2015 Goals: -Trigger stability -Good calibration for HLT2 processing -Improved calibration ( timing, e/gamma response) for all calo.
Chapter 3 Averages and Variation Understanding Basic Statistics Fifth Edition By Brase and Brase Prepared by Jon Booze.
Descriptive statistics Describing data with numbers: measures of variability.
1 1 Slide © 2003 South-Western/Thomson Learning TM Chapter 3 Descriptive Statistics: Numerical Methods n Measures of Variability n Measures of Relative.
Claritas 3D REFSTAT: Refraction statics calculations.
PyRAF/Pipeline Removal of SAA Persistence from NICMOS Data Elizabeth A. Barker Vicki Laidler Eddie Bergeron Anton Koekemoer Elizabeth A. Barker Vicki Laidler.
Info Read SEGY Wavelet estimation New Project Correlate near offset far offset Display Well Tie Elog Strata Geoview Hampson-Russell References Create New.
Unsupervised Classification
09/24/2008Unavco Track Intro1 TRACK: GAMIT Kinematic GPS processing module R King overview from longer T Herring.
Measures of Center Sigma- A symbol for sum. ∑ Summation Notation- The use of the sigma symbol to represent a summation. Also called sigma-notation or.
Measures of Central Tendency and Variation
Nautel HD PowerBoost Asymmetric Sidebands Philipp Schmid
Jean Ballet, CEA Saclay GSFC, 31 May 2006 All-sky source search
Statistics in MSmcDESPOT
Averages and Variation
Chapter 3 Describing Data Using Numerical Measures
S1: Chapter 4 Representation of Data
Summary of dE/dx studies in silicon and MS in muon system
Claritas 3D REFSTAT: Refraction statics calculations
Measures of Central Tendency and Variation 8-1
12.4 Box-and-Whisker Plots
Execution time Execution Time (processor-related) = IC x CPI x T
Warm up Honors Algebra 2 3/14/19
Presentation transcript:

MIPS Enhancer MIPS_Enhancer Overview MIPS Data Processing and Calibration Workshop April 12, 2004

How to Run MIPS_ENHANCER Command line options –mips_enhancer –f filename.fits (40+ options) Namelist options –mips_enhancer –n namelist.in

What have we learned since launch ? Need to make MIPS_enhancer more efficient in terms of: –Memory –Speed Improve method of combing surface bright nesses.

Memory and Speed Tiling –-x #, -y # –Only operating on tile sub-pixels Do not hold mosaic in memory –-m Memory limited to current tile Write tiles out Stitch mosaic from tiles –Necessary to change format of mosaic to limit memory needed. Primary header (history, information from first DCE) Extensions: surface brightness, uncertainty, pixel flag, overlap coverage)

Conserving Surface Brightness Improvements in: –Outlier rejection algorithm –Weighting overlapping pixels in mosaic

Outlier Rejection Algorithm For each sub- pixel there is a stack of overlapping BCD pixels.

Sub-Pixel Outlier Rejection N BCD overlapping pixel values Start Iteration i = 1. Find the median value: Median org Find Standard Deviation: STDEV org Find N differences: |(Median org – flux k )| Sort differences Withhold 10% largest differences (minimum 1) Find new median and standard deviation of remaining points: Median i, STDEV i Test Most deviant point: –(Flux most deviant point – Median i )/STDEV i > Sigma Clipping (SC) –If reject – iterate

Outlier Rejection cont. Continue iterating until: –Remain points < Minimum Points (SP) –Iteration # > Maximum # iterations (SM) –((STDEV org – STDEV new )/STDEV org )*100 > Sigma Tolerance (ST)

Variation on Outlier Rejection Option: SK Test Most deviant point: (Flux most deviant point – Median i )/STDEV i > Sigma Clipping (SC) Option: SU Instead of using the standard deviation of stack: STDEV i Combine in quadrature: uncertainty of BCD pixel and standard deviation of Median

Obsolete Outlier Rejection options Obsolete Outlier Rejection options Quartiles May retire thresholding (t) –(Flux i /Median Flux) > t continue rejecting –(Flux i /Median Flux) < t stop rejection

Conserving Surface Brightness For each sub-pixel we have N BCD pixels overlapping –Surface Brightness of BCD –Uncertainty associated with surface brightness –Overlap Area How do we combine information to conserve surface brightness in mosaic ?

Distortions

Weighting Methods Most probable value is a weighted average of points:  w i x i /  w i W 1 = overlap area, uncertainties W 2 =overlap area W 3 =overlap area, S/N (SB/uncertainty) W 4 =overlap area, SQRT(S/N) W 5 =overlap area, SQRT(S)

Useful Options for MIPS_enhancer -f filename (-i list of files) -o output_name -RR (remove rotation) -s # (scale factor, recommended = 0.25 ) dy (correct for distortion, default) -x #, -y #, -m (memory & speed options) -r # (70 microns, # BCDs to reject after stim, recommened 1) -IB (ignore bias boost, 24 microns, default) -W2 (W1,W3,W4,W5) Weight options -SC #, ST #, SP #, SM # SK, SU (outlier rejection options Recommened:SC 4, ST 10, SP 3, SM 30, SK) -FM (FD) sub-pixel flux weighted mean (median) -D, -C, -FL (sets other appropriate options)

Near Term Improvements SED mode Distortion (verify or tweak distortion coefficients produced from CODE-V) Study on surface brightness conservation –Add weighting which only uses the number of reads that went into the slope determination. –Develop testing routine to see how well we have Use simulating routine (Emeric) to add sources to cal file. Move on to 160 micron data Start enhancing framework

Suggestions ?