Software for Deep Survey How useful are tools developed for HIPASS for ALFA surveys? HIPASS members in DEEP working group Software not specific to DEEP.

Slides:



Advertisements
Similar presentations
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
Advertisements

Australian Virtual Observatory Pacific Rim Applications and Grid Middleware Assembly The 4th Workshop 5th-6th June 2003 Monash University David Barnes.
Basics of mm interferometry Turku Summer School – June 2009 Sébastien Muller Nordic ARC Onsala Space Observatory, Sweden.
Eleventh Synthesis Imaging Workshop Socorro, June 10-17, 2008 Wide Field Imaging II: Mosaicing Debra Shepherd.
S-PASS, a new view of the polarized sky Gianni Bernardi SKA SA On behalf of the S-PASS team CMB2013, Okinawa, June th 2013.
Deep Neutral Hydrogen Surveys with the Arecibo 305-m Telescope – the Arecibo Galaxy Environment Survey Robert Minchin NAIC Arecibo Observatory.
A MOPRA CS(1-0) demonstration survey of the Galactic plane G. Fuller, N. Peretto, L. Quinn (University of Manchester UK), J. Green (ATNF ) All dust continuum.
Lister Staveley-Smith – GALFA March 21, Parkes HI Surveys  HIPASS –An extragalactic survey reprocessed for Galactic science  Magellanic System.
ATNF Scientific Software – an overview Mark Wieringa – ATNF/Operations/SCA.
EOR Detection Strategies Somnath Bharadwaj IIT Kharagpur.
EURO 3D – Kick Off Meeting – IAC 2-3-4/07/2002 Deconvolution of 3D data cubes Task manager : Pierre Ferruit (CRAL)
Interferometric Spectral Line Imaging Martin Zwaan (Chapters of synthesis imaging book)
HI from z ~ 0 – 1 with FAST D.J. Pisano West Virginia University NRAO.
HIPark – a parked Parkes survey Goals: ultra sensitive to low column densities How sensitive ? … optically thin at the Lyman limit exercise in observational.
BLAH BLAH BLAH nvvbnvbnvbncvncn. Abstract A complete sample of point source emissions in the spiral type galaxies NGC300 and M31 have been catalogued.
Cosmology Zhaoming Ma July 25, The standard model - not the one you’re thinking  Smooth, expanding universe (big bang).  General relativity controls.
WG1: Techniques and Applications Wed AM: imaging comparison Wed PM1: source positions Wed PM2: source sizes Thu AM1: new algorithms Thu AM2: source fluxes.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array.
BLAH BLAH BLAH nvvbnvbnvbncvncn. Abstract A complete sample of point source emissions in the spiral type galaxies NGC300 and M31 have been catalogued.
Neutral Hydrogen Gas in Star Forming Galaxies at z=0.24 HI Survival Through Cosmic Times Conference Philip Lah.
Astronomy at 100 MHz HI-z vs ZZ Top. damped Lyman-  abs-lines 21cm Line Studies (HIPASS)
Cataloguing and Data Sharing: Getting the Most Out of Archives Management Software Joanna Rae Ellen Bazeley-White British Antarctic Survey High Cross,
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
Simulating JWST-MIRI data with the Multi-Object Simulator (MOSim) Owen Littlejohns, Paul O’Brien & John Pye Department of Physics & Astronomy University.
Coordinated High |b| Drift Survey Basics: Combination of 12 s/beam and 60 s/beam surveys High latitude sky (wait for low latitude for commensal) 100 MHz.
MEASUREMENT PLAN SOFTWARE MEASUREMENT & ANALYSIS Team Assignment 15
GBT radio recombination lines (GBT-5) Single Dish Summer School July 2009.
Survey Quality Jim Condon NRAO, Charlottesville. Survey Qualities Leiden 2011 Feb 25 Point-source detection limit S lim Resolution Ω s Brightness sensitivity.
HIFI Tutorial 3: Getting some basic science out A.P.Marston ESAC 27 June 2013.
J. Hibbard Spectral Line II: Calibration & Analysis 1 Spectral Line II: Calibration and Analysis Bandpass Calibration Flagging Continuum Subtraction Imaging.
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
Which dipoles to use to optimize survey speed? –What tapering? –Trade-off between sensitivity, FOV and low side-lobe levels –Station beam stability, pointing.
EASI a free web database application for collecting and managing monitoring records.
THE LWA SOFTWARE LIBRARY Jayce Dowell – LWA Users’ Meeting – July 27, 2012.
F. Levrier (LERMA - ENS) J. Pety (LERMA - IRAM Grenoble) P. Salomé (LERMA - Observatoire de Paris) STAR FORMAT meeting, Heidelberg, 4-5 may 2010 Making.
The H ICAT Optical Catalogue H OPCAT Marianne T. Doyle Ph.D. Project.
Ninth Synthesis Imaging Summer School Socorro, June 15-22, 2004 Spectral Line II John Hibbard.
Basic Concepts An interferometer measures coherence in the electric field between pairs of points (baselines). Direction to source Because of the geometric.
The Arecibo Legacy Fast ALFA Drift Survey (ALFALFA/VAVA) and E-ALFA Data Processing Overview Overview Riccardo Giovanelli GALFA/Aug 2004.
Star Formation Efficiency and Environment Marianne T. Doyle *1, David J. Rohde 1, Michael J. Drinkwater 1, Mike Read 2, Baerbel S Koribalski 3 and The.
1 Software for the KEK test Malcolm Ellis 13 th April 2005.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Pat Morris, NHSC HIFI Mapping Processing in HIPE.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
Counting individual galaxies from deep mid-IR Spitzer surveys Giulia Rodighiero University of Padova Carlo Lari IRA Bologna Francesca Pozzi University.
GALFA Software Group GALFA-HI –Narrow-band spectral line data cubes of HI emission GALFA-RRL –Narrow-bad spectral line data cubes of recombination lines.
Observing Strategies at cm wavelengths Making good decisions Jessica Chapman Synthesis Workshop May 2003.
The ATNF Pulsar Data Archive Matthew Whiting (ATNF) Albert Teoh, David Smith, Lucyna Kedziora-Chudczer, Dick Manchester, Vince McIntyre 2nd Gravitational.
ASKAP: Setting the scene Max Voronkov ASKAP Computing 23 rd August 2010.
Robbie Auld1 Simulated HI Observations 4 th SKADS Workshop, Lisbon, 2-3 October 2008 Simulated HI observations Robbie Auld Cardiff University collaborating.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
The European Hubble Space Telescope Legacy Archive Wolfram Freudling.
1 Synthesis Imaging Workshop Sept 24-28, 2001, ATCA Narrabri Calibration & Flagging Mark Wieringa  Theory of calibration  Practice - RFI & malfunctions.
Bright & Dark Galaxies from the HIPASS Radio Survey Marianne T. Doyle *1, Michael J. Drinkwater 1, David J. Rohde 1, Mike Read 2, Baerbel S Koribalski.
Plan of the Talk What is AGES The AGES volume High density environments –Groups and clusters Low density environments –Galaxy pairs, isolated galaxies.
Foreground Contamination and the EoR Window Nithyanandan Thyagarajan N. Udaya Shankar Ravi Subrahmanyan (Raman Research Institute, Bangalore)
Data Organization Quality Assurance and Transformations.
EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.
NASSP Masters 5003F - Computational Astronomy Lecture 7 Confusion Dynamic range Resolved sources Selection biases Luminosity (and mass) functions.
HIFI Tutorial 1: Running the HIFI Pipelines and Adaptations A.P.Marston ESAC 27 June 2013.
1 1 CORNISH WORKSHOP Leeds, 13 th April 2007 James Green The Methanol Multibeam Project Project MMB.
1 Tracker Software Status M. Ellis MICE Collaboration Meeting 27 th June 2005.
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-403 (for Hipe 13.0) Level 1 to Level 2.5 processing: The Unimap pipeline Prepared.
MWA imaging and calibration – early science results
The Hubble Legacy Archive (HLA) Slitless Spectroscopy Project
Neutral Hydrogen in Galaxy Groups
MPIfR Results from the A. Chippendale ATUC, 14 Nov 2016
Data Reduction and Analysis Techniques
Data Reduction and Analysis Techniques
HERA Imaging and Closure
Presentation transcript:

Software for Deep Survey How useful are tools developed for HIPASS for ALFA surveys? HIPASS members in DEEP working group Software not specific to DEEP survey Initial assessment by Martin Zwaan Wolfram Freudling

Tools developed for HIPASS Livedata: On-line/off-line processing software removes bandpass calibrates the spectra applies doppler tracking, smoothes and baselines the spectra has an excellent capability for visualising calibrated spectra Gridzilla: takes spectra from a collection of bandpass-calibrated measurement sets and writes a 3-plane cube Both are aips++ packages (Solaris/Linux, not Mac) See: for desciption of tasks Both were specifically designed for Parkes Multibeam, but could be easily modified to work for ALFA Viewgraphs prepared by Martin Zwaan (ESO)

Livedata GUI scheduler Bandpass calibration Multibeam reader Data monitor

Gridzilla GUI

On-line monitoring Monitor display  livedata Statistics tools  livedata RFI id & removal  /  (median filtering removes some RFI) NVSS cross reference  1 beam bandpass  livedata 1 beam spectra  livedata Quick-look T-F maps  livedata Quick-look X-Y maps  (maps made with gridzilla, not on-line)

Level I processing Bandpass subtraction  livedata Continuum subtraction  by LUTHER (fits and subtracts templates) Flux calibration  livedata Higher level RFI excision  Astrometry  (not an issue for HIPASS…) Gridding  gridzilla Level 1 CLEANing  (HIPASS sources unresolved so no deconvolution. Need to do this for ALFA) Level 1 spectra  livedata Level 1 maps & cubes  maps & cubes only level II Continuum catalogue in progress (David Barnes) (level II) Data validation process  livedata Level 1 access tools  livedata Level 1 documentation  see ATNF/HIPASS webpages Level 1 software export  Level 1 archive 

Level II processing Level II CLEANing  (is required for ALFA) Level II spectra  livedata Level II maps  gridzilla Level II cubes  gridzilla Data validation  livedata Level II archive  FITS cubes Level II access tools  Level II documentation  Level II software export  Portal to NVO the HIPASS catalogue is VO compliant, the cubes are not

Level III Data & Software Tasks Baseline fluctuations  livedata Noise characteristics  livedata Sidelobe “cleaning” schemes  livedata Object finding algorithms  peak flux/wavelet (see Meyer et al 2004) Template fitting ? Injection of fake sources  lesson from HIPASS: need MANY! (see Zwaan et al 2004) Extended vs. point sources  not a big issue for HIPASS (see M04) Detection documentation  M04 & Z04 Data validation process ? HI source catalogue  Survey simulator  why? ALFA simulator  Overlay tool  Drinkwater et al in prep Catalogue Xreference tool  ditto Toolkit documentation 

Level of effort to convert to ALFA “pskread”  “alfareader” –Converts data to glish format which can be continuously read Time dependent bandpass estimate, depends on observing strategy Cleaning RFI treatment Modify line spread function by clever smoothing (convolution)

Issues AIPS++ support? Date rate Parkes: 1024ch * 2pols * 13 beams every 5 sec= 26* 1 kByes/sec ALFA data rate: 8194 * 2pol * 7 beams ~ factor of 5 bigger than Parkes