Anita Richards and members of MERLIN, RadioNet and AstroGrid teams. ● 'Old' radio archive access ● Source lists, fixed images or visibility data ● Most.

Slides:



Advertisements
Similar presentations
VODA - A Sampo Project Johan Lindroos – CSC Scientific Computing Ltd, Finland Pekka Järveläinen – CSC Scientific Computing Ltd, Finland Richard Hook -
Advertisements

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
JWST IFUs and Data Tool Development Plans Tracy Beck JWST NIRSpec Instrument Scientist.
Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.
Image Analysis Jim Lovell ATNF Synthesis Imaging Workshop May 2003.
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
ALMA Proposal Preparation and Submission Eelco van Kampen European ALMA Regional Centre (ESO, Garching) Thanks to Liz Humphrys, Andy Biggs and Paola Andreani.
GAUDI Ground-based Asteroseismology Uniform Database Interface E. Solano Bases de données en spectroscopie stellaire. Paris.
Binding applications with PLASTIC John Taylor Institute for Astronomy, Edinburgh / AstroGrid Topcat Astr oSco pe Plastic.
Platform for Astronomy Tool InterCommunication John Taylor.
ALMA Proposal Preparation and Submission Liz Humphreys European ALMA Regional Centre ESO, Garching Thanks to Andy Biggs, Paola Andreani, Eelco van Kampen.
Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.
VO & Astro-Wise & others A.Belikov OmegaCEN
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Tero Oittinen Sampo Team Department of Astronomy University of Helsinki,Finland Using ESO Reflex to access astronomical WebServices by The Sampo.
The AstroGrid Desktop Suite Release 2008 what it is what you can do short demo (wireless permitting...) NAM2008 Belfast Andy Lawrence April 2008.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
● VO Science ● Tools for ELT ● Data analysis ● Case preparation ● Multi-l comparisons ● Planet-hunting - ALMA, Spitzer ● Stellar populations - JWST, X-ray.
Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.
CRISP & SKA WP19 Status. Overview Staffing SKA Preconstruction phase Tiered Data Delivery Infrastructure Prototype deployment.
Lessons learned from cm-wave interferometry Interferometry analysis is less straightforward than single aperture analysis. Astronomers need ‘support’.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
EVLA Software Bryan Butler. 2007May22EVLA SAGE Meeting2 Requirements and Goals of EVLA Software Maximize scientific throughput of the instrument At a.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
Мulti-frequency VLA observations of M87. Observations’ parameters Test VLA observations (configuration D) of M87 (RA=12:28, Dec=12:40) took place on November.
● Radio telescope arrays – km diameter – Resolution arcmin to micro-arcsec at radio wavelengths ● Similar (baseline/ wavelength) for other regimes.
Radio Interferometers’ Data Archives how to find, retrieve, and image radio data: a lay-person’s primer Michael P Rupen (NRAO)
Observing Modes from a Software viewpoint Robert Lucas and Philippe Salomé (SSR)
EOVSA Data and Database System J. McTiernan EOVSA CoDR 25-April-2011.
1 KFPA Critical Design Review – Fri., Jan. 30, 2009 KFPA Data Pipeline Bob Garwood- NRAO-CV.
Observing Strategies at cm wavelengths Making good decisions Jessica Chapman Synthesis Workshop May 2003.
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
A PPARC funded project Tony Linde Programme Manager AG-SAG FM5: AG2/VOTech Scope & Targets Glasgow, 7 Feb 2005 VOTech Project.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Pipeline Basics Jared Crossley NRAO NRAO. What is a data pipeline?  One or more programs that perform a task with reduced user interaction.  May be.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
AstroGrid Usability & Docs, JBO, 6 th Dec 2005 Jonathan Tedds Leicester University AstroGrid Usability & Documentation Usability –Documentation –Infrastructure.
ALMA and the Call for Early Science The Atacama Large (Sub)Millimeter Array (ALMA) is now under construction on the Chajnantor plain of the Chilean Andes.
E-MERLIN & EVLA P.J.DiamondP.J.Diamond MERLIN/VLBI National Facility Jodrell Bank Observatory University of Manchester MERLIN/VLBI National Facility Jodrell.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
The Large Synoptic Survey Telescope Project Bob Mann Wide-Field Astronomy Unit University of Edinburgh.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Evanthia Hatziminaoglou, ESO - Garching Virtual Observatory Info-Workshop, SOFIA January 2008 VO Tools Overview.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
EVLA Data Processing PDR Pipeline design Tim Cornwell, NRAO.
E-MERLIN & Radio issues Simon Garrington Wide-fields (ie ~10x10 arcmin) uJy sensitivity; mas resolution key science driver for e-MERLIN ~1500 sources.
SAGE meeting Socorro, May 22-23, 2007 WIDAR Correlator Overview Michael P. Rupen Project Scientist for WIDAR & Software.
Anita Richards and members of MERLIN, RadioNet and AstroGrid teams. ● 'Old' radio archive access ● Source lists, fixed images or visibility data ● Most.
AstroGrid and Virtual Observatories for Radio Interferometry arrays/ proposals Anita Richards Paul Harrison Noel Winstanley (Jodrell Bank Centre for Astrophysics,
The CORNISH data reduction pipeline. Architecture - Overview AIPS Tasks Obit Tasks ObitTalk / Python Control Scripts MySQL Database Book-keeping Raw Data.
RichardsAMS_AIDA_WP7_T7_T11 EuroV_ Tech Forum AMS Richards, University of Manchester (UEDIN) WP7 T7 Radio Cubes Bonnarel, Harrison, Richards,
4th Solar KSP Meeting Potsdam 2010 November 08
The CSIRO ASKAP Science Data Archive Progress and Plans
NRAO VLA Archive Survey
Observing Strategies for the Compact Array
EVLA Archive The EVLA Archive is the E2E Archive
Concluding Remarks Paolo Padovani Head, Virtual Observatory Project Office, ESO, Garching bei München, Germany & EURO-VO Facility Centre.
Gustaaf van Moorsel September 9, 2003
Registry Applications Data Model
Observing with Modern Observatories (the data flow)
Google Sky.
Rick Perley NRAO - Socorro
Presentation transcript:

Anita Richards and members of MERLIN, RadioNet and AstroGrid teams. ● 'Old' radio archive access ● Source lists, fixed images or visibility data ● Most maps only inner few arcsec, fixed resol n ● MERLIN archive on-demand imaging ● via AstroGrid, using ParselTongue ● Next-generation interferometry ● Archive development strategies ● VO requirements ● Enable all astronomers to use multi-l data On-demand radio imaging access to calibrated data for all astronomers

Flexible data products  GB – TB raw data per experiment (mins - weeks)  Visibility data Cal sources. antennas etc.  Domain-specific software  No unique product  Resolution v. sensitivity tradeoff by baseline weighting  3D/polarisation cubes, spectra, time series...  Field of view e.g. 8', image pixels 10 mas  Map out regions of interest, usually not all 10 9 pixels  Most PI results too varied to archive  Pipeline data for VOs  Quick Look static images  Flexible products to order  Raw data option rarely wanted if alternatives!

Interferometry visibility amplitude v. baseline length Calibrated, binned visibility amplitudes Quick-look image Data cube First Moment Data examples

IR from warm dust in remnant AGB shell (IRAS, ISO, 2MASS) Non-thermal nebular radiocontinuum (various - Vollmer catalogue) Hot stellar emission FUSE, IUE  Non-expert access pre  Major surveys e.g. FIRST  Ready-made FITS images Aladin  Catalogues: SpecFind

MERLIN 2005 Web forms: static images Calibrated visibility data  Visibilities live on disc, calibrated  Sample products  User version of pipeline  Still need AIPS

What's wrong with that?  Dedicated web site fine for PIs of major projects Able to use domain-specific projects Even PIs look at pipeline calibration/images first!  Not really friendly for non-experts  Not convenient for multi-wavelength  Can't be used easily in workflows  Need VO access  Single interface to many archives  Standard metadata  Static quick-look products  Flexible data products  ATCA prototype imager used VO model

2006 AstroGrid Workbench MERLINImager Simple inputs Name/ Pos (Size Resln Freq Date)

User AstroGrid Workbench Task Launcher MERLINImager Position, size, n, resol n, date Registry CEA JBO server Python (perl/dbi) ParselTongue Select AIPS data Image best 5 (calibration, fov) FITS images, logs, to public HTML area SIAP VOTable2006 AstroGrid Task RadioNet package MERLINImager MySpace Aladin, TopCat Download

 Start AIPS No  SPLIT with/out channel averaging (f.o.v. required)  Fix known polarization etc. bugs - heuristics  Reweight, set beam/pixel size  Run IMAGR incl. field centre  Run SUBIM if necessary  Save to disc/web area  Write metadata to Simple Image Access Protocol VOTable Using parselTongue

Interoperability (Plastic)  Matching resolution  Spectral index image 18 cm 6 cm Steep spectrum – SE not AGN HST 110,160, 220

Coming soon: M+VLA HDF(N) cutouts 1” 10 mJy contours + X-ray selected AGN2 1 < z < AGN Starburst with AGN core Starburst

Next Generation Interferometers  e-MERLIN, eVBLI, EVLA ATCA/LBA, LOFAR, GMRT, ALMA, SKA etc  Committed to VO access  Software development RadioNet – ParselTongue (Python over e.g. AIPS) NRAO – CASA (aips++ based, Python scripting). ESO – XML binary and metadata storage  'B2E' obs-to-archive integrated data path  Metadata retrieval  Flexible remote processing of products  VO components in archive management?  Cornish, GMRT, MMB and other surveys

Beginning-to-End (B2E) Science proposal Science products Schedule Quality control Basic irreversible correlation, calibration etc. Capture data and intentions Public access Standard calibration pipeline Steerable pipeline Processing history, metadata Archive Re-extraction recalibration etc Key projects Major surveys Standard products documented methods

Data model Mkn 18 cm Data model Mkn 18 cm

Development of VO access  Expand/apply VO standards  Spatial frequencies, polarization...  Tools for radio data (Jy/beam, 3+D cubes...)  Authentication  Expand data products/services available  Robustness  Visibility data, spectra, time series  Single-dish data  Image cutouts for Deep Fields  Solve queuing/overload and other problems  Impliment at other sites/other radio datasets

AstroGrid/RadioNet workshop  Radio data management Dec– Dec  Workshop for data providers/large surveys etc. Data flow using archives and pipelines  ParselTongue, Common Proposal Tool etc. Archive management Data delivery  Publishing data to VOs  Use and development of VO tools & standards  Science use Dec – Dec