The DiFX software correlator DiFX is an FX style correlator written in C++ Designed to run on commodity clusters Optimised Intel vector libraries are used.

Slides:



Advertisements
Similar presentations
David - Doppler He is known for the principle he proposed he first proposed in concerning the colored light of double stars in He hypothesized that.
Advertisements

NAIC-NRAO School on Single-Dish Radio Astronomy. Arecibo, July 2005
National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
Pulsars with LWA1 Paul S. Ray and Sean Cutchin Naval Research Laboratory 2012 July 26 Basic research in radio astronomy at NRL is supported by NRL/ONR.
Swift/BAT Hard X-ray Survey Preliminary results in Markwardt et al ' energy coded color.
The Transient Radio Sky to be Revealed by the SKA Jim Cordes Cornell University AAS Meeting Washington, DC 8 January 2002.
Transient Science with the Allen Telescope Array Geoff Bower Berkeley.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
1 CSE SUNY New Paltz Chapter Seven Exploiting Memory Hierarchy.
Ninth Synthesis Imaging Summer School Socorro, June 15-22, 2004 Cross Correlators Walter Brisken.
02/08/2015Regional Writing Centre2 02/08/2015Regional Writing Centre3.
Solar dynamic spectra C. Vocks and G. Mann 1. Spectrum of the quiet Sun: First results 2. How to obtain spectra: Beamformed data 3. Single station spectra.
CVN software correlator development and its applications Zheng Weimin*, Zhang Juan, Tong Li, Tong Fengxian, Liu Lei, Chen Zhong, Shu Fengchun, Wang Guangli.
C. ChandlerEVLA Advisory Committee Meeting September 6-7, Scientific Commissioning Plan Claire Chandler.
DiFX: Software Correlation at Swinburne for the LBA Adam Deller Swinburne University/CSIRO Australia Telescope National Facility Supervisors: A/Prof Steven.
Data Acquisition  From receivers to correlator  Data Acquisition System  Recorder  Station Unit – DAS2  Correlator  Key Features:  Digital, KISS.
Basic concepts of radio interferometric (VLBI) observations Hiroshi Imai Department of Physics and Astronomy Graduate School of Science and Engineering.
21 st Century VLBI Mike Garrett (JIVE) Astro-lunch, 16 April
Solar observation modes: Commissioning and operational C. Vocks and G. Mann 1. Spectrometer and imaging modes 2. Commissioning proposals 3. Operational.
LBA Calibrator Survey Chris Phillips eVLBI Project Scientist 23 July 2009.
Cosmic magnetism ( KSP of the SKA) understand the origin and evolution of magnetism in the Galaxy, extragalactic objects, clusters and inter-galactic/-cluster.
Wideband Imaging and Measurements ASTRONOMY AND SPACE SCIENCE Jamie Stevens | ATCA Senior Systems Scientist / ATCA Lead Scientist 2 October 2014.
B19-Describe how light is absorbed, reflected, and refracted by different surfaces.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array New VLBA capabilities.
Andreas Horneffer Status of MKSP LOFAR Observations.
Which dipoles to use to optimize survey speed? –What tapering? –Trade-off between sensitivity, FOV and low side-lobe levels –Station beam stability, pointing.
The Expanded Very Large Array: Phase I Science and Technical Requirements Rick Perley NRAO - Socorro.
Pulsar Timing and Galaxy Evolution Sarah Burke Swinburne University/ATNF ATNF GW Mtg December 12, 2008 Sarah Burke Swinburne University/ATNF ATNF GW Mtg.
SpaceWire Plug-and-Play: A Roadmap Peter Mendham, Albert Ferrer Florit, Steve Parkes Space Technology Centre, University of Dundee 1.
Designing Experiments T. Venturi Istituto di Radioastronomia, Bologna, INAF ERIS, Manchester, 9 September 2005.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Software correlators.
1 The VLBA and Fermi Dave Thompson NASA GSFC Fermi Large Area Telescope Multiwavelength Coordinator Julie McEnery NASA GSFC Fermi Project Scientist VLBA.
The ALMA Observation Support Tool Adam Avison UK ALMA Regional Centre Node.
DiFX Performance Testing Chris Phillips eVLBI Project Scientist 25 June 2009.
ASKAP Capabilities John Reynolds on behalf of the SEIC and ASKAP team.
GALFA Software Group GALFA-HI –Narrow-band spectral line data cubes of HI emission GALFA-RRL –Narrow-bad spectral line data cubes of recombination lines.
Pulsar surveys at Arecibo and Green Bank David Champion Gravity Wave Meeting, Marsfield, Dec 2007.
An FX software correlator for VLBI Adam Deller Swinburne University Australia Telescope National Facility (ATNF)
Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE.
Sanjay BhatnagarEVLA Advisory Committee Meeting May 8-9, EVLA Algorithm Research & Development Progress & Plans Sanjay Bhatnagar CASA/EVLA.
GSB : A real-time Software back-end for the GMRT Jayanta Roy National Centre for Radio Astrophysics Pune, India 12 th December 2008 Collaborators.
HEPiX FNAL ‘02 25 th Oct 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 25 th October 2002 HEPiX 2002, FNAL.
Large Area Surveys - I Large area surveys can answer fundamental questions about the distribution of gas in galaxy clusters, how gas cycles in and out.
THE CHEMICAL INVENTORY OF INTERSTELLAR CLOUDS J. M. Hollis (NASA/GSFC), Anthony Remijan (NRAO), P.R. Jewell (NRAO), and F. J. Lovas (NIST) Propose GBT.
Tenth Synthesis Imaging Summer School UNM, June 13-20, 2006 Cross Correlators Walter Brisken.
Distributed FX software correlation Adam Deller Swinburne University/CSIRO Australia Telescope National Facility Supervisors: A/Prof Steven Tingay, Prof.
Rick Perley 2 Nov 2001 EVLA Correlator Conceptual Design Review 1 Science Drivers for the EVLA Correlator Rick Perley EVLA Project Scientist 2 Nov 2001.
A Global 86 GHz VLBI Survey of Compact Radio Sources Sang-Sung Lee MPIfR In collaboration with A.P. Lobanov, T.P. Krichbaum, A. Witzel, J.A. Zensus (MPIfR,
Review of developments in Australasia and mainland Asia Steven Tingay Swinburne University of Technology Next Generation correlator meeting, JIVE 27 -
A real-time software backend for the GMRT : towards hybrid backends CASPER meeting Capetown 30th September 2009 Collaborators : Jayanta Roy (NCRA) Yashwant.
Swift as a Rapid Wide Field Follow-up Instrument John Nousek & Jamie Kennea Penn State University Phil Evans University of Leicester International Workshop.
ATCA GPU Correlator Strawman Design ASTRONOMY AND SPACE SCIENCE Chris Phillips | LBA Lead Scientist 17 November 2015.
Building Your Own Number Line. Step 1: Fold your strip in half.
1 1 CORNISH WORKSHOP Leeds, 13 th April 2007 James Green The Methanol Multibeam Project Project MMB.
Observations with AMBER  General overview  P2VM  OB preparation with P2PP P2PP / OB / templates Available templates for observation procedure Typical.
COLORCOLOR. The Color Spectrum The spread of colors from white light when passed through a prism or diffraction grating. –Red, Orange, Yellow, Green,
Mesh Refinement: Aiding Research in Synthetic Jet Actuation By: Brian Cowley.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array The Very Long Baseline.
VGOS GPU Based Software Correlator Design Igor Surkis, Voytsekh Ken, Vladimir Mishin, Nadezhda Mishina, Yana Kurdubova, Violet Shantyr, Vladimir Zimovsky.
SAGE meeting Socorro, May 22-23, 2007 WIDAR Correlator Overview Michael P. Rupen Project Scientist for WIDAR & Software.
Korea Astronomy and Space Science Institute
EVLA Availability - or - When Can I Use It?
Architecture & Organization 1
JIVE UniBoard Correlator (JUC) Firmware
Architecture & Organization 1
Vector accelerator array in constrained memory bandwidth
Some Illustrative Use Cases
Wide-field, high sensitivity VLBI
EVLA Algorithm Research & Development
Rick Perley NRAO - Socorro
Presentation transcript:

The DiFX software correlator DiFX is an FX style correlator written in C++ Designed to run on commodity clusters Optimised Intel vector libraries are used for good performance Makes hard-to-reach areas of correlator parameter space accessible Now used by LBA, VLBA and (soon) AuScope, MPIfR (Bonn)

DiFX at the VLBA Acceptance testing is all but complete - correlator switchover by end of year (call for proposals already made in October) Investment has been modest: 10 node cluster costing ~$25,000 enables throughput of ~500 Mbps/antenna for 10 stations (roughly double the hardware correlator)

VLBA DiFX verification Visibility phase vs time: Colors are a little hard to see: blue is HWC, purple is SWC, cyan is where they overlap perfectly

New VLBA functionality: now Much increased spectral and temporal resolution: in principle almost infinite, in practice at least 16x previous is offered Much more flexible pulsar processing; previously only an on/off gate available Ability to process data in previously inaccessible formats (like the higher datarate Mark5B/B+)

Future features: Multiple PCs At any given instant, the phase centre (PC) of correlation can be changed by rotating the visibilities by a phase value equal to the sky frequency x  delay (between desired phase centre and current phase centre) When done in-correlator, very high spectral and temporal resolution means almost no smearing primary beam uv-shifted “pencil” fields

Future features: Multiple PCs At low frequencies (and high sensitivity) there will be many sources per primary beam Thus a dramatic improvement in survey speed! Applications in in-beam calibrator searches, star-formation regions, galaxy evolution studies and more