Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE NEW USE for An old correlatoR Arpad Szomoru Joint Institute for VLBI in Europe.

Slides:

Advertisements

Similar presentations

Dominik Stoklosa Poznan Supercomputing and Networking Center, Supercomputing Department EGEE 2007 Budapest, Hungary, October 1-5 Workflow management in.

Advertisements

SCARIe: Realtime software correlation Nico Kruithof, Damien Marchal.

Dominik Stokłosa Pozna ń Supercomputing and Networking Center, Supercomputing Department INGRID 2008 Lacco Ameno, Island of Ischia, ITALY, April 9-11 Workflow.

Onsala Space Observatory Present status and technical directions of the EVN Michael Lindqvist Onsala Space Observatory, Sweden Arpad.

Project Partners Project Collaborators The Council for the Central Laboratory of the Research Councils Funded by EPSRC GR/T04465/01

Baseband Processing and SKA Simulations using Supercomputers: Enhancing Australia‘s radio astronomy facilities and its bid for the SKA Steven Tingay Swinburne.

7th US VLBI Technical Meeting at Haystack Observatory, November 3-4, 2009 Arecibo VLBI Report Arecibo VLBI Team: V. Arun, R. Ganesan, T. Ghosh, C. Salter.

First e-EVN Science and Future Astronomy projects via EXPReS Michael Garrett Joint Institute for VLBI in Europe e-VLBI Workshop, Sydney, 13 July 2005.

Arpad Szomoru Joint Institute for VLBI in Europe

Ongoing e-VLBI Developments with K5 VLBI System Hiroshi Takeuchi, Tetsuro Kondo, Yasuhiro Koyama, and Moritaka Kimura Kashima Space Research Center/NICT.

E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk Kevin Dudevoir Jason SooHoo MIT Haystack Observatory 24 March 2006 EVN TOG meeting.

VLBI Report LBA Operations & eVLBI Tasso Tzioumis ATNF May 2008.

E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk MIT Haystack Observatory 10 Jan 2006 IVS General Meeting Concepion, Chile.

Electronic Transmission of Very- Long Baseline Interferometry Data National Internet2 day, March 18, 2004 David LapsleyAlan Whitney MIT Haystack Observatory,

E-VLBI: Connecting the Global Array of Radio Telescopes through High-Speed Networks Participating U.S. organizations: MIT Haystack Observatory MIT Lincoln.

Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec Virtual Laboratory as a Remote.

Developments for real-time software correlation e-VLBI Y. Koyama, T. Kondo, M. Kimura, M. Sekido, M. Hirabaru, and M. Harai Kashima Space Research Center,

21 st Century VLBI Mike Garrett (JIVE) Astro-lunch, 16 April

E-VLBI at ≥ 1 Gbps -- “unlimited” networks? Tasso Tzioumis Australia Telescope National Facility (ATNF) 4 November 2008.

Internet2, Washington, 10 April 2003 eVLBI Research in the European VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands.

Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array New VLBA capabilities.

e-VLBI International Research Networking Needs Alan R. Whitney MIT Haystack Observatory.

AMPATH, FIU, Miami, 31 January 2003 eVLBI Research in the European VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands.

E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.

High Data Rate Transfer for HEP and VLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester Netwrokshop33 March 2005.

EVN-NREN meeting, Schiphol, , A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe.

High Rate Internet Data Transfer for eVLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester All Hands Sept 2005.

VLBI/eVLBI with the 305-m Arecibo Radio Telescope Chris Salter Tapasi Ghosh Emmanuel Momjian Arun Venkataraman Jon Hagen.

EVLBI and the Australian SKA Pathfinder (ASKAP) Prof. Steven Tingay Curtin University of Technology Perth, Australia 7th eVLBI workshop SHAO, 2008 June.

E-VLBI: Creating a Global Radio Telescope via High-Speed Networks Alan R. Whitney MIT Haystack Observatory SLAC Data Management Workshop 17 March 2004.

Nov 3, 2009 RN - 1 Jet Propulsion Laboratory California Institute of Technology Current Developments for VLBI Data Acquisition Equipment at JPL Robert.

Research Networks and Astronomy Richard Schilizzi Joint Institute for VLBI in Europe

4th e-VLBI workshop, Sydney, July 2005, A. Szomoru, JIVE e-VLBI and EXPReS Arpad Szomoru.

Arecibo (JIVE/EXPReS +) Presented by : Tapasi Ghosh Other active players: Arun Venkataraman, Chris Salter, & Emmanuel Momjian. A brief history.

2006 AUSAC Meeting VLBI/eVLBI with the 305-m Arecibo Radio Telescope Arecibo VLBI Group Chris Salter Tapasi Ghosh Emmanuel Momjian Arun Venkataraman (Jon.

E-VLBI FP6 Proposal. Outline Background The Call Content of Proposal & Aim Possible Participants Overall preparation plan.

● Radio telescope arrays – km diameter – Resolution arcmin to micro-arcsec at radio wavelengths ● Similar (baseline/ wavelength) for other regimes.

Connect. Communicate. Collaborate GÉANT2 User Support for eVLBI John Chevers, Project Manager, DANTE Forskningsnet Konference 2005 Middelfart, Denmark.

An FX software correlator for VLBI Adam Deller Swinburne University Australia Telescope National Facility (ATNF)

76-m Lovell Telescope Jodrell Bank, UK Even big telescopes see no more detail than the naked eye High bandwidth data transfer - the future of European.

IVS General Meeting, Feb 2004, Ottawa eVLBI Research in the European VLBI Network Steve Parsley JIVE

Large Area Surveys - I Large area surveys can answer fundamental questions about the distribution of gas in galaxy clusters, how gas cycles in and out.

Westerbork Netherlands Dedicated Gbit link Onsala Sweden Gbit link Jodrell Bank UK Dwingeloo DWDM link Cambridge UK MERLIN Medicina Italy Chalmers University.

Review of developments in Australasia and mainland Asia Steven Tingay Swinburne University of Technology Next Generation correlator meeting, JIVE 27 -

A real-time software backend for the GMRT : towards hybrid backends CASPER meeting Capetown 30th September 2009 Collaborators : Jayanta Roy (NCRA) Yashwant.

EURO-VO: GRID and VO Lofar Information System Design OmegaCEN Kapteyn Institute TARGET- Computing Center University Groningen Garching, 10 April 2008 Lofar.

E. Momjian, T. Ghosh, C. Salter, & A. Venkataraman (NAIC-Arecibo Observatory) eVLBI with the 305 m Arecibo Radio Telescope ABSTRACT Using the newly acquired.

1 eVLBI Developments at Jodrell Bank Observatory Ralph Spencer, Richard Hughes- Jones, Simon Casey, Paul Burgess, The University of Manchester.

TOG, Yebes, November 2007, A. Szomoru, JIVE Arpad Szomoru, JIVE EXPReS progress, Mark5 and e-VLBI.

5 th e-VLBI Workshop, Haystack Observatory, September 2006, A. Szomoru, JIVE e-VLBI Developments at JIVE Arpad Szomoru.

SA1: second year overview Arpad Szomoru JIVE January 30EXPReS Board Meeting, Utrecht, the Netherlands: SA1Slide #2 Outline Accomplishments in 2007.

PRESENTATION DATEEXPReS- TITLE OF YOUR PRESENTATIONSlide #1 What is EXPReS? EXPReS = Express Production Real-time e-VLBI Service Three year project (March.

Coordinator’s report Huib van Langevelde EXPReS board Utrecht, 30 January, 2008.

NEXPReS Period 3 Overview WP5 Cloud Correlation Arpad Szomoru, JIVE.

8 th EVN Symposium, Torun, September 2006, A. Szomoru, JIVE Recent e-EVN Developments Arpad Szomoru.

TOG, Torun, April 2009 Arpad Szomoru, JIVE EVN/JIVE Technical developments.

SPIE, Orlando, May 2006, A. Szomoru, JIVE VLBI in Transition Arpad Szomoru Joint Institute for VLBI in Europe.

EInfrastructures: Usage Policy Mike Garrett Joint Institute for VLBI in Europe (JIVE, Dwingeloo, The Netherlands) eInfrastructure meeting, Dublin, April.

E-VLBI – Creating a Global Radio-Telescope Array via High-Speed Networks Alan R. Whitney MIT Haystack Observatory Optical Waves: Who Needs Them and Why?

What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo.

SA1: Production e-VLBI service Previous 12 Month Overview Arpad Szomoru JIVE EXPReS is made possible through the support of the European Commission (DG-INFSO),

TOG, Dwingeloo, March 2006, A. Szomoru, JIVE Status of JIVE Arpad Szomoru.

EVLBI MPIfR,Bonn A. Roy, W. Alef, D. Graham, A. Oberreuter

SA1: technical progress

SA1: overview, first results

e-VLBI: Creating a Global Radio Telescope via High-Speed Networks

SA1: Production e-VLBI service

e-EVN: practical considerations

SA1: third year overview

The Uniboard FPGA Processing for Astronomy

Presentation transcript:

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE NEW USE for An old correlatoR Arpad Szomoru Joint Institute for VLBI in Europe

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Mark IV EVN Correlator Developed by international consortium: EVN institutes, MIT Officially inaugurated October 1998 Comparable correlators in use at Haystack Obs., US Naval Obs., MPIfR, JIVE Correlator boards in use at WSRT, SMA

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Basic specifications Input: No. of telescopes (N) 16 Array Observing frequencies: 329 MHz – 22 GHz Data bandwidth: 128 MHz per polarization (Right and Left-hand circular), divided into 8 bands. Channel bandwidths 0.5 MHz to 16 MHz. Data input rate: 1 Gbps per telescope Output: Integration time 1/4s (will become 1/32s with PCInt) 2048 spectral channels per baseline/band/polarization Data Output rate 6 MB/s (will become 80 MB/s with PCInt)

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE

Field of View limitation Limited by t int Time smearing Shorter integrations Enable wide field surveys Study μJy sources Discriminate AGNs But, enormous increase of output data volume..  VLBI FoV x arcmin [FWHP] Effelsberg beam

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE EVN MkIV Correlator limits Integration time Cycle time of 0.015s (actually, 1/64th of a second) Spectral resolution complex lags per readout = spectral points per readout Divided over 32 products leads to 2048 spectral channels per product PCINT: Short for Post Correlator Integrator Capture the full output of the EVN MkIV correlator to disk Need to replace output datapath

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE The PCInt project High speed readout of the correlator was already prepared Via DSP powered serial port Need hardware and software to enable this Receiving end of serial port Gbit ethernet for transfer from correlator rack to data collection host Fast disk subsystem in order to support 160MByte/s (parallel RAID arrays in a Storage Area Network) Harro Verkouter

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Current situation CCC EEE (xk) DDD (xn) Switch FC Switch Correlator Board (x8) Raid Array (xm) RT System Ethernet Card C40 COMM VMEHigh Speed Serial SBC (x2) Correlator rack (x4) PCI 100TX 1000FX (x8) Fibre Channel

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Phase 0 CCC EEE (xk) DDD (xn) Switch FC Switch Correlator Board (x8) Raid Array (xm) RT System VME High Speed Serial Correlator rack (x4) 100TX 1000FX (x8) Fibre Channel Ethernet Card C40 COMM SBC (x2) PCI

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Phase 1 CCC EEE (xk) DDD (xn) Switch FC Switch Correlator Board (x8) Raid Array (xm) RT System VME High Speed Serial Correlator rack (x4) 100TX 1000FX (x8) Fibre Channel Ethernet Card C40 COMM SBC (x2) PCI

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Phase 2 CCC EEE (xk) DDD (xn) Switch Correlator Board (x8) Raid Array (xn) RT System VME High Speed Serial Correlator rack (x4) 100TX 1000FX (x8) 1000TX Ethernet Card C40 COMM SBC (x2) PCI

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Post-processing issues Huge data volumes equals 560GBytes of data Use a cluster of nodes Need automated processing Use a processing pipeline Achieved 1/16s sampling, at 24 MB/s data output Users seem to be ready for 800 GB data-sets …

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Price recording media ($/GB)

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Data Acquisition Move from tape to disk recording Reliability Cost Bandwidth Efficiency e-VLBI: the next step No consumables Higher bandwidth Fast turn-around ToO support Disk based recording e-VLBI using fiber

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Why e-VLBI ? Reliability – real-time feedback to the telescopes Logistics – No media management Sensitivity – sustained data rates >> 1 Gbps possible… Rapid science results: Geodesy (Earth rotation rate) Precision spacecraft navigation Transient phenomena… GRBs, SNe etc.

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Why e-VLBI (cont) ? Target of Opportunity (ToO) capability: Dominated by VLBA currently… Reliability & Logistics  e-VLBI Sensitivity  e-VLBI Rapid science  e-VLBI Rapid publication  e-VLBI Optimal observing strategy (obs. freq., calibrators, telescope array) LOFAR Transients etc.  ToOs may become much more common  e-VLBI.

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE e-VLBI Proof-of-Concept Project DANTE/GÉANT Pan-European Network SURFnetDutch NREN GARR Italian NREN UKERNAUK NREN PSNC Polish NREN DFN German NREN KTHNOC/NORDUnet Nordic NREN Manchester UniversityNetwork application software JIVEEVN Correlator Westerbork telescopeNetherlands Onsala Space Observatory Sweden MROFinland MPIfRGermany Jodrell Bank UK TCfAPoland CNR IRA Italy

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE 0 SISI GRGR CZCZ IEIE LULU EEEE SKSK ILIL LTLTCYCY ESES HUHU ITIT FRFR UKUK BEBE NLNL DEDE SESE CHCH PTPT ATAT GEANT GEANT 2.5 G 1.2 G 622M 155 M BGBG LVLV RORO HRHR PLPL 45 M 34 M 310 M GÉANT: Access of NRENs to GÉANT EVN telescope

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE POC results Demonstration of feasibility Identification of problems Has led to closer ties with networking community and generated political interest Has laid the foundation for the next step forward (EXPReS): I3 proposal to the EC (Communication & Network Development Call) Ranked first out of 43 proposals; nearly fully funded to an amount of 3.9 MEuro.

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE EXPReS – major aims: Making e-VLBI an operational astronomical instrument: 16 telescopes connected to JIVE at 1 Gbps Robust real-time e-VLBI operations Transparent inclusion of e-MERLIN antennas within e-EVN Target of Opportunity Capability Future developments in e-VLBI >> 1 Gbps data transfer rates, extended LOFAR etc. distributed software correlation.

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE

Expanding the e-VLBI Network

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Network testing Use existing protocols on currently available hardware TCP maximal reliability Not really required Sensitive to congestion Lot of fine-tuning necessary And possible UDP connectionless Unaccountable Tailor made protocols? Lambda switching Internet weather Hard to quantify Hard to pinpoint bottlenecks

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE February 2005: network transfer test (BWCTL) employing various network monitoring tools involving Jb, Cm, On, Tr, Bologna and JIVE Network testing (2)

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE

First real-time eVLBI Image, 3 telescope observation of gravitational lens, May 2004 First eVLBI science observation, OH masers around IRC10420, Richards et al, Oct 2004 First broadband eVLBI science, detection of the Hypernova SN2001em, Paragi et al, astro-ph/

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE First open e-EVN Call for Proposals (March 2006) First Target of Opportunity Observations (May 2006, Cygnus X-3), Tudose et al. (in prep)…

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Current status Regular science runs at 128 Mbps with 6 European stations (24 hours) Arecibo sometimes participates at 32 Mbps Fringes from all European stations at 256 Mbps have been demonstrated, and, on single baselines, 512 Mbps

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Issues, Developments Convincing a correlator designed for tape technology to become real-time.. Operational improvements: Robustness Reliability Speed Ease Bandwidth Station feedback

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Ongoing New control computers (Solaris AMD servers) Cut down on (re-)start time Powerful code development platform Tightening up of existing code Other hardware upgrades: Upgrade existing connectivity from 6*1 Gbps to 16*1 Gbps (lightpaths) SX optics (fibres + NICs) Replacement of SU functionality: Mark5A→B: motherboards, memory, power supplies, serial links.

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE Conclusions e-VLBI is changing the nature of VLBI Fast response, ToO capability better quality control, rapid data delivery New science, higher bandwidths Large fields of view Will allow the study of μJy sources Or many masers over a large star formation region Data archive will contain millions of weak sources EXPReS will realize an operational e-VLBI network distributed across 1000’s km – a true pathfinder for SKA.