What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo.

Slides:



Advertisements
Similar presentations
1 Spiral 1 Requirements Demonstrate GENI Clearinghouse & control framework in Spiral 1 projects as a central GENI concept. Demonstrate End-to-end.
Advertisements

Dominik Stoklosa Poznan Supercomputing and Networking Center, Supercomputing Department EGEE 2007 Budapest, Hungary, October 1-5 Workflow management in.
SCARIe FABRIC A pilot study of distributed correlation Huib Jan van Langevelde Ruud Oerlemans Nico Kruithof Sergei Pogrebenko and many others…
Dominik Stokłosa Pozna ń Supercomputing and Networking Center, Supercomputing Department INGRID 2008 Lacco Ameno, Island of Ischia, ITALY, April 9-11 Workflow.
Huib Jan van Langevelde Joint Institute for VLBI in Europe, Dwingeloo NL radio-astronomy a telescope larger than Europe radio-astronomy a telescope larger.
Progress With iBOBs at Jodrell Bits & Bytes Meeting, JBO, th Dec 2007 Jonathan Hargreaves Electronic Engineer, Jodrell Bank Observatory.
High Performance Computing Course Notes Grid Computing.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
CSCD 433/533 Advanced Computer Networks Lecture 1 Course Overview Fall 2011.
CS 582 / CMPE 481 Distributed Systems Communications.
Task 3.5 Tests and Integration ( Wp3 kick-off meeting, Poznan, 29 th -30 th January 2002 Santiago González de la.
First e-EVN Science and Future Astronomy projects via EXPReS Michael Garrett Joint Institute for VLBI in Europe e-VLBI Workshop, Sydney, 13 July 2005.
Arpad Szomoru Joint Institute for VLBI in Europe
Router Architectures An overview of router architectures.
INTRUSION DETECTION SYSTEMS Tristan Walters Rayce West.
Router Architectures An overview of router architectures.
E-VLBI Development at Haystack Observatory 5 th Annual e-VLBI Workshop Haystack Observatory 20 September 2006 Alan R. Whitney Kevin Dudevoir Chester Ruszczyk.
1.  Project Goals.  Project System Overview.  System Architecture.  Data Flow.  System Inputs.  System Outputs.  Rates.  Real Time Performance.
Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture.
Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec Virtual Laboratory as a Remote.
High Data Rate Transfer for HEP and VLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester Netwrokshop33 March 2005.
EVN-NREN meeting, Schiphol, , A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe.
VLBI Storage Manager (VSM) Matteo Stagni – Mauro Nanni 0.
Research Networks and Astronomy Richard Schilizzi Joint Institute for VLBI in Europe
Introduction VLBI_UDP is an application being developed to transfer VLBI data using the UDP protocol. Initially developed by Richard Hughes- Jones for.
Management of the LHCb DAQ Network Guoming Liu * †, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.
BalticGrid-II Project BalticGrid-II Kick-off Meeting, , Vilnius1 Joint Research Activity Enhanced Application Services on Sustainable e-Infrastructure.
E-VLBI FP6 Proposal. Outline Background The Call Content of Proposal & Aim Possible Participants Overall preparation plan.
BalticGrid-II Project The Second BalticGrid-II All-Hands Meeting, Riga, May, Joint Research Activity Enhanced Application Services on Sustainable.
● Radio telescope arrays – km diameter – Resolution arcmin to micro-arcsec at radio wavelengths ● Similar (baseline/ wavelength) for other regimes.
An FX software correlator for VLBI Adam Deller Swinburne University Australia Telescope National Facility (ATNF)
Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE.
76-m Lovell Telescope Jodrell Bank, UK Even big telescopes see no more detail than the naked eye High bandwidth data transfer - the future of European.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Westerbork Netherlands Dedicated Gbit link Onsala Sweden Gbit link Jodrell Bank UK Dwingeloo DWDM link Cambridge UK MERLIN Medicina Italy Chalmers University.
EC Review – 01/03/2002 – WP9 – Earth Observation Applications – n° 1 WP9 Earth Observation Applications 1st Annual Review Report to the EU ESA, KNMI, IPSL,
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
1 eVLBI Developments at Jodrell Bank Observatory Ralph Spencer, Richard Hughes- Jones, Simon Casey, Paul Burgess, The University of Manchester.
Netherlands Institute for Radio Astronomy Big Data Radio Astronomy A VRC for SKA and its pathfinders Hanno Holties March 28 th 2012.
Master Correlator Control Computer (MCCC) Requirements & Status Sonja Vrcic Socorro, December 12, 2007.
NEXPReS Period 3 Overview WP8 FlexBuff High-Bandwidth, High-Capacity Networked Storage Ari Mujunen Aalto University Metsähovi Radio Observatory Finland.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
WP8: FlexBuff Ari Mujunen, Tomi Salminen Aalto University Metsähovi Radio Observatory NEXPReS 2nd Board Meeting – 2012 June 20 – NORDUnet, Copenhagen Denmark.
CSCD 433/533 Advanced Computer Networks Lecture 1 Course Overview Spring 2016.
PRESENTATION DATEEXPReS- TITLE OF YOUR PRESENTATIONSlide #1 What is EXPReS? EXPReS = Express Production Real-time e-VLBI Service Three year project (March.
Coordinator’s report Huib van Langevelde EXPReS board Utrecht, 30 January, 2008.
Broadband Interfacing eMerlin-JIVE (1-10Gbps) Onsala-Jodrell Bank (
Introduction to Fabric Kiwi Team PSNC. E-VLBI system – general idea.
EXPReS FABRIC meeting at Poznan, Poland1 EXPReS FABRIC WP 2.2 Correlator Engine Meeting Poznan Poland JIVE, Ruud Oerlemans.
WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC.
SPIE, Orlando, May 2006, A. Szomoru, JIVE VLBI in Transition Arpad Szomoru Joint Institute for VLBI in Europe.
Title FABRIC Progress - Mark, Huib etc. T. Charles Yun Project Manager EXPReS/JIVE.
Presentation Title Presentation subtitle Your name Your title, organisation.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
Distributed Correlation in Fabric Kiwi Team PSNC.
TOG, Dwingeloo, March 2006, A. Szomoru, JIVE Status of JIVE Arpad Szomoru.
EVLBI MPIfR,Bonn A. Roy, W. Alef, D. Graham, A. Oberreuter
Progress on EXPReS at JBO
SA1: overview, first results
Overview of 4Gbps connectivity for Nordic-MERLIN fringe tests
Broadband Tests John Conway FABRIC F2F-2 Poznan, Sept 25th 2006
EXPReS, NEXPReS, UniBoard
Grid Computing.
EXPReS Annual Review April 17
University of Technology
Bryan Butler (for Bill Sahr)
SA1: third year overview
Progress on EXPreS at JBO Ralph Spencer
User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.
Presentation transcript:

What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo

huib 30/10/06 2/10EXPReS kick-off October EXPreS::FABRIC Future Arrays of Broadband Radio-telescopes on Internet Computing JRA (Joint Research Activity), looking at the future of eVLBI R+D project, deliver documents, prototypes, test reports A work-package on 4Gb/s data acquisition and transport A work-package on distributed correlation For a total of 29 man years 14.5 man year contributed by the EC 1253 k€ over 3 years 7 participating institutes: Jodrell Bank, protocols and interfacing to eMERLIN network Metsahovi, next generation data acquisition Onsala, testing high speed connectivity MPI Bonn, integrating with operational VLBI systems ASTRON/LOFAR, interfacing of E-LOFAR JIVE, algorithm and correlator cores software PSNC Poznan, Grid methods and virtual Lab for radio-astronomy

huib 30/10/06 3/10EXPReS kick-off October Part 1: Scalable connectivity 1.1. Data Acquisition Data acquisition architecture (MRO) Scalable data acquisition system, off-the-shelf components new version of PC-EVN? Data acquisition prototype (MRO) Prototype for 4Gb/s? Data acquisition control (MPI) Control data acquisition, interface for protocol, distributed computing 1.2. Broadband Data path Broadband protocols (JBO) IP protocols, lambda switching, multicasting Broadband data processor interface (JBO) Data from public network to eMERLIN correlator Integrate and test (OSO) 10 Gb/s test environment for OSO-eMERLIN (and LOFAR?) Public to dedicated interface (ASTRON) LOFAR transport over public network, LO & timing

huib 30/10/06 4/10EXPReS kick-off October Part 2: Distributed correlation 2.1. Grid resource allocation (PSNC) Grid VLBI collaboration Establish relevant tools for eVLBI Grid workflow management Tool to allocate correlator resources and schedule correlation Grid routing Data flow from telescopes to appropriate correlator resources 2.2. Software correlation (JIVE) correlator algorithm design High precision correlation on standard computing Correlator computational core Scaled up version for clusters Distributed version, middleware Deploy on Grid computing Interactive visualization Output definition Output data from individual correlators Output merge Collect data in EVN archive

huib 30/10/06 5/10EXPReS kick-off October Work on broadband acquisition Reaching consensus to work with iBOB’s and 10GbE considered options with Mk5 and PC-EVN XilinX FPGA with 2 10Gb Ethernet Also at heart of Haystacks DBE Also for eMERLIN ⇔ VLBI interface Trying to put an order in… May delay the development Continuous work on protocols Mostly carried out at Jodrell Reports available on wiki Tied to connecting outside to MERLIN and MERLIN to outside Similar questions for E-LOFAR

huib 30/10/06 6/10EXPReS kick-off October month demo October 20 between On and Jb Data recorded on PC-EVN locally Some issues at Jb at 512 Mb/s Due to wrong buffer setting Transfer to JIVE after recording Tsunami reached 800Mb/s Hick-ups in copy to Mk5, now OK Also included streaming to Metsahovi has 2.5 Gb/s connection and parallel data capturing machines Transfer OK for 2 x 512 Mb/s Actually a useful exercise Not only to secure the money, milestone on request Exercise different protocols in future tests Learning experience for people new to the projecy

huib 30/10/06 7/10EXPReS kick-off October

huib 30/10/06 8/10EXPReS kick-off October Distributed correlation Get CPU cycles from the Grid Explore software correlation Better accuracy and flexibility Portable, Grid friendly code Use net as crossbar switch a-synchronous correlation Seek boundaries of the Grid “Real time” applications data transfer limitations Demo application: Monitoring EVN network Continuous small eVLBI network Monitoring transient sources Astrometry, spectral line sources spacecraft navigation pulsar gating

huib 30/10/06 9/10EXPReS kick-off October Progress and previous experience Virtual Lab developed at Poznan ftp VLBI EVN monitor Comparison software and hardware correlation High accuracy Huygens detections

huib 30/10/06 10/10EXPReS kick-off October Progress seems fair Project ramping up to satisfactory pace Had kick-off meeting in March (Dwingeloo) And progress meeting in September (Poznan) Have approximately 4 new people employed And 2 more coming December 1 Means a late start in various places Still need to complete design phase To clear up work packages for all parties And order these iBOB’s Already passing milestones Design documents, Demo’s, Software