Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE.

Slides:

Advertisements

Similar presentations

SCARIe: Realtime software correlation Nico Kruithof, Damien Marchal.

Advertisements

SCARIe FABRIC A pilot study of distributed correlation Huib Jan van Langevelde Ruud Oerlemans Nico Kruithof Sergei Pogrebenko and many others…

Introduction to Grid Application On-Boarding Nick Werstiuk

Digital FX Correlator Nimish Sane Center for Solar-Terrestrial Research New Jersey Institute of Technology, Newark, NJ EOVSA Technical Design Meeting.

E-VLBI progress in the South Tasso Tzioumis ATNF, CSIRO September 2006 “Towards e-VLBI”  “e-VLBI”

Shanghai Astronomical Observatory 2009 East Asia VLBI Workshop1 A few Astronomical Observations of CVN Wang Weihua Shanghai Astronomical Observatory.

MotoHawk Training Model-Based Design of Embedded Systems.

June 22-23, 2005 Technology Infusion Team Committee1 High Performance Parallel Lucene search (for an OAI federation) K. Maly, and M. Zubair Department.

CHEP 2015 Analysis of CERN Computing Infrastructure and Monitoring Data Christian Nieke, CERN IT / Technische Universität Braunschweig On behalf of the.

Ongoing e-VLBI Developments with K5 VLBI System Hiroshi Takeuchi, Tetsuro Kondo, Yasuhiro Koyama, and Moritaka Kimura Kashima Space Research Center/NICT.

Numerical Grid Computations with the OPeNDAP Back End Server (BES)

CVN software correlator development and its applications Zheng Weimin*, Zhang Juan, Tong Li, Tong Fengxian, Liu Lei, Chen Zhong, Shu Fengchun, Wang Guangli.

Developments for real-time software correlation e-VLBI Y. Koyama, T. Kondo, M. Kimura, M. Sekido, M. Hirabaru, and M. Harai Kashima Space Research Center,

f ACT s  Data intensive applications with Petabytes of data  Web pages billion web pages x 20KB = 400+ terabytes  One computer can read

Monte Carlo Instrument Simulation Activity at ISIS Dickon Champion, ISIS Facility.

Kondo, T. *1*2 and T. Hobiger *2 Kondo, T. *1*2.

Distributed Monte Carlo Instrument Simulations at ISIS Tom Griffin, ISIS Facility & University of Manchester.

Hirabaru, Koyama, and Kimura NICT APAN NOC Meeting January 20, 2005 e-VLBI updates.

Real Time Correlator in FPGA Xu ZhiJun, Zhang XiuZhong Shanghai Astronomical Observatory China 4 th IVS General Meeting January 9, 2006.

Pre-OTS Testing in Penticton Sonja Vrcic Socorro, December 11, 2007.

Soil moisture generation at ECMWF Gisela Seuffert and Pedro Viterbo European Centre for Medium Range Weather Forecasts ELDAS Interim Data Co-ordination.

Using SWARM service to run a Grid based EST Sequence Assembly Karthik Narayan Primary Advisor : Dr. Geoffrey Fox 1.

DiFX Performance Testing Chris Phillips eVLBI Project Scientist 25 June 2009.

An FX software correlator for VLBI Adam Deller Swinburne University Australia Telescope National Facility (ATNF)

DiFX New Features. Disk based file specification Improved specification of files to correlate Wild cards with time of scan name filtering? External reference.

INTRODUCTION TO GIS  Used to describe computer facilities which are used to handle data referenced to the spatial domain.  Has the ability to inter-

Distributed FX software correlation Adam Deller Swinburne University/CSIRO Australia Telescope National Facility Supervisors: A/Prof Steven Tingay, Prof.

DiFX Overview Adam Deller NRAO 3rd DiFX workshop, Curtin University, Perth.

The DiFX software correlator DiFX is an FX style correlator written in C++ Designed to run on commodity clusters Optimised Intel vector libraries are used.

TOW 2003 Correlator Class Kerry Kingham US Naval Observatory Arno Mueskens University of Bonn Mike Titus MIT Haystack Observatory.

上海天文台 Shanghai Astronomical Observatory VLBI correlators of Shanghai Astronomical Observatory ZHENG Weimin, Zhang Xiuzhong Shanghai Astronomical Observatory,

Liverpool Experience of MDC 1 MAP (and in our belief any system which attempts to be scaleable to 1000s of nodes) broadcasts the code to all the nodes.

Mihai Lucian Cristea, on behalf of SCARIe team University of Amsterdam TERENA CONFERENCE ‘10, Vilnius, 1 June 2010.

HPC HPC-5 Systems Integration High Performance Computing 1 Application Resilience: Making Progress in Spite of Failure Nathan A. DeBardeleben and John.

M.P. RupenEVLA Advisory Committee Meeting September 6-7, Correlator Test Plan Michael P. Rupen.

AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.

1 Masaki Hirabaru and Yasuhiro Koyama PFLDnet 2006 Febrary 2, 2006 International e-VLBI Experience.

1 09/2003 Processing Library Update CF Checker – Script made available as a web based form on the BADC site -

TOG, Yebes, November 2007, A. Szomoru, JIVE Arpad Szomoru, JIVE EXPReS progress, Mark5 and e-VLBI.

5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.

New Workflow Manager Katarzyna Bylec PSNC. Agenda Introduction WLIN Workflows DEMO KIWI Design Workflow Manager System Components descripton ▫ KIWI Portal.

NEXPReS Period 3 Overview WP8 FlexBuff High-Bandwidth, High-Capacity Networked Storage Ari Mujunen Aalto University Metsähovi Radio Observatory Finland.

3rd International VLBI Technology Workshop November Groningen/Dwingeloo, The Netherlands DSCC VLBI PROCESSOR (DVP) J.E. Clark 1, C. García-Miró.

SA1: second year overview Arpad Szomoru JIVE January 30EXPReS Board Meeting, Utrecht, the Netherlands: SA1Slide #2 Outline Accomplishments in 2007.

NEXPReS Period 3 Overview WP5 Cloud Correlation Arpad Szomoru, JIVE.

NEXPReS Period 3 Overview The hunt for 4Gbps fringes Or, may the fringe be with you Or, nothing like living on the edge Arpad Szomoru, JIVE.

Scenario use cases Szymon Mueller PSNC. Agenda 1.General description of experiment use case. 2.Detailed description of use cases: 1.Preparation for observation.

Introduction to Fabric Kiwi Team PSNC. E-VLBI system – general idea.

EXPReS FABRIC meeting at Poznan, Poland1 EXPReS FABRIC WP 2.2 Correlator Engine Meeting Poznan Poland JIVE, Ruud Oerlemans.

WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC.

TeraGrid Capability Discovery John-Paul “JP” Navarro TeraGrid Area Co-Director for Software Integration University of Chicago/Argonne National Laboratory.

TOG, Torun, April 2009 Arpad Szomoru, JIVE EVN/JIVE Technical developments.

WfMS and external systems Katarzyna Bylec PSNC. Agenda Introduction Pre-corelation ▫ North Star ▫ NRAO SCHED ▫ Vlbeer FTP ▫ Log2vex ▫ drudg Correlation.

SUCCS Software for Uniboard / Correlator Control System.

WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC.

Title FABRIC Progress - Mark, Huib etc. T. Charles Yun Project Manager EXPReS/JIVE.

NEXPReS WP5 - Cloud Correlation Work Package Overview Arpad Szomoru JIVE.

UniBoard review September 2014

What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo.

Distributed Correlation in Fabric Kiwi Team PSNC.

A GOS Interoperate Interface's Design & Implementation GOS Adapter For JSAGA Meng You BUAA.

SA1: overview, first results

An Open Source Project Commonly Used for Processing Big Data Sets

CMS High Level Trigger Configuration Management

INTRODUCTION TO GEOGRAPHICAL INFORMATION SYSTEM

JIVE UniBoard Correlator (JUC) Firmware

e-EVN: practical considerations

Multiple Processor Systems

SCARIe: eVLBI Software Correlation Over Dynamic Lambda Grids

User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.

Presentation transcript:

Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE

Jan 29, 2008Update on the Software CorrelatorSlide #: 2 Starting Point C++ implementation of the correlator used for the Huygens FX correlator. Monolithic. Single-subband, USB only. Single-threaded, largely unoptimized. Driven by home-grown control file. No integrated delay model. No fringes on standard EVN data. Input data needs conversion. Raw output data.

Jan 29, 2008Update on the Software CorrelatorSlide #: 3 Design Decisions Parallelisation in both subbands and time. All baselines for a single subband processed on a single cluser node. Further course grained parallelisation (in time only) to distribute over multiple clusters. Input node (one per station) Correlator node (as many as feasable) Output node Manager node

Jan 29, 2008Update on the Software CorrelatorSlide #: 4 Design Decisions Grid Telescopes Input nodes Correlator nodes Output node Sorting and merging Time and channel slicing

Jan 29, 2008Update on the Software CorrelatorSlide #: 5 Current State VEX-driven, with small JSON-based control file specifying correlation parameters. Modular. Parallelized using MPI. Scales from SMP machines to largish clusters. Integrated delay model based on CALC 10. All subbands processed, both LSB and USB, cross-correlations. Still mostly unoptimized: 1.5 min to process 1s of a typical EVN NME on a quadcore SMP machine. Takes Mark4 (Mark5A) and Mark5B input data. Output data format that includes (some) metadata.

Jan 29, 2008Update on the Software CorrelatorSlide #: 6 Validation Phase Closure

Jan 29, 2008Update on the Software CorrelatorSlide #: 7 Validation Noise Analysis

Jan 29, 2008Update on the Software CorrelatorSlide #: 8 Validation Comparison with the Hardware Correlator

Jan 29, 2008Update on the Software CorrelatorSlide #: 9 Optimization Some plans for further optimization include: Investigate other compilers Use Intel/AMD vector libraries. Interpolation in application of delay model. Fringe rotation before fractional bit shift. Fringe rotation after correlation.

Jan 29, 2008Update on the Software CorrelatorSlide #: 10 Success Story: FTP Fringe Tests Cluster running NICT correlator broke down in May 2007 SFXC was used since then for FTP Fringe Tests

Jan 29, 2008Update on the Software CorrelatorSlide #: 11 Post Processing JIVE uses j2ms2 to convert hardware correlator output into MeasurementSet. J2ms2 has been adapted to accapt new SFXC output format. Translation into FITS through standard pipeline.

Jan 29, 2008Update on the Software CorrelatorSlide #: 12 The Bigger Picture How to get things on the Grid? Workflow Manager (PSNC) VLBI Grid broker (PSNC) Web Services Vex2ccf: Creates control file template from VEX Data providers: Provides chunks of data and transfers them to GridFTP servers. Currently working with GEANT2 AutoBAHN group on a joint demo to show usage of their Bandwidth-on-Demand facility.

Jan 29, 2008Update on the Software CorrelatorSlide #: 13 The Picture

Jan 29, 2008Update on the Software CorrelatorSlide #: 14 Future Directions Integrate uvw coordinates in correlator output Make things faster Real-Time eVLBI Pulsar Gating?