WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC.

Slides:



Advertisements
Similar presentations
Dominik Stoklosa Poznan Supercomputing and Networking Center, Supercomputing Department EGEE 2007 Budapest, Hungary, October 1-5 Workflow management in.
Advertisements

Dominik Stokłosa Pozna ń Supercomputing and Networking Center, Supercomputing Department INGRID 2008 Lacco Ameno, Island of Ischia, ITALY, April 9-11 Workflow.
Kjeld v.d. Schaaf DS3-T2 DS3 T2: Data Handling, Control and Distributed Computing Kjeld v.d. Schaaf 4 September 2006.
Onsala Space Observatory Present status and technical directions of the EVN Michael Lindqvist Onsala Space Observatory, Sweden Arpad.
This project has received funding from the European Union’s Seventh Programme for Research, Technological Development and Demostration under Grant Agreement.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 4 Software Integration.
Secure European Common Information Space for the Interoperability of First Responders and Police Authorities This project has received funding from the.
1 SWE Introduction to Software Engineering Lecture 3 Introduction to Software Engineering.
Revision Week 13 – Lecture 2. The exam 5 questions Multiple parts Read the question carefully Look at the marks as an indication of how much thought and.
The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI Multiscale APPlications.
All Hands Meeting DORII Deployment of Remote Instrumentation Infrastructure Norbert Meyer PSNC October 20, 2009, Garching.
WP6: Grid Authorization Service Review meeting in Berlin, March 8 th 2004 Marcin Adamski Michał Chmielewski Sergiusz Fonrobert Jarek Nabrzyski Tomasz Nowocień.
E-RemoteCtrl: Concepts for VLBI station control as part of NEXPReS Arpad Szomoru (JIVE) Alexander Neidhardt (FESG), Martin Ettl (FESG), Matthias Mühlbauer.
LIGO-G E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
The Preparatory Phase Proposal a first draft to be discussed.
Procurement Innovation for Cloud Services in Europe CERN – 14 May 2014 Bob Jones (CERN) This document produced by Members of the Helix Nebula consortium.
Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture.
Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec Virtual Laboratory as a Remote.
The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/ ) under grant agreement n°
Per Møldrup-Dalum State and University Library SCAPE Information Day State and University Library, Denmark, SCAPE Scalable Preservation Environments.
SCAPE Scalable Preservation Environments. 2 Its all about scalability! Scalable services for planning and execution of institutional preservation strategies.
COOPERaTE Control and Optimization of Energy Positive Neighbourhoods Energy Management and Sharing The COOPERaTE Experience COOPERaTE ICT Approach Keith.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech.
This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under.
FESSUD is funded by the European Union under the 7th Research Framework programme (theme SSH) Grant agreement nr These views are only those of.
Managing and communicating uncertainty in geospatial web service workflows Richard Jones, Dan Cornford, Lucy Bastin, Matthew Williams Computer Science,
E-VLBI FP6 Proposal. Outline Background The Call Content of Proposal & Aim Possible Participants Overall preparation plan.
Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE.
EUCISE 2020 EUCISE 2020 has received funding from the European Union’s seventh framework programme under grant agreement no: Participating Countries:
DiFX New Features. Disk based file specification Improved specification of files to correlate Wild cards with time of scan name filtering? External reference.
Westerbork Netherlands Dedicated Gbit link Onsala Sweden Gbit link Jodrell Bank UK Dwingeloo DWDM link Cambridge UK MERLIN Medicina Italy Chalmers University.
1 - Genias and Contrail - WP14 Communication and Dissemination Ad Emmen, Genias Benelux bv contrail is co-funded by the EC 7th Framework Programme under.
Project number: ENVRI and the Grid Wouter Los 20/02/20161.
The Consortium FP7 collaborative Smart City project ENERGY Collaborative Project – This project has received funding from the European Union’s.
The HiLumi LHC Design Study is included in the High Luminosity LHC project and is partly funded by the European Commission within the Framework Programme.
New Workflow Manager Katarzyna Bylec PSNC. Agenda Introduction WLIN Workflows DEMO KIWI Design Workflow Manager System Components descripton ▫ KIWI Portal.
NEXPReS Period 3 Overview WP 6: High Bandwidth on Demand Paul Boven, JIVE.
NEXPReS Period 3 Overview WP8 FlexBuff High-Bandwidth, High-Capacity Networked Storage Ari Mujunen Aalto University Metsähovi Radio Observatory Finland.
WP8: FlexBuff Ari Mujunen, Tomi Salminen Aalto University Metsähovi Radio Observatory NEXPReS 2nd Board Meeting – 2012 June 20 – NORDUnet, Copenhagen Denmark.
NEXPReS Period 3 Overview WP5 Cloud Correlation Arpad Szomoru, JIVE.
NEXPReS Period 3 Overview The hunt for 4Gbps fringes Or, may the fringe be with you Or, nothing like living on the edge Arpad Szomoru, JIVE.
Safe and secure control of VLBI stations from remote Alexander Neidhardt (FESG, TUM) Martin Ettl (FESG/MPIfR), Jim Lovell (UTAS),
Scenario use cases Szymon Mueller PSNC. Agenda 1.General description of experiment use case. 2.Detailed description of use cases: 1.Preparation for observation.
Introduction to Fabric Kiwi Team PSNC. E-VLBI system – general idea.
TOG, Torun, April 2009 Arpad Szomoru, JIVE EVN/JIVE Technical developments.
NEXPReS Period 3 Overview WP2 EVN-NREN Richard Hughes-Jones, DANTE.
WfMS and external systems Katarzyna Bylec PSNC. Agenda Introduction Pre-corelation ▫ North Star ▫ NRAO SCHED ▫ Vlbeer FTP ▫ Log2vex ▫ drudg Correlation.
NEXPReS WP8 Provisioning High-Bandwidth, High-Capacity Networked Storage on Demand Ari Mujunen Board Meeting 20-Sep-2010 in Manchester Research leading.
WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC.
Title FABRIC Progress - Mark, Huib etc. T. Charles Yun Project Manager EXPReS/JIVE.
NEXPReS WP5 - Cloud Correlation Work Package Overview Arpad Szomoru JIVE.
The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI EGI and PRACE ecosystem.
What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo.
Distributed Correlation in Fabric Kiwi Team PSNC.
Background Data Centre (DC) energy consumption doubled between 2000 and 2005 and grew by 50% from 2005 to 2010, consuming 1.5% of global primary energy.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.
Your name Your title, institution. RI READ ME To modify “Event – Location – Date” footer on all slides, go to Insert > Header & Footer. Change.
Finnish Final Workshop Helsinki 16th March 2016
Technical Operations and R&D at JIVE
EVN TOG-meeting Onsala Space Observatory
ICT NCP Infoday Brussels, 23 June 2010
NEXPReS Period 3 Overview
Dependability management in automated border control
First, Last Name (Institute)
Anja Burghardt, Institute for Employment Research (IAB)
16th EMS Annual Meeting Trieste, 13 September 2016
User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.
Title of the presentation: Methods and Data Analysis
Presentation transcript:

WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC

Remaining Deliverables MM NEXPReS Period 2 Review – Brussels - September 21, 2012 NoNo NameTypeDueStatus D7.6Demo of real-time correlationDemo342 D7.7Demo of global correlationDemo361 2

Planning & Challenges D7.6 Real-Time Correlation ▫ Really want to do a more extended background observation ▫ And get a real trigger ▫ Telescopes need to know other commitments before we can plan D7.7 Global Correlation ▫ Mostly a technical demonstration ▫ Globally distributed correlation SFXC is now the primary correlator at JIVE ▫ Less time available for testing ▫ But new PSNC cluster on-line now 3 NEXPReS Period 2 Review – Brussels - September 21, 2012

Global/Distributed Correlation NEXPReS Period 2 Review – Brussels - September 21, 2012 Distribute subbands over correlation centers Poznan Dwingeloo Perth Onsala Irbene Mopra Leverage new VDIF/VTP standards to achieve this Use software Mark5 to VDIF conversion in jive5ab 4

Distributed Correlation All major components in place ▫ SFXC is e-VLBI capable ▫ Jive5ab can split data up into subbands ▫ Station module ▫ Workflow Manager Components still need to be integrated & tested DiFX integration still needs to happen ▫ To show e-VLBI platform is generic ▫ DiFX is another software correlator widely used in VLBI ▫ Already installed at PSNC WP5 4Gbit/s demo already used distributed correlation with SFXC 5 NEXPReS Period 2 Review – Brussels - September 21, 2012

Triggered Observatoins (OSO) Decider module receives triggers & decides whether to observe ▫ Being written in Python ▫ Listens for incoming VOEvents ▫ Parser module written at Southampton University converts XML VOEvents to Python-friendly structure ▫ On receipt of VOEvent, details compared with trigger definitions provided by PIs ▫ Decision is made to observe or not, as well as when to observe ▫ Observation parameters sent to Schedule Writer Work in progress ▫ Logic used for decision making needs expanding OSO Decider module Set of trigger definition files PI Trigger definition generator VOEvent Backbone XML Southampton VOEvent parser OSO Schedule writer 6 NEXPReS Period 2 Review – Brussels - September 21, 2012

Research leading to these results has received funding from the European Union's Seventh Framework Programme (FP7/2007 ‑ 2013) under grant agreement n° RI NEXPReS. This material reflects only the author's views, and the European Community is not liable for any use that may be made of the information contained therein. NEXPReS Period 2 Review – Brussels - September 21,