NEXPReS WP5 - Cloud Correlation Work Package Overview Arpad Szomoru JIVE.

Slides:

Advertisements

Similar presentations

Managing transport on demand for the disabled in Rome: Bus Abile Marco Farina, ATAC S.p.A., Rome, Italy Workshop: Tackling socio-economic disparities using.

Advertisements

1 Service Providers Capacity Assessment Framework Presentation to the Service Delivery Advisory Group August 28, 2008.

Onsala Space Observatory Present status and technical directions of the EVN Michael Lindqvist Onsala Space Observatory, Sweden Arpad.

Cloud Computing to Satisfy Peak Capacity Needs Case Study.

DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance

SWE Introduction to Software Engineering

Azad Madni Professor Director, SAE Program Viterbi School of Engineering Platform-based Engineering: Rapid, Risk-mitigated Development.

Performance Evaluation of a Multi-Threaded Distributed Telerobotic Framework Mayez Al-Mouhamed, Onur Toker, and Asif Iqbal College of Computer Science.

Project planning. Software project management Informal definition of management – The art of getting work done through other people Software project management.

© Copyright High Performance Concepts, Inc. 12 Criteria for Software Vendor Selection July 14, 2014 prepared by: Brian Savoie Vice President HIGH.

VLBI Report LBA Operations & eVLBI Tasso Tzioumis ATNF May 2008.

E-RemoteCtrl: Concepts for VLBI station control as part of NEXPReS Arpad Szomoru (JIVE) Alexander Neidhardt (FESG), Martin Ettl (FESG), Matthias Mühlbauer.

1 Software Process Lecture Outline Nature of software projects Engineering approaches Software process A process step Characteristics of a good.

Software Engineering Chapter 15 Construction Leads to Initial Operational Capability Fall 2001.

Alex C. Mueller, MANETEURONS PCC-Meeting, Mainz (Germany), April 2006 EURONS 1st annual report: Generalities (I)  With an EC contribution of 14,056,000.

Testing Challenges in an Agile Environment Biraj Nakarja Sogeti UK 28 th October 2009.

Welcome to Session 4 – Project Management Process Overview (continued) Instructor:Phyllis Sweeney Instructor: Phyllis Sweeney Project Management Certificate.

© Copyright, The Joint Commission 1 Joint Commission Center for Transforming Healthcare Introduction: Hand Hygiene Targeted Solutions Tool ® (TST)

EVN-NREN meeting, Schiphol, , A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe.

1 st -4 th December st BioXHIT Annual Meeting WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution Peter.

©Ian Sommerville 2000Software Engineering, 6th edition. Chapter 4 Slide 1 Project management l Organising, planning and scheduling software projects.

VLBI/eVLBI with the 305-m Arecibo Radio Telescope Chris Salter Tapasi Ghosh Emmanuel Momjian Arun Venkataraman Jon Hagen.

Supporting Industry Change Planning: Risk & Milestone Assessment Process & Tools 07/07/2014.

NMI End-to-End Diagnostic Advisory Group BoF Fall 2003 Internet2 Member Meeting.

17 th October 2005CCP4 Database Meeting (York) CCP4(i)/BIOXHIT Database Project: Scope, Aims, Plans, Status and all that jazz Peter Briggs, Wanjuan Yang.

GREG CAPPS [ ASUG INSTALLATION MEMBER MEMBER SINCE:1998 ISRAEL OLIVKOVICH [ SAP EMPLOYEE MEMBER SINCE: 2004 GRETCHEN LINDQUIST [ ASUG INSTALLATION MEMBER.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Analytical Reliability Centered Maintenance

E-VLBI FP6 Proposal. Outline Background The Call Content of Proposal & Aim Possible Participants Overall preparation plan.

2007Sep06 EAC Butler - Software Overview 1 Software Overview Bryan Butler.

CSC480 Software Engineering Lecture 5 September 9, 2002.

Coordinating an Observation Network of Networks EnCompassing saTellite and IN-situ to fill the Gaps in European Observations Kick-Off Meeting, February.

Sponsored by the National Science Foundation Measurement System Spiral 2 Year-end Project Review University of Wisconsin, Colgate University, Boston University.

{ North East ISD Technology Plan North East ISD Technology Plan By Dilene Witt-Nelson EDLD 5362 ET 8040.

Unit – I Presentation. Unit – 1 (Introduction to Software Project management) Definition:-  Software project management is the art and science of planning.

1 WP7 Presentation WP7 -- Project Evaluation Computer Engineering and Networks Laboratory, ETH Zurich Lukas Ruf.

TOG, Yebes, November 2007, A. Szomoru, JIVE Arpad Szomoru, JIVE EXPReS progress, Mark5 and e-VLBI.

Open Map Yamama Dagash & Haitham Khateeb under the supervision of: Benny Daon & Eyal Levin Open Map.

NEXPReS Period 3 Overview WP 6: High Bandwidth on Demand Paul Boven, JIVE.

NEXPReS Period 3 Overview WP8 FlexBuff High-Bandwidth, High-Capacity Networked Storage Ari Mujunen Aalto University Metsähovi Radio Observatory Finland.

EVN Performance and Reliability Iván Agudo. Collection of Highlights A large improvement of the EVN in terms of new stations & sensitivity! First fringes.

Federal Acquisition Service 4 th Annual Government Transportation Forum TransPort Integrator Overview.

SA1: second year overview Arpad Szomoru JIVE January 30EXPReS Board Meeting, Utrecht, the Netherlands: SA1Slide #2 Outline Accomplishments in 2007.

INDIGO – DataCloud WP5 introduction INFN-Bari CYFRONET RIA

WP5: Cloud Correlation Arpad Szomoru Joint Institute for VLBI in Europe.

WP8: FlexBuff Ari Mujunen, Tomi Salminen Aalto University Metsähovi Radio Observatory NEXPReS 2nd Board Meeting – 2012 June 20 – NORDUnet, Copenhagen Denmark.

NEXPReS Period 3 Overview WP5 Cloud Correlation Arpad Szomoru, JIVE.

NEXPReS Period 3 Overview The hunt for 4Gbps fringes Or, may the fringe be with you Or, nothing like living on the edge Arpad Szomoru, JIVE.

Safe and secure control of VLBI stations from remote Alexander Neidhardt (FESG, TUM) Martin Ettl (FESG/MPIfR), Jim Lovell (UTAS),

WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC.

TOG, Torun, April 2009 Arpad Szomoru, JIVE EVN/JIVE Technical developments.

Enterprise Solution Services Assessing the IT environment Oversaw 2014 Texas Legacy System Study report (HB 2738, 83R) Identified 4,130 business applications.

WfMS and external systems Katarzyna Bylec PSNC. Agenda Introduction Pre-corelation ▫ North Star ▫ NRAO SCHED ▫ Vlbeer FTP ▫ Log2vex ▫ drudg Correlation.

WP7: Computation in a shared infrastructure Mark Kettenis JIVE Presented by Norbert Meyer PSNC.

SA1: Production e-VLBI service Period 2 Overview Arpad Szomoru JIVE EXPReS is made possible through the support of the European Commission (DG-INFSO),

EVLBI MPIfR,Bonn A. Roy, W. Alef, D. Graham, A. Oberreuter

SA1: technical progress

SA1: overview, first results

Supportability Design Considerations

Chapter 6: Database Project Management

IBM Talent Suite Family of Offerings September 2014 Release

Description of Revision

e-EVN: practical considerations

OGC Testbed 13 Outcomes and Information on the OGC Testbed 14

Simplified Development Toolkit

SA1: third year overview

The e-EVN Arpad Szomoru, JIVE.

Joint Application Development (JAD)

Change Tested or Implemented

ISO Open system Requirements and IT Needs

Presentation transcript:

NEXPReS WP5 - Cloud Correlation Work Package Overview Arpad Szomoru JIVE

20 September 2010NEXPReS- WP5: Cloud CorrelationSlide #2 Overview Who & why Work packages Resources, progress Deliverables & milestones

Who & why 20 September 2010NEXPReS- WP5: Cloud CorrelationSlide #3 Participants & FTEs: JIVE (87), MPG (9), AALTO (9), TUM (15) Purpose: Extend advantages of e-VLBI to all VLBI Transform complete VLBI observational chain: Scheduling, setting, actual observing, buffering, real-time - delayed correlation Transparent to user Enable modification of observational parameters on the fly Prepare and implement 4 Gbps recording/transmitting/playback And beyond...

20 September 2010NEXPReS- WP5: Cloud CorrelationSlide #4 Work packages Flexible buffering (JIVE, AALTO) Buffering at stations: Safeguard against loss through network failures Complement e-observations at later time with full network Mixed e/recorded VLBI first deliverable Buffering at correlator: Re-correlation with more stations, different parameters Mark5B needed (or C) 4 Gbps capability needed, hardware/software correlators Implementation of VDIF standard Integrate VDIF (and VTP?) in all EVN operations Corner turning platform

20 September 2010NEXPReS- WP5: Cloud CorrelationSlide #5 Work packages (2) Continuous quality monitoring & station remote control (TUM, MPG, JIVE) RPC-based client/server solution for station monitoring and remote control Authentication and authorization Extension of current station-log monitoring and feedback Near-continuous automated fringe checks Network monitoring (overlap with WP6) Automated network-dependent correlation (JIVE) Determination of sustainable data rates Scheduling of remote and local buffering Reliable operator feedback mechanisms Unattended correlation Rapid response to observers for timely decisions on re- correlation

20 September 2010NEXPReS- WP5: Cloud CorrelationSlide #6 Resources, progress Start date of project far from optimal (1st of July) Unavoidable delay in hiring One ad out, closing date October 1st (scientific software engineer at JIVE) Second ad possibly end of year One JIVE staff member retired One JIVE staff member to return from secondment at NRAO One engineer hired at MPG on August 1, at TUM from September 1 No hires yet at AALTO Sizable effort from available JIVE staff towards first deliverable, no serious delays expected First TUM/MPG deliverable expected on time First kick-off telecon held end of August

20 September 2010NEXPReS- WP5: Cloud CorrelationSlide #7 Deliverables 1.Mixed e-VLBI/recorded-VLBI at stations (3) 2.Metrics, selection criteria and user feedback (4) 3.Definition of specifications monitoring and remote control (4) 4.Automated job scheduling (9) 5.VDIF Mark5 conversion software (15) 6.Control systems and scheduling mechanisms for 4-Gbps recording equipment (18) 7.Unattended correlation (19) 8.Monitoring, remote control and client software including the authorization and authentication layer (22) 9.Control systems and scheduling mechanisms for 4-Gbps at correlator (23) 10.Corner-turning platform (24) 11.FS-integrated remote control system (28) 12.Automated delayed correlation (29) 13.Real-time correlation with simultaneous recording at the correlator (30) 14.Report on tests with Wettzell & Effelsberg stations (36) 15.Streamlined data reduction pipelines & user access (36)

20 September 2010NEXPReS- WP5: Cloud CorrelationSlide #8 Milestones 1.Definition of specifications monitoring and remote control (4) 2.Automated job scheduling (9) 3.Unattended correlation (19) 4.Control systems and scheduling mechanisms for 4-Gbps at correlator (23)