Mihai Lucian Cristea, on behalf of SCARIe team University of Amsterdam TERENA CONFERENCE ‘10, Vilnius, 1 June 2010.

Slides:



Advertisements
Similar presentations
SCARIe: Realtime software correlation Nico Kruithof, Damien Marchal.
Advertisements

A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Opportunistic Mobility with Multipath TCP
Requirements on the Execution of Kahn Process Networks Marc Geilen and Twan Basten 11 April 2003 /e.
Performance Evaluation of Open Virtual Routers M.Siraj Rathore
Towards Virtual Routers as a Service 6th GI/ITG KuVS Workshop on “Future Internet” November 22, 2010 Hannover Zdravko Bozakov.
Modeling Kanban Scheduling in Systems of Systems Alexey Tregubov, Jo Ann Lane.
WS-VLAM: Towards a Scalable Workflow System on the Grid V. Korkhov, D. Vasyunin, A. Wibisono, V. Guevara-Masis, A. Belloum Institute.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
Welco me. Bart’s Operating System Structure B.Visscher Aug 2001.
CS538: Advanced Topics in Information Systems. 2 Secure Location transparency Consistent Real-Time Available Black Box: Distributed Storage [GMM] ? Data.
UCB Implementing QoS Jean Walrand EECS. UCB Outline What? Bandwidth, Delay Where? End-to-End, Edge-to-Edge, Edge-to-End, Overlay Mechanisms Access Control.
May TERENA workshopStarPlane StarPlane: Application Specific Management of Photonic Networks Paola Grosso SNE group - UvA.
Traffic shaping with OVS and SDN Ramiro Voicu Caltech LHCOPN/LHCONE, Berkeley, June
The Pursuit for Efficient S/C Design The Stanford Small Sat Challenge: –Learn system engineering processes –Design, build, test, and fly a CubeSat project.
1/8 Enhancing Grid Infrastructures with Virtualization and Cloud Technologies Ignacio M. Llorente Business Workshop EGEE’09 September 21st, 2009 Distributed.
1.  Project Goals.  Project System Overview.  System Architecture.  Data Flow.  System Inputs.  System Outputs.  Rates.  Real Time Performance.
Wireless Sensor Networking for “Hot” Applications: Effects of Temperature on Signal Strength, Data Collection and Localization.
Mantychore Oct 2010 WP 7 Andrew Mackarel. Agenda 1. Scope of the WP 2. Mm distribution 3. The WP plan 4. Objectives 5. Deliverables 6. Deadlines 7. Partners.
1 Enabling Large Scale Network Simulation with 100 Million Nodes using Grid Infrastructure Hiroyuki Ohsaki Graduate School of Information Sci. & Tech.
Grid Data Management A network of computers forming prototype grids currently operate across Britain and the rest of the world, working on the data challenges.
1. 2 Corollary 3 System Overview Second Key Idea: Specialization Think GoogleFS.
Tiziana FerrariNetwork metrics usage for optimization of the Grid1 DataGrid Project Work Package 7 Written by Tiziana Ferrari Presented by Richard Hughes-Jones.
David G. Andersen CMU Guohui Wang, T. S. Eugene Ng Rice Michael Kaminsky, Dina Papagiannaki, Michael A. Kozuch, Michael Ryan Intel Labs Pittsburgh 1 c-Through:
A Transport Framework for Distributed Brokering Systems Shrideep Pallickara, Geoffrey Fox, John Yin, Gurhan Gunduz, Hongbin Liu, Ahmet Uyar, Mustafa Varank.
A Proposal of Application Failure Detection and Recovery in the Grid Marian Bubak 1,2, Tomasz Szepieniec 2, Marcin Radecki 2 1 Institute of Computer Science,
Example: Sorting on Distributed Computing Environment Apr 20,
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Introduction to Software Development. Systems Life Cycle Analysis  Collect and examine data  Analyze current system and data flow Design  Plan your.
1 Network Emulation Mihai Ivanovici Dr. Razvan Beuran Dr. Neil Davies.
AIMS Workshop Heidelberg, 9-11 March EURESCOM P616 ENHANCED ATM IMPLEMENTATION ISSUES OVERALL RESULTS Augusto Casaca Portugal Telecom.
GRID ARCHITECTURE Chintan O.Patel. CS 551 Fall 2002 Workshop 1 Software Architectures 2 What is Grid ? "...a flexible, secure, coordinated resource- sharing.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE.
Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication.
A Utility-based Approach to Scheduling Multimedia Streams in P2P Systems Fang Chen Computer Science Dept. University of California, Riverside
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Performance Analysis of Preemption-aware Scheduling in Multi-Cluster Grid Environments Mohsen Amini Salehi, Bahman Javadi, Rajkumar Buyya Cloud Computing.
Distributed FX software correlation Adam Deller Swinburne University/CSIRO Australia Telescope National Facility Supervisors: A/Prof Steven Tingay, Prof.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Dzmitry Kliazovich University of Luxembourg, Luxembourg
Adaptive Sleep Scheduling for Energy-efficient Movement-predicted Wireless Communication David K. Y. Yau Purdue University Department of Computer Science.
Lawrence H. Landweber National Science Foundation SC2003 November 20, 2003
Tool Integration with Data and Computation Grid “Grid Wizard 2”
An Evaluation of Fairness Among Heterogeneous TCP Variants Over 10Gbps High-speed Networks Lin Xue*, Suman Kumar', Cheng Cui* and Seung-Jong Park* *School.
1 PerfCenter and AutoPerf: Tools and Techniques for Modeling and Measurement of the Performance of Distributed Applications Varsha Apte Faculty Member,
SYSTEMSDESIGNANALYSIS 1 Chapter 21 Implementation Jerry Post Copyright © 1997.
Sensor Coordination using Active Dataspaces Steven Cheung NSF NOSS PI Meeting October 18, 2004.
Homework 1 solutions. Question 1 Solution Q1 Question 2.
Wide Area Grid – Technical Requirements Paul Kopp.
Studies of LHCb Trigger Readout Network Design Karol Hennessy University College Dublin Karol Hennessy University College Dublin.
Holding slide prior to starting show. Scheduling Parametric Jobs on the Grid Jonathan Giddy
Univ. of TehranIntroduction to Computer Network1 An Introduction to Computer Networks University of Tehran Dept. of EE and Computer Engineering By: Dr.
Introduction to Fabric Kiwi Team PSNC. E-VLBI system – general idea.
BDTS and Its Evaluation on IGTMD link C. Chen, S. Soudan, M. Pasin, B. Chen, D. Divakaran, P. Primet CC-IN2P3, LIP ENS-Lyon
SCARIe: using StarPlane and DAS-3 Paola Grosso Damien Marchel Cees de Laat SNE group - UvA.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
With the recent rise in cloud computing, applications are routinely accessing and interacting with data on remote resources. As data sizes become increasingly.
TEIN2 Report - CN TEIN2/ORIENT Orient is a project linking academic networks in China and Europe Aim is to provide a dedicated high-bandwidth.
Distributed Correlation in Fabric Kiwi Team PSNC.
Input and Output Optimization in Linux for Appropriate Resource Allocation and Management James Avery King.
Regional Operations Centres Core infrastructure Centres
Grid Computing.
Red Hat User Group June 2014 Marco Berube, Cloud Solutions Architect
StatSense In-Network Probabilistic Inference over Sensor Networks
Streaming Sensor Data Fjord / Sensor Proxy Multiquery Eddy
User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.
Use Of GAUDI framework in Online Environment
portal broker PingER Replica Mgr RFT GridFTP GateKeeper Job Mgr Akenti
Presentation transcript:

Mihai Lucian Cristea, on behalf of SCARIe team University of Amsterdam TERENA CONFERENCE ‘10, Vilnius, 1 June 2010

 eVLBI on the Grid: SCARIe  Problems when running SCARIe on Grid  Workflow management: WS-VLAM  Experiments  Conclusions

Telescopes Bring the data from telescopes: Current: 4x256MBps Mid-target: 16x1Gbps Future scenario: 32x4Gbps Correlator Input nodes Correlator nodes Output node Result Software Correlator Architecture Research and Implementation for e-VLBI Requirement: constant throughput

Jitter due to network congestion Telescope Correlator Input node Correlator nodes Output node 80% 95% 80% Jitter due to network overload at ingress NE

 Specific services to applications: ◦ Only the App knows how to optimally use the resources  Solutions to meet the specific network demands: ◦ Schedule network resources (e.g., parallelize the link usage, not only the CPU usage, tradeoffs link connectivity vs. energy budget) ◦ Application controls the network resources

DAS1 DAS3 DAS5 DAS x 100Mbps Switch DAS2 DAS4 DAS6 DAS IXDP2850 1Gbps Network Broker

DAS1 DAS3 DAS5 DAS x 100Mbps Switch DAS2 DAS4 DAS6 DAS IXDP2850 1Gbps Network Broker W1W1 W2W2 W3W3 W4W4 R1R1 R2R2 R3R3 R4R4 A B C D E

Playback Demos:

 Close interactions between applications and networks enables better usage of resources  We support it in Grids by enabling networks as a service  When network resources are not transparent to applications, the interfaces between sensors, networks, and computational resources in the Grid can be managed in order to achieve an optimal interworking