Presentation is loading. Please wait.

Presentation is loading. Please wait.

Published byCarol Waters Modified over 9 years ago

Similar presentations

Presentation on theme: ""— Presentation transcript:

1 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de http://www.interactive-grid.eu

2 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Interactive grid access for Matlab Marcus Hardt SCC @ FZK

3 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Idea: Computer power Electrical power From Electrical power grid => computational grid Across organisational domains / countries Transparent access to ● Computing ● Data ● Network Large scale installations Grid Computing

4 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Grid middleware  Middleware := Softwarelayer between application and operating system  gLite: one grid middleware ● Development driven by CERN ● Tools for data+computing of new accelerator ● 10 PB/year * 20 years, random access ● Job based: Job = Complete application + description Send job to remote compute center Get result back after job is finished

5 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de g gLite installations in Europe

6 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de gLite architecture

7 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Using a lightbulb in the job based grid world  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...

8 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...  Submit request for electricity to broker Using a lightbulb in the job based grid world

9 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...  Submit request for electricity to broker => Powerplant chosen for you Using a lightbulb in the job based grid world

10 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...  Submit request for electricity to broker => Powerplant chosen for you => Send lightbulb to powerplant Using a lightbulb in the job based grid world

11 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...  Submit request for electricity to broker => Powerplant chosen for you => Send lightbulb to powerplant => Wait for electricity Using a lightbulb in the job based grid world

12 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...  Submit request for electricity to broker => Powerplant chosen for you => Send lightbulb to powerplant => Wait for electricity => Lightbulb glows Using a lightbulb in the job based grid world

13 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...  Submit request for electricity to broker => Powerplant chosen for you => Send lightbulb to powerplant => Wait for electricity => Lightbulb glows  Results come back Using a lightbulb in the job based grid world

14 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Describe the lightbulb Voltage, Watts, Amount Lighting_time,...  Submit request for electricity to broker => Powerplant chosen for you => Send lightbulb to powerplant => Wait for electricity => Lightbulb glows  Results come back ● About 20% of the bulbs broken Using a lightbulb in the job based grid world

15 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Can interactivity be a solution?

16 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Yes! We submit a cable! Can interactivity be a solution?

17 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de The interactive channel A “cable” connects user with resource

18 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Our cable: GridSolve

19 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de GridSolve submitted to the WNs

20 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de GridSolve network connectivity

21 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de GridSolve workflow

22 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  Client interface for Java, C, Fortran, Matlab, Octave,...  Easy to use: y=problem(x) y=gs_call('problem', x)‏ ● Transport input parameters to remote side ● Execute “problem” ● Transport result back GridSolve interface => Reduce complexity of the grid to one function call

23 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Life-Demo  Two concurrent runs of ” backpropagation ” algorithm  Local part: ● Matlab computes ”backpropagation” on my laptop  Grid part: ● Matlab computes ”backpropagation” using the grid ● We use GridSolve interfaces (used in backpropagation _parallel ) ‏ Migrating Desktop ( MD ): grid Integration environment Grid resource allocation (via jobs from MD) ‏

24 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de  We can...... use grid resources from Matlab... compute more pixels... in shorter time... develop algorithms faster  Download a movie of the life demonstration: ● http://marcus.hardt-it.de/grid4matlab Life-Demo

25 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Summary  Current status ● Grid useable within Applications (like Matlab) ‏ Interactively Without much grid specific knowledge  Work in progress ● Improve minor itches with GridSolve ● Simplify grid allocation  Future work ● Software deployment ● Data management ● Inter process communication (MPI) ‏

26 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de

27 http://interactive-grid.eu Marcus.Hardt@iwr.fzk.de Source code

Download ppt ""

Similar presentations

Max Mustermann Folientitel Veranstaltung Online Steering of HEP Applications Daniel Lorenz University of Siegen Cracow Grid Workshop 06 14. 10. 2006 –

Max Mustermann Folientitel Veranstaltung Online Steering of HEP Applications Daniel Lorenz University of Siegen Cracow Grid Workshop –
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University 2005.9.

A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Www.cpc.wmin.ac.uk/GEMLCA Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.

Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.

Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.

RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.
Batch Production and Monte Carlo + CDB work status Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.

Batch Production and Monte Carlo + CDB work status Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),

ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

Task Scheduling and Distribution System Saeed Mahameed, Hani Ayoub Electrical Engineering Department, Technion – Israel Institute of Technology - 2009.

Task Scheduling and Distribution System Saeed Mahameed, Hani Ayoub Electrical Engineering Department, Technion – Israel Institute of Technology
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.

DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
.NET Mobile Application Development Introduction to Mobile and Distributed Applications.

.NET Mobile Application Development Introduction to Mobile and Distributed Applications.
High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.

High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.
Smart Home Current Progress Summary. Main Processor – Stellaris.

Smart Home Current Progress Summary. Main Processor – Stellaris.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,

EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
INTRODUCTION TO WEB DATABASE PROGRAMMING

INTRODUCTION TO WEB DATABASE PROGRAMMING
DIANE Overview Germán Carrera, Alfredo Solano (CNB/CSIC) EMBRACE COURSE Monday 19th of February to Friday 23th. CNB-CSIC Madrid.

DIANE Overview Germán Carrera, Alfredo Solano (CNB/CSIC) EMBRACE COURSE Monday 19th of February to Friday 23th. CNB-CSIC Madrid.
Beyond DHTML So far we have seen and used: CGI programs (using Perl ) and SSI on server side Java Script, VB Script, CSS and DOM on client side. For some.

Beyond DHTML So far we have seen and used: CGI programs (using Perl ) and SSI on server side Java Script, VB Script, CSS and DOM on client side. For some.
SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.

SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.

Similar presentations

Ads by Google