In each iteration macro model creates several micro modules, sends data to them and waits for the results. Using Akka Actors for Managing Iterations in.

Slides:



Advertisements
Similar presentations
Polska Infrastruktura Informatycznego Wspomagania Nauki w Europejskiej Przestrzeni Badawczej Institute of Computer Science AGH ACC Cyfronet AGH The PL-Grid.
Advertisements

Making Time-stepped Applications Tick in the Cloud Tao Zou, Guozhang Wang, Marcos Vaz Salles*, David Bindel, Alan Demers, Johannes Gehrke, Walker White.
QuIDE was used during the Quantum Computation classes at DCS AGH The students assessed the usability with the System Usability Scale QuIDE was compared.
Cosine similarity metric calculation on low power heterogeneous computing platform Michał Karwatowski 1,2, Sebastian Koryciak 1,2, Ernest Jamro 1,2, Agnieszka.
Negative feedback based organized systems simulations EUROPEAN UNION EUROPEAN REGIONAL DEVELOPMENT FUND The work was co-funded by the European Regional.
Scientific Workflow Support in the PL-Grid Infrastructure with HyperFlow Bartosz Baliś, Tomasz Bartyński, Kamil Figiela, Maciej Malawski, Piotr Nowakowski,
Towards Autonomic Adaptive Scaling of General Purpose Virtual Worlds Deploying a large-scale OpenSim grid using OpenStack cloud infrastructure and Chef.
Polish Infrastructure for Supporting Computational Science in the European Research Space GridSpace Based Virtual Laboratory for PL-Grid Users Maciej Malawski,
Next Generation Domain-Services in PL-Grid Infrastructure for Polish Science. Numerical Simulations of Metal Forming Production Processes and Cycles by.
Copyright Arshi Khan1 System Programming Instructor Arshi Khan.
The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI CYFRONET Programming.
Towards auto-scaling in Atmosphere cloud platform Tomasz Bartyński 1, Marek Kasztelnik 1, Bartosz Wilk 1, Marian Bubak 1,2 AGH University of Science and.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Towards scalable, semantic-based virtualized storage.
Polish Infrastructure for Supporting Computational Science in the European Research Space Policy Driven Data Management in PL-Grid Virtual Organizations.
Advanced Grid-Enabled System for Online Application Monitoring Main Service Manager is a central component, one per each.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
CGW 2003 Institute of Computer Science AGH Proposal of Adaptation of Legacy C/C++ Software to Grid Services Bartosz Baliś, Marian Bubak, Michał Węgiel,
Polish Infrastructure for Supporting Computational Science in the European Research Space QoS provisioning for data-oriented applications in PL-Grid D.
Next Generation Domain-Services in PL-Grid Infrastructure for Polish Science Daniel Bachniak 1, Jakub Liput 2, Łukasz Rauch 1, Renata Słota 2,3, Jacek.
An Autonomic Framework in Cloud Environment Jiedan Zhu Advisor: Prof. Gagan Agrawal.
Recording application executions enriched with domain semantics of computations and data Master of Science Thesis Michał Pelczar Krakow,
Simultech 2011, July, 2011, Noordwijkerhout, The Netherlands Component Approach to Distributed Multiscale Simulations Katarzyna Rycerz(1,2), Marian.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Lechoslaw Trębacz 1, Włodzimierz Funika 2, Piotr Handzlik 3, Marcin Smętek 2 1 Department of Computer Methods in Metallurgy, AGH, Kraków, Poland 2 Institute.
A performance evaluation approach openModeller: A Framework for species distribution Modelling.
Porting Irregular Reductions on Heterogeneous CPU-GPU Configurations Xin Huo, Vignesh T. Ravi, Gagan Agrawal Department of Computer Science and Engineering.
Cracow Grid Workshop, October 27 – 29, 2003 Institute of Computer Science AGH Design of Distributed Grid Workflow Composition System Marian Bubak, Tomasz.
Experience with the OpenStack Cloud for VPH Applications Jan Meizner 1, Maciej Malawski 1,2, Piotr Nowakowski 1, Paweł Suder 1, Marian Bubak 1,2 AGH University.
Basic Grid Registry configuration – there is not any backup data Grid Registry configuration where every domain has duplicated information Find all services.
BOF: Megajobs Gracie: Grid Resource Virtualization and Customization Infrastructure How to execute hundreds of thousands tasks concurrently on distributed.
DataNet – Flexible Metadata Overlay over File Resources Daniel Harężlak 1, Marek Kasztelnik 1, Maciej Pawlik 1, Bartosz Wilk 1, Marian Bubak 1,2 1 ACC.
High Level Architecture (HLA)  used for building interactive simulations  connects geographically distributed nodes  time management (for time- and.
Polish Infrastructure for Supporting Computational Science in the European Research Space FiVO/QStorMan: toolkit for supporting data-oriented applications.
Distributed Computing Environment (DCE) Presenter: Zaobo He Instructor: Professor Zhang Advanced Operating System Advanced Operating System.
Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.
EC-project number: Universal Grid Client: Grid Operation Invoker Tomasz Bartyński 1, Marian Bubak 1,2 Tomasz Gubała 1,3, Maciej Malawski 1,2 1 Academic.
AKOGRIMO Integration of Grid services with mobile technologies; validation in e-health, e-learning and disaster management areas CoreGRID European Grid.
1 The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI Towards Environment.
Scalarm: Scalable Platform for Data Farming D. Król, Ł. Dutka, M. Wrzeszcz, B. Kryza, R. Słota and J. Kitowski ACC Cyfronet AGH KU KDM, Zakopane, 2013.
Polish Infrastructure for Supporting Computational Science in the European Research Space Component Approach to Distributed Multiscale Simulations Katarzyna.
KUKDM’2011, Zakopane Semantic Based Storage QoS Management Methodology Renata Słota, Darin Nikolow, Jacek Kitowski Institute of Computer Science AGH-UST,
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
Lightweight construction of rich scientific applications Daniel Harężlak(1), Marek Kasztelnik(1), Maciej Pawlik(1), Bartosz Wilk(1) and Marian Bubak(1,
GEM: A Framework for Developing Shared- Memory Parallel GEnomic Applications on Memory Constrained Architectures Mucahid Kutlu Gagan Agrawal Department.
Towards large-scale parallel simulated packings of ellipsoids with OpenMP and HyperFlow Monika Bargieł 1, Łukasz Szczygłowski 1, Radosław Trzcionkowski.
Federating PL-Grid Computational Resources with the Atmosphere Cloud Platform Piotr Nowakowski, Marek Kasztelnik, Tomasz Bartyński, Tomasz Gubała, Daniel.
Rafał Słota, Michał Wrzeszcz, Renata G. Słota, Łukasz Dutka, Jacek Kitowski ACC Cyfronet AGH Department of Computer Science, AGH - UST CGW 2015 Kraków,
Włodzimierz Funika 1, Marian Bubak 1,2, Marcin Smętek 1 and Roland Wismüller 3 1 Institute of Computer Science, AGH, Kraków, Poland 2 Academic Computer.
BIOLOGICAL SYSTEMS SIMULATIONS BASED ON NEGATIVE FEEDBACK EUROPEAN UNION EUROPEAN REGIONAL DEVELOPMENT FUND The work was co-funded by the European Regional.
High Level Architecture (HLA)  used for building interactive simulations  connects geographically distributed nodes  time management (for time- and.
Parameter Sweep and Resources Scaling Automation in Scalarm Data Farming Platform J. Liput, M. Paciorek, M. Wrona, M. Orzechowski, R. Slota, and J. Kitowski.
Marian Bubak 1,2, Włodzimierz Funika 1,2, Roland Wismüller 3, Tomasz Arodź 1,2, Marcin Kurdziel 1,2 1 Institute of Computer Science, AGH, Kraków, Poland.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
Scaling up R computation with high performance computing resources.
The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI CYFRONET Hands.
National Aeronautics and Space Administration Jet Propulsion Laboratory March 17, 2009 Workflow Orchestration: Conducting Science Efficiently on the Grid.
An Efficient Compilation Framework for Languages Based on a Concurrent Process Calculus Yoshihiro Oyama Kenjiro Taura Akinori Yonezawa Yonezawa Laboratory.
PL-Grid: Polish Infrastructure for Supporting Computational Science in the European Research Space 1 ESIF - The PLGrid Experience ACK Cyfronet AGH PL-Grid.
Piotr Bała, Marcin Radecki, Krzysztof Benedyczak
Seasonal School Demo and Assigments
on behalf of the CECM Project Marian Bubak
From VPH-Share to PL-Grid: Atmosphere as an Advanced Frontend
Model Execution Environment for Investigation of Heart Valve Diseases
PROCESS - H2020 Project Work Package WP6 JRA3
Ray-Cast Rendering in VTK-m
1ACC Cyfronet AGH, Kraków, Poland
Scheduling Jobs in Multi-Grid Environment
H2020 EU PROJECT | Topic SC1-DTH | GA:
A Survey of Interactive Execution Environments
Towards a Centre for New Methods
Presentation transcript:

In each iteration macro model creates several micro modules, sends data to them and waits for the results. Using Akka Actors for Managing Iterations in Multiscale Applications Katarzyna Rycerz (1,2), Marian Bubak (1,2) (1)AGH University of Science and Technology, Institute of Computer Science AGH, Department of Computer Science, al. Mickiewicza 30, Kraków, Poland (2)ACC Cyfronet AGH, Nawojki 11, ,Kraków, Poland Typical execution cases of macro-micro interactions INNOVATIVE ECONOMY NATIONAL COHESION STRATEGY EUROPEAN UNION EUROPEAN REGIONAL DEVELOPMENT FUND The work was co-funded by the European Regional Development Fund as part of the Innovative Economy program. 1.Joris Borgdorff, at al: Foundations of distributed multiscale computing: Formalization, specification, and analysis, JPDC, Volume 73, Issue 4, April 2013, Pages E. Ciepiela at al. Exploratory Programming in the Virtual Laboratory, in Proceedings of the International Multiconference on Computer Science and Information Technology pp. 621–628[3] 3.K. Rycerz, et al: An Environment for Programming and Execution of Multiscale Applications, Future Generation Computer Systems, 2015 vol. 53, s. 77–87. 4.K. Rycerz, et al: Enabling Multiscale Fusion Simulations on Distributed Computing Resources. In: M. Bubak, J. Kitowski, K. Wiatr (Eds.): eScience on Distributed Computing Infrastructure, LNCS, Vol Springer, pp (2014) This study was partly supported by the AGH grant no and also by the European Union within the European Regional Development Fund program no. POIG /13 as part of the PLGrid Core project Motivation Solution Different coupling templates of multiscale applications [1] supported by building and execution tools [2,3]. Efficient execution support for iteration graphs of multiscale applications on a fine-grained (iteration level) the macro and micro modules execute concurrently after each iteration the macro module sends data to the micro counterpart and waits for the results. The state from iteration i is then used in iteration i+1. if the macro module needs to use different resources then micro module it has to wait wasting resources. we propose a solution that allows for efficient use of resources during these idle times. to group modules of similar demands for the same resources the modules do not necessary have to belong to the same application the behavior of each module is modeled by Akka actors used to send commands to the wrapping service on the actual resource. once send to the same resources, the modules need to be properly queued to execute part of one application in the idle time of the other Results The experiment was performed with Akka for Scala 2.11 on Intel Core i GHz. LU factorization was implemented with LAPACK library routine wrapped by Ruby linalg library we have compared execution of the varied ( ) number of calculations on the same CPU resource by running them concurrently (naive method) and one after another with Akka-based queuing mechanism (customized dispatcher with thread-pool-executor ) the execution time of a single task is fixed for Akka-based solution and grows linearly for naive solution the measured time of tasks creation by a REST client shows Akka and Spray overhead. Conclusions The preliminary results are promising for building the Akka-based framework managing execution of the applications consisting of distributed modules communicating in iterations. As a resources, apart from HPC we also plan to use cloud resources and mechanism of lightweight virtualization containers. The main challenges are to build a solution for a set of legacy multiscale applications[4]. Case 1 Case 2 Experiment computing is invoked by a client communicating with the wrapping service by REST (Spray toolkit) the manager actor inside a wrapping service creates a single calculation actor for one CPU intensive calculation. A single calculation is an LU factorization algorithm with parameterized matrix size to steer CPU time of the simulation