© EADS 2010 – All rights reserved Force Protection Call 4 A-0938-RT-GC EUSAS European Urban Simulation for Asymmetric Scenarios Scalarm: Massively Self-Scalable.

Slides:



Advertisements
Similar presentations
Performance Testing - Kanwalpreet Singh.
Advertisements

Evaluating the Cost-Benefit of Using Cloud Computing to Extend the Capacity of Clusters Presenter: Xiaoyu Sun.
Consistent Dynamic-group Emotions for Virtual Agents. Abstract The use of computational models of emotion in virtual agents enhances the realism of these.
EHarmony in Cloud Subtitle Brian Ko. eHarmony Online subscription-based matchmaking service Available in United States, Canada, Australia and United Kingdom.
A Service Platform for On-Line Games DebanJan Saha, Dambit Sahu, Anees Shaikh (IBM TJ Watson Research Center, NY) Presented by Gary Huang March 17, 2004.
Analyzing the tradeoffs between breakup and cloning in the context of organizational self-design By Sachin Kamboj.
Geography 465 Overview Geoprocessing in ArcGIS. MODELING Geoprocessing as modeling.
Mr. Perminous KAHOME, University of Nairobi, Nairobi, Kenya. Dr. Elisha T.O. OPIYO, SCI, University of Nairobi, Nairobi, Kenya. Prof. William OKELLO-ODONGO,
Next Generation Domain-Services in PL-Grid Infrastructure for Polish Science. Numerical Simulations of Metal Forming Production Processes and Cycles by.
April 2009 OSG Grid School - RDU 1 Open Science Grid John McGee – Renaissance Computing Institute University of North Carolina, Chapel.
Stuart K. PatersonCHEP 2006 (13 th –17 th February 2006) Mumbai, India 1 from DIRAC.Client.Dirac import * dirac = Dirac() job = Job() job.setApplication('DaVinci',
New Challenges in Cloud Datacenter Monitoring and Management
January 13, 2012 Oscar Lin Steve Leung School of Computing and Information Systems Faculty of Science and Technology Athabasca University, Canada.
EstiNet Network Simulator & Emulator 2014/06/ 尉遲仲涵.
1 Integrating a Network IDS into an Open Source Cloud Computing Environment 1st International Workshop on Security and Performance in Emerging Distributed.
Self-Adaptive QoS Guarantees and Optimization in Clouds Jim (Zhanwen) Li (Carleton University) Murray Woodside (Carleton University) John Chinneck (Carleton.
TECHNOLOGY GUIDE THREE Emerging Types of Enterprise Computing.
Cognitive Interactivity Gina A. Richter Gina A. Richter
Self-Organizing Agents for Grid Load Balancing Junwei Cao Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04)
Abstract Load balancing in the cloud computing environment has an important impact on the performance. Good load balancing makes cloud computing more.
COnvergence of fixed and Mobile BrOadband access/aggregation networks Work programme topic: ICT Future Networks Type of project: Large scale integrating.
Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.
Social Networking and On-Line Communities: Classification and Research Trends Maria Ioannidou, Eugenia Raptotasiou, Ioannis Anagnostopoulos.
Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
University of Zagreb MMVE 2012 workshop1 Towards Reinterpretation of Interaction Complexity for Load Prediction in Cloud-based MMORPGs Mirko Sužnjević,
OPTIMAL SERVER PROVISIONING AND FREQUENCY ADJUSTMENT IN SERVER CLUSTERS Presented by: Xinying Zheng 09/13/ XINYING ZHENG, YU CAI MICHIGAN TECHNOLOGICAL.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
DIS Helsinki University of Technology Multi-Agent System Enhanced Supervision of Process Automation Teppo Pirttioja 1, Antti Pakonen 2, Ilkka.
ASG - Towards the Adaptive Semantic Services Enterprise Harald Meyer WWW Service Composition with Semantic Web Services
20 October 2006Workflow Optimization in Distributed Environments Dynamic Workflow Management Using Performance Data David W. Walker, Yan Huang, Omer F.
Politecnico di Torino Dipartimento di Automatica ed Informatica TORSEC Group Performance of Xen’s Secured Virtual Networks Emanuele Cesena Paolo Carlo.
Multicriteria Driven Resource Management Strategies in GRMS Krzysztof Kurowski, Jarek Nabrzyski, Ariel Oleksiak, Juliusz Pukacki Poznan Supercomputing.
A performance evaluation approach openModeller: A Framework for species distribution Modelling.
Instrumentation of the SAM-Grid Gabriele Garzoglio CSC 426 Research Proposal.
Pavel Slavík, Marek Gayer, Frantisek Hrdlicka, Ondrej Kubelka Czech Technical University in Prague Czech Republic 2003 Winter Simulation Conference December.
Exploiting Context Analysis for Combining Multiple Entity Resolution Systems -Ramu Bandaru Zhaoqi Chen Dmitri V.kalashnikov Sharad Mehrotra.
Tools for collaboration How to share your duck tales…
Application of AI techniques for Computer Games BSc Computer Games Programming, 2006 Julien Delezenne GAMES ARTIFICIAL INTELLIGENCE.
Scalarm: Scalable Platform for Data Farming D. Król, Ł. Dutka, M. Wrzeszcz, B. Kryza, R. Słota and J. Kitowski ACC Cyfronet AGH KU KDM, Zakopane, 2013.
ECE 466/658: Performance Evaluation and Simulation Introduction Instructor: Christos Panayiotou.
Mitigation strategies on scale-free networks against cascading failures Jianwei Wang Adviser: Frank,Yeong-Sung Lin Present by Chris Chang.
Grid Appliance The World of Virtual Resource Sharing Group # 14 Dhairya Gala Priyank Shah.
Big traffic data processing framework for intelligent monitoring and recording systems 學生 : 賴弘偉 教授 : 許毅然 作者 : Yingjie Xia a, JinlongChen a,b,n, XindaiLu.
TECHNOLOGY GUIDE THREE Emerging Types of Enterprise Computing.
4/26/2017 Use Cloud-Based Load Testing Service to Find Scale and Performance Bottlenecks Randy Pagels Sr. Developer Technology Specialist © 2012 Microsoft.
Evolving RBF Networks via GP for Estimating Fitness Values using Surrogate Models Ahmed Kattan Edgar Galvan.
Parameter Sweep and Resources Scaling Automation in Scalarm Data Farming Platform J. Liput, M. Paciorek, M. Wrona, M. Orzechowski, R. Slota, and J. Kitowski.
Towards an IoT Ecosystem Flavia C. Delicato 1, Paulo F. Pires 1, Thais Batista 2, Everton Cavalcante 2, Bruno Costa 1, Thomaz Barros 1 1 Department of.
Application of Maximum Entropy Principle to software failure prediction Wu Ji Software Engineering Institute BeiHang University.
The Global Scene Wouter Los University of Amsterdam The Netherlands.
Efficient Implementation of Complex Interventions in Large Scale Epidemic Simulations Network Dynamics & Simulation Science Laboratory Jiangzhuo Chen Joint.
Mobile Analyzer A Distributed Computing Platform Juho Karppinen Helsinki Institute of Physics Technology Program May 23th, 2002 Mobile.
Architecture for Resource Allocation Services Supporting Interactive Remote Desktop Sessions in Utility Grids Vanish Talwar, HP Labs Bikash Agarwalla,
1 Performance Impact of Resource Provisioning on Workflows Gurmeet Singh, Carl Kesselman and Ewa Deelman Information Science Institute University of Southern.
18 May 2006CCGrid2006 Dynamic Workflow Management Using Performance Data Lican Huang, David W. Walker, Yan Huang, and Omer F. Rana Cardiff School of Computer.
TECHNOLOGY GUIDE THREE
Edinburgh Napier University
SPEEch on the griD (SPEED)
AWS Batch Overview A highly-efficient, dynamically-scaled, batch computing service May 2017.
TECHNOLOGY GUIDE THREE
3 Cloud Computing.
Smart Learning concepts to enhance SMART Universities in Africa
Market-based Dynamic Task Allocation in Mobile Surveillance Systems
Dtk-tools Benoit Raybaud, Research Software Manager.
Cost Effective Presto on AWS
Data Wrangling as the key to success with Data Lake
Quality Management Anita Téringer– ITS Hungary
TECHNOLOGY GUIDE THREE
Presentation transcript:

© EADS 2010 – All rights reserved Force Protection Call 4 A-0938-RT-GC EUSAS European Urban Simulation for Asymmetric Scenarios Scalarm: Massively Self-Scalable Platform for Data Farming

© EADS 2010 – All rights reserved2 Agenda 1.Introduction to Data Farming in the EUSAS project 2.The problem of Data Farming scale 3.Overview of Scalarm 4.Architecture of Scalarm 5.Resource management 6.Scalarm applications 7.Conclusions

© EADS 2010 – All rights reserved3 Goals of data farming in EUSAS During training sessions soldiers perform a mission (scenario).However, if we look closer, the simulation process is more complicated than it seems. Each agent can be parameterized! Agent 1: readiness for aggression - 10, anger - 3, fear - 12, …. Agent 2: readiness for aggression - 10, anger - 10, fear - 2, …. Agents can also be divided into groups! 1. group that loots: group size - 30, aggression of members - 10, readiness for aggression of members group that is prone to violence group size - 12, aggression of members - 10, readiness for aggression of members - 25 Leader of group 1: radius of influence - 10, prestige - 30, … Moreover, groups may have leaders.As a result, many scenarios of mission are possible but soldiers are able to execute mission only a few times during the training session. In EUSAS project data farming provides: Identification of dependences between input parameters and simulation result (described by measures of effectiveness). Comparison of behaviour models/soldiers strategies. Selection of input parameters for training sessions Result of the mission cannot be predicted simply on the basis of the few serious game executions of the scenario. Data farming allows analysis of missions that have several different parameter combinations (possibly billions).

© EADS 2010 – All rights reserved4 Introduction to Data Farming in the EUSAS project Data Farming, in general, enables discovery of useful insights in studied phenomena by providing large amounts of data for analysis. In the context of EUSAS, Data Farming is utilized to study agents’ behaviour in various scenarios in order to verify different engagement strategies. EUSAS developed a novel system, called Scalarm, to facilitate conducting large Data Farming experiments with heterogeneous computational infrastructure.

© EADS 2010 – All rights reserved5 The problem of Data Farming scale – simple scenario Two groups: 1.Looters group 2.Group that is prone to violence Two informal leaders: soldiers do not know who they are Many input parameters: group sizes, leader prestige, readiness for aggression… Many monitored MoEs: escalation, anger, number of killed or injured agents… 1 2 Presented application of data farming system: Identification of dependencies between input parameters and simulation results (described by Measures of Effectiveness).

© EADS 2010 – All rights reserved6 The problem of Data Farming scale Simple simulated scenario can include: 2 individual agents representing group leaders (each with 22 parameters) 2 groups of agents (each group with 24 parameters) => 92 different parameters for a single scenario Let’s suppose we want to check only 2 values for each parameter => 2^92 different simulations Let’s suppose a single simulation runs only for 1 second on average => 157,019,284,536,451,074,949 compute years We need to filter input parameter combinations even more and have a lot of computing power at the backend.

© EADS 2010 – All rights reserved7 Scalarm goals Simulating complex phenomena with multiple input parameters by running various types of simulation applications, e.g. multi-agent, optimization, etc. Self-scalable platform adapting to particular problem size and different simulation types Exploratory approach for conducting Data Farming experiments Supporting online analysis of experiment partial results Running on Cloud, Grid and private cluster infrastructures

© EADS 2010 – All rights reserved8 Scalarm architecture Small experiment Very large experiment Standard experiment Large experiment

© EADS 2010 – All rights reserved9 Resource management Client SM SiM EM SiM Computational resources Platform management resources Free resources Experiment conducting More workload EM SM SiM Workload change: shorter simulations => increase of management overhead SM EM SM EM - worker node EM – Experiment Manager SM – Storage Manager SiM – simulation manager

© EADS 2010 – All rights reserved Scalarm applications - TODO

© EADS 2010 – All rights reserved11 Comparison of behaviour models/soldiers strategies Crowd behaviour depends on many input parameters: Behaviour model/strategy that works well for one parameters’ set may work badly for another. Example: First implementation of soldiers model escalation mean: Soldiers model created with MASDA: escalation mean: Different strategies may be compared in 3 steps: 1.Multiple execution of mission by soldiers (using different strategies). 2.Behaviour cloning. 3.Executing data farming experiment for each cloned strategy. Conclusion: MASDA helped to choose strategies that work well in different conditions.

© EADS 2010 – All rights reserved12 Conclusions 1.To enhance soldiers’ training, a large number of analysis of soldiers’ behaviour in different scenarios is required, thus Data Farming is a crucial module of the project. 1.EUSAS Data Farming module (implemented as Scalarm) constitutes a complete virtual platform for executing interactive Data Farming experiments. 1.Scalarm enables analysts to generate and analyze large amount of data with computer simulation in order to gain useful insight into simulated scenarios.

© EADS 2010 – All rights reserved Thank you for your attention !