Use Case #2: Large Events

Slides:



Advertisements
Similar presentations
What is Cloud Computing? Massive computing resources, deployed among virtual datacenters, dynamically allocated to specific users and tasks and accessed.
Advertisements

SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.
The FI-WARE Project – Base Platform for Future Service Infrastructures OCTOBER 2011 Presentation at proposers day.
Undergraduate Poster Presentation Match 31, 2015 Department of CSE, BUET, Dhaka, Bangladesh Wireless Sensor Network Integretion With Cloud Computing H.M.A.
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
Scalable Server Load Balancing Inside Data Centers Dana Butnariu Princeton University Computer Science Department July – September 2010 Joint work with.
11 SERVER CLUSTERING Chapter 6. Chapter 6: SERVER CLUSTERING2 OVERVIEW  List the types of server clusters.  Determine which type of cluster to use for.
Software to Data model Lenos Vacanas, Stelios Sotiriadis, Euripides Petrakis Technical University of Crete (TUC), Greece Workshop.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment.
Presenter: Dipesh Gautam.  Introduction  Why Data Grid?  High Level View  Design Considerations  Data Grid Services  Topology  Grids and Cloud.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
Other Quality Attributes Other Important Quality attributes Variability: a special form of modifiability. The ability of a system and its supporting artifacts.
Question To know that quality has improved, it would be helpful to be able to measure quality. How can we measure quality?
Advanced Computer Networks Topic 2: Characterization of Distributed Systems.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
11 CLUSTERING AND AVAILABILITY Chapter 11. Chapter 11: CLUSTERING AND AVAILABILITY2 OVERVIEW  Describe the clustering capabilities of Microsoft Windows.
Virtual Classes Provides an Innovative App for Education that Stimulates Engagement and Sharing Content and Experiences in Office 365 MICROSOFT OFFICE.
NCP Info DAY, Brussels, 23 June 2010 NCP Information Day: ICT WP Call 7 - Objective 1.3 Internet-connected Objects Alain Jaume, Deputy Head of Unit.
The FI-WARE Project – Base Platform for Future Service Infrastructures FI-WARE OCTOBER 2011 Presentation at proposers day.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
Saahithi Chillara Radhika Goyal ECE Fall Senior Design Project.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Demonstration StratusLab First.
An Introduction to SaaS and Cloud Computing Ross Cooney.
LOGO Supervisor: Mr.Huỳnh Anh Dũng Students: Nguyễn Công Tuyến Nguyễn Cảnh Phương Phạm Thị Hằng Bùi Thị Huệ Trần Đức Bình Nguyễn.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.
Advancing National Wireless Capability Date: March 22, 2016 Wireless Test Bed & Wireless National User Facility Paul Titus Department Manager, Communications.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement n° iGrid Aron Kondoro.
RESERVOIR Service Manager NickTsouroulas Head of Open-Source Reference Implementations Unit Juan Cáceres
CompSci 280 S Introduction to Software Development
Chapter 1 Characterization of Distributed Systems
George Kurtanidze, Head of FAS
Connected Infrastructure
ICT22 – 2016: Technologies for Learning and Skills ICT24 – 2016: Gaming and gamification Francesca Borrelli DG CONNECT, European Commission BRUXELLES.
Organizations Are Embracing New Opportunities
Connected Living Connected Living What to look for Architecture
George Kurtanidze, Head of FAS
Smart Building Solution
Connected Maintenance Solution
Joslynn Lee – Data Science Educator
INTAROS WP5 Data integration and management
Integrated Management System and Certification
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Cloud Adoption Framework
Smart Building Solution
Connected Maintenance Solution
Connected Living Connected Living What to look for Architecture
Work Package 2 Interactions with Targeted Communities
Connected Infrastructure
Physical Architecture Layer Design
AWS COURSE DEMO BY PROFESSIONAL-GURU. Amazon History Ladder & Offering.
RESEARCH, EDUCATION, AND TRAINING FOR THE SMART GRID
Get Enterprise-Grade Call Handling and Control for Microsoft Office 365 and Skype for Business with the Bridge Boss-Admin Executive Console OFFICE 365.
Technical Capabilities
Reportin Integrates with Microsoft Office 365 to Provide an End-to-End Platform for Financial Teams That Simplifies Report Creation and Management OFFICE.
Scientific and Technical Overview
High Performance Computing Center – HLRS
Project Overview Konstantinos Tserpes, ICCS/NTUA Final Review Meeting
Use Case #1: Mobile Virtual Desktop
Requirements Definition
Windows Azure Hybrid Architectures and Patterns
Pitch Deck.
Harrison Howell CSCE 824 Dr. Farkas
WP6 – EOSC integration J-F. Perrin (ILL) 15th Jan 2019
VIFI : Virtual Information Fabric for Data-Driven Discovery from Distributed Fragmented Repositories PI: Dr. Ashit Talukder Bank of America Endowed Chair.
What is UiPATH? For more details visit this link online-training.
Presentation transcript:

Use Case #2: Large Events Antonia Schwichtenberg, CAS Richard Wacker, YM and Jamie Marshall, AMEN October 10, 2018 Seoul

BASMATI Final Review meeting Outline Introduction Requirements and Challenges Architecture of the solution BASMATI Contribution Simulation of the real DAS FEST demonstrator Evaluation results 10/10/2018 BASMATI Final Review meeting 2

BASMATI Final Review meeting Main Goal & Objectives Goal: Provide DAS FEST with more insight into the dynamics of people‘s movement under varying conditions (running order, weather, train arrivals,…) Objective: Providing stable, easy to use and cost effective monitoring of asynchronous crowd density By BASMATIzing edge and backend Provide one management interface for edge and backend Provide cloud-based backend resources Adjust resources to meet the current demand at any time 10/10/2018 BASMATI Final Review meeting 4

BASMATI Final Review meeting Requirements and Challenges Environmental Challenges and Requirements: Up to 180.000 visitors at peak times, ~ 250.000 in total Challenging characteristics of the area (topology, technical constraints) Overloaded mobile infrastructure Hard conditions regarding other modes of connectivity Organizational and financial challenges Hard budget limitations as ticket price are and shall be low Simple and reliable – voluntary non-professionals in the DAS FEST team 10/10/2018 BASMATI Final Review meeting 4

BASMATI Final Review meeting Requirements and Challenges Environmental Challenges and Requirements: Up to 180.000 visitors at peak times, ~ 250.000 in total Challenging characteristics of the area (topology, technical constraints) Overloaded mobile infrastructure Hard conditions regarding other modes of connectivity Organizational and financial challenges Hard budget limitations as ticket price are and shall be low Simple and reliable – voluntary non-professionals in the DAS FEST team 10/10/2018 BASMATI Final Review meeting 4

BASMATI Final Review meeting Requirements and Challenges Environmental Challenges and Requirements: Up to 180.000 visitors at peak times, ~ 250.000 in total Challenging characteristics of the area (topology, technical constraints) Overloaded mobile infrastructure Hard conditions regarding other modes of connectivity Organizational and financial challenges Hard budget limitations as ticket price are and shall be low Simple and reliable – voluntary non-professionals in the DAS FEST team 10/10/2018 BASMATI Final Review meeting 4

BASMATI Final Review meeting Localization of the Pis 10/10/2018 BASMATI Final Review meeting 7

BASMATI Final Review meeting Application workflow 10/10/2018 BASMATI Final Review meeting 8

BASMATI Final Review meeting Architecture Control Raw data VPN for bulk wifi data - On site at das fest the basmati platform on a hardware machine controls a set of raspberry pis. In the cloud, the basmati platform in a virtual machine controls all aspects of application resource deployment. One scalability engine allocates pis for wifi data sensing at strategic places on the festival site. The other scaling engine responds to signals from the load balancer to accommodate trilateration with real-time signal load. Raw wifi sensing data is transmitted by the pis to the on-site BASMATI and from there it is send over a satellite in bulk to the Basmati Cloud. The clustering signals components pulls the wifi data from the BASMATI cloud, groups it by MAC address and time period and sends it to the load balancer who makes it available to the trilaterators upon request. Trilaterators are calculating the geo positions of single festival users (i.e. MAC addresses) by means of the different wifi signal strengths perceived by the pis. The geo positions are stored in a Mongo DB from where the visualization reads the time coordinated data. The monitoring component allows real time KPI observation of monitoring data provided by BASMATI cloud. Processed data Monitoring data 10/10/2018 BASMATI Final Review meeting 10

BASMATI Final Review meeting Application creation 10/10/2018 BASMATI Final Review meeting 10

BASMATI Final Review meeting Full application deployment 10/10/2018 BASMATI Final Review meeting 11

BASMATI Final Review meeting Monitoring 10/10/2018 BASMATI Final Review meeting 12

BASMATI Final Review meeting WiFi data 10/10/2018 BASMATI Final Review meeting 13

BASMATI Final Review meeting Unique MAC addresses 22nd of July 2018 10/10/2018 BASMATI Final Review meeting 14

BASMATI Final Review meeting Visualization 10/10/2018 BASMATI Final Review meeting 15

BASMATI Final Review meeting BASMATI contribution BEAM and Application Repository Description of hardware and software requirements relevant for the automatic deployment of all components Decision maker Generate deployment plan Knowledge Extractor Prediction of hardware resource demand Application controller deploy/undeploy/start/stop/scale up/scale down app component 10/10/2018 BASMATI Final Review meeting 16

BASMATI Final Review meeting BASMATI contribution Cloud Provider management Provisioning of cloud resources Federation management Communication and management of heterogeneous resources Cloud and edge resource management Edge controller Deployment of Wi-Fi collectors on edge devices Budamaf Encryption and storage of signals 10/10/2018 BASMATI Final Review meeting 17

BASMATI Final Review meeting 10/10/2018 BASMATI Final Review meeting 18

BASMATI Final Review meeting Evaluation methods Interviews Automated tests and manual tests Performance measurements Monitoring metrics Component level evaluation Added value Technical aspects evaluation Mapping and fulfillment of project objectives 10/10/2018 BASMATI Final Review meeting 19

BASMATI Final Review meeting Evaluation criteria Functional suitability Functional completeness Functional correctness Performance Time behaviour Resource utilization Compatibility Interoperability Modularity Adaptability Usability Recognisability Learnability Operability User error protection User interface design Reliability Availability Monitoring Fault tolerance Recoverability Security Data storage Data transport System administration Maintainability Analysability Modifiability Testability Installability Overall Documentation 10/10/2018 BASMATI Final Review meeting 20

BASMATI Final Review meeting Evaluation results Functional suitability: very good Performance: excellent Time behaviour: Transferring and computing over 7 million single data sets (~1GB of data) in these 3 days was not an issue Resource utilization: on-site: 8GB RAM, 4 Cores, 1TB disk (not used completely), in the cloud: 4GB, 2 cores, 40GB disk Mean time to provision new instance and deploy trilaterator: 50 sec Mean time to scale trilaterator: 1min 41 sec Compatibility: good 10/10/2018 BASMATI Final Review meeting 21

BASMATI Final Review meeting Evaluation results Usability: UI Design could be improved Reliability: excellent 100% availability Security: All security requirements for the demo fulfilled Maintainability: good Overall Ease of use: could be improved Usefulness: Very useful Documentation: Available, but distributed over many sources 10/10/2018 BASMATI Final Review meeting 22

BASMATI Final Review meeting Evaluation results Overall the use case development, deployment and operation with BASMATI was compared to other solutions very efficient and reliable. Support from BASMATI partners was necessary for the first deployment but could be done by any dev-op in the future. Some graphical interfaces could be improved but all relevant functionality was available. 10/10/2018 BASMATI Final Review meeting 23

BASMATI Final Review meeting Acknowledgements: This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement no. 723131 and from ICT R&D program of Korean Ministry of Science, ICT and Future Planning no. R0115-16-0001. Visit us: www.basmati.cloud 10/10/2018 BASMATI Final Review meeting 34