A prototypical tool to discover architecture changes based on multiple monitoring data sources for a distributed system Patrick Schäfer, 22.05.2017, Munich.

Slides:



Advertisements
Similar presentations
TSpaces Services Suite: Automating the Development and Management of Web Services Presenter: Kevin McCurley IBM Almaden Research Center Contact: Marcus.
Advertisements

Customer Strategic Presentation March 2010
EVLA Data Processing PDR Proposal Handling Honglin Ye, NRAO.
The Business Value of CA Solutions Ovidiu VALEANU Senior Consultant DNA Software – CA Regional Representative.
Overview SAP Basis Functions. SAP Technical Overview Learning Objectives What the Basis system is How does SAP handle a transaction request Differentiating.
Client/Server Grid applications to manage complex workflows Filippo Spiga* on behalf of CRAB development team * INFN Milano Bicocca (IT)
Introduction to UDDI From: OASIS, Introduction to UDDI: Important Features and Functional Concepts.
Computer Associates Solutions Managing eBusiness Catalin Matei, April 12, 2005
February Semantion Privately owned, founded in 2000 First commercial implementation of OASIS ebXML Registry and Repository.
Department of Veterans Affairs VLER Core Vendor Days 1/24, 1/25.
How to Deploy, Monitor and Manage Middle-Tier Applications Lars Ewe, Principal Product Manager Valerie K. Kane, Group Manager Oracle Corporation Session.
Technology Overview. Agenda What’s New and Better in Windows Server 2003? Why Upgrade to Windows Server 2003 ?  From Windows NT 4.0  From Windows 2000.
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
ASG - Towards the Adaptive Semantic Services Enterprise Harald Meyer WWW Service Composition with Semantic Web Services
Event Management & ITIL V3
Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF Automatic server registration and burn-in framework HEPIX’13 28.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Introduction to EJB. What is an EJB ?  An enterprise java bean is a server-side component that encapsulates the business logic of an application. By.
EJB Enterprise Java Beans JAVA Enterprise Edition
Collection and storage of provenance data Jakub Wach Master of Science Thesis Faculty of Electrical Engineering, Automatics, Computer Science and Electronics.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
© Copyright IBM Corporation 2016 Diagram Template IBM Cloud Architecture Center Using the Diagram Template This template is for use in creating a visual.
International Planetary Data Alliance Registry Project Update September 16, 2011.
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
Project Cumulus Overview March 15, End Goal Unified Public & Private PaaS for GlassFish/Java EE Simplify deployment of Java EE Apps on top of.
Outline Introduction and motivation, The architecture of Tycho,
Pilot Kafka Service Manuel Martín Márquez. Pilot Kafka Service Manuel Martín Márquez.
Chapter 6: Securing the Cloud
Combining Process Mining and Distributed Tracing to Improve Root Cause Analysis Jochen Graeff (B.Sc.), , Munich Advisor: Martin Kleehaus.
DevOps Cloud Native Microservices
Build /26/2018 6:17 AM Building Resilient, Scalable Services with Microsoft Azure Service Fabric Érsek © 2015 Microsoft Corporation.
A Publish/Subscribe Model for Collaborative Project Management in a Decentralized Environment - Design and Prototypical Implementation Michael Rose, 05/11/2015.
OpenLegacy Training Day Four Introduction to Microservices
Master thesis: Automatic Extraction of Design Decision Relationships from a Task Management System Kick-Off Matthias Ruppel, 8th of May 2017, Munich.
Parcel Tracking Solution Parcel Tracking What to look for Architecture
Google App Engine Mandeep Singh (37926)
PA1 Discussion.
Self Healing and Dynamic Construction Framework:
Distributed Tracing Of Microservices
UI-Performance Optimization by Identifying its Bottlenecks
Cloud Management Mechanisms
The Enterprise API Integration Platform Prepared for
Predicting Enterprise Application Performance Measures through Time-series Forecasting Daniel Elsner, 21st August 2017, Scientific advisor: Pouya Aleatrati.
A prototypical tool to discover architecture changes based on multiple monitoring data sources for a distributed system Patrick Schäfer, , Munich.
Introduction to Microservices Prepared for
Introduction to J2EE Architecture
Microservices Diagram Template
Management of Virtual Execution Environments 3 June 2008
Replication Middleware for Cloud Based Storage Service
Practical Choreography with Spring Cloud
Identification of Cross-Blockchain Transactions: A Feasibility Study
Securing Cloud-Native Applications Jason Schmitt CEO
DUCKS – Distributed User-mode Chirp-Knowledgeable Server
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Enhancing enterprise architecture models using application monitoring data Christopher Janietz, 2018/04/23, Advanced Seminar (Advisor: Martin Kleehaus)
Web Application Architectures
Introduction to Apache
Software Architecture
Software models - Software Architecture Design Patterns
autodiscoverable microservices with vertx3
End to End Monitoring Solution using Open Source Technology where webMethods 9.10 is used as ESB IBM Confidential.
JINI ICS 243F- Distributed Systems Middleware, Spring 2001
Guided Research: Intelligent Contextual Task Support for Mails
Enhancing enterprise architecture models using application monitoring data Christopher Janietz, 2018/10/12, Advanced Seminar (Advisor: Martin Kleehaus)
Web Application Architectures
Sending data to EUROSTAT using STATEL and STADIUM web client
Master’s Thesis – Kick-off presentation Assessing the cost and benefit of a microservice landscape discovery method in the automotive industry Advisor:
Bachelor’s Thesis Kick-Off: Empirical Task Analysis of Data Protection Management Michael Vilser
Presentation transcript:

A prototypical tool to discover architecture changes based on multiple monitoring data sources for a distributed system Patrick Schäfer, 22.05.2017, Munich Advisor: Martin Kleehaus

Outline Motivation Research Questions Approach Timeline Modeled & Runtime Architecture Problem Statement Research Questions Approach Architecture Discovery Idea Discovery System Environment User Interface Mockups Limitations Timeline 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Motivation Modeled Enterprise Architecture Business Process Model S 4 S 8 S 1 S 3 S 6 S 9 S 2 S 5 S 7 Component Model VM VM VM VM Infrastructure Model 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Motivation Runtime architecture Necessity of knowledge about runtime architecture Detecting deviations from modeled architecture Compliance violations / SLA violations Semi-automated root cause analysis Semi-automated Impact analysis State of the art solution Application Runtime Architecture Discovery A1 A2 V A3 A4 A5 Business Process Model S 1 S 4 S 2 S 5 S 6 S 3 S 7 S 9 S 8 Component Model Infrastructure Model S 1 S 4 S 2 S 5 S 6 S 3 S 7 S 9 S 8 Discovered Components Architecture discovery by distributed tracing VM Discovered Infrastructure 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Motivation Problem statement Problem: Current discovery solutions don‘t own knowledge about the entire architecture including dependencies between and within the architectual layers Interlayer dependencies between components and business activities unknown Intralayer dependencies on infrastructure layer unknown Consequences comparison of modeled and runtime architecture not possible across all layers root cause analysis is challenging and time consuming Incomplete impact analysis Objective a system, that owns knowledge about all realtime architecture components as well as their inter- and intralayer dependencies S 1 S 4 S 2 S 5 S 6 S 3 S 7 S 9 S 8 Discovered Components Discovered Infrastructure ? A1 A2 V A3 A4 A5 Business Process Model 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Research questions 1 How to discover the Microservice Architecture by applying distributed tracing? What are component relationship types and how to discover them automatically? How to discover concurrency and synchronization? How to recognize changes in the Microservice Architecture? How to categorize services regarding their target purpose? How to provide a smart user interface for adding business semantic on top of business services? 2 3 4 5 6 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Approach Architecture Discovery Idea Continuous architecture discovery by utilizing multiple data sources System Monitoring Registry Service data Architecture Discovery System Distributed Tracing data Server logs / configurations S 1 S 4 S 2 S 5 S 6 S 3 S 7 S 9 S 8 Discovered Components Discovered Infrastructure ? A1 A2 V A3 A4 A5 Business Process Model VM VM VM 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Approach Architecture Discovery Idea Continuous architecture discovery by utilizing multiple data sources + Business semantic by semi-automated way System Monitoring User Interface Registry Service data Architecture Discovery System Business Process Model Distributed Tracing data Assign requests to activities Server logs / configurations S 1 S 4 S 2 S 5 S 6 S 3 S 7 S 9 S 8 Discovered Components Discovered Infrastructure VM A1 A2 V A3 A4 A5 Business Process Model VM VM 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Approach Discovery System Environment Gateway Service Zuul Registry Service Eureka Architecture Discovery Frontend REST API REST API Registry Client REST API Registry Client Microservice Spring Boot Microservice Spring Boot REST API Architecture Discovery System Storage DT Client Zipkin DT Client Zipkin Message Stream Kafka Architecture Change Notifier Distributed Tracing Server Zipkin Storage 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis 9

Approach User Interface Mockup 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Approach User Interface Mockup 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Timeline May June July August September October Approach Literature / Research Prototype Concept Prototype Implementation Thesis Writing Review / Print Infrastructure Architecture discovery system Thesis Submission Today Semantic Input Architecture discovery frontend 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

B.Sc. Patrick Schäfer patrick.schaefer@tum.de

Backup

Approach Resulting datastructure Dependency Structure Matrix (t) Foundation for automated detection of architecture changes comparison of modeled and runtime architecture root cause analysis impact analysis Dependency Structure Matrix (t+1) Dependency Structure Matrix (t+2) 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Approach Discovery data source: Server logs / configurations Load balancer Eureka Service Registry Architecture Discovery FE REST API Registry Client REST API Registry Client REST API Microservice Microservice Architecture Discovery System Storage Logstash Server Logstash server ElasticSearch REST API 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis

Approach User interface mockup 170522 Schäfer, Patrick - Master's Thesis kickoff presentation © sebis