DataHub Product Overview Cover example with photo inside the shape

Slides:



Advertisements
Similar presentations
School Management Tracking Solutions
Advertisements

Tableau Software Australia
Copyright © 2006 Help Desk Systems, Inc. All rights reserved. Overview of Help Desk Systems Inc. (HDSI) HDSI offers a hosted, web based trouble ticket.
SSRS 2008 Architecture Improvements Scale-out SSRS 2008 Report Engine Scalability Improvements.
Information Retrieval in Practice
Event Processing Course Event processing networks (relates to chapter 6)
Technical solution presentation AVL System for Fire Brigades.
Check Disk. Disk Defragmenter Using Disk Defragmenter Effectively Run Disk Defragmenter when the computer will receive the least usage. Educate users.
Date: 18 February 2008 Federal Aviation Administration Collaborative Decision Making at the FAA/ATO A look at how CDM is applied in the U.S.
Cube Enterprise Database Solution presented to MTF GIS Committee presented by Minhua Wang Citilabs, Inc. November 20, 2008.
. Center TRACON Automation System (CTAS) Traffic Management Advisor (TMA) Transportation authorities around the globe are working to keep air traffic moving.
Miami International Airport’s Integrated Airport Management System
© Paradigm Publishing Inc. 9-1 Chapter 9 Database and Information Management.
Module 7: Fundamentals of Administering Windows Server 2008.
© Paradigm Publishing Inc. 9-1 Chapter 9 Database and Information Management.
Enterprise Integration Patterns CS3300 Fall 2015.
Mark E. Fuller Senior Principal Instructor Oracle University Oracle Corporation.
1 Do You Need an ETL Tool? Ben Bor NZ Ministry of Health Ben Bor NZ Ministry of Health.
Chapter 4: server services. The Complete Guide to Linux System Administration2 Objectives Configure network interfaces using command- line and graphical.
Identify internal hardware devices (e. g
Information Retrieval in Practice
WHY VIDEO SURVELLIANCE
Connected Infrastructure
AODB/RMS and FIDS New Features
Running a Forms Developer Application
B1. PROPworks® New Features Cover example with photo inside the shape
Smart Building Solution
Streamline Functionality for Creating and Managing New Rates
Amadeus Ticket Changer Refund
B9. Requirements Gathering Session
PW Steering Committee April Cover example with photo
Miami International Airport’s PROPworks and AOIS Upgrade Project
New Features in PROPworks Portal
SSL Setup Making PROPworks® Applications Secure
PROPworks ESB Financial Interface
Open Source distributed document DB for an enterprise
Baggage Messaging Solutions
Lightning Talks Bill Rule Check Report
Cash Posting Topics Learn how you can address some special cases in the Invoice to Payment process using the Cash Posting Module Cover example with photo.
Smart Building Solution
Amadeus Queue Manager Amadeus Business Management Platform
Connected Infrastructure
EASE – New Features Cover example with photo as background
CHAPTER 3 Architectures for Distributed Systems
Features and Highlights
Using Agreement Templates with Workflow
Transitioning to Rate Tables
Migration Strategies – Business Desktop Deployment (BDD) Overview
SMART GROUND platform overview
Use Cases & User Mocks Customer Call –
Chapter 9 Database and Information Management.
Overview of big data tools
Product Overview.
AWS Cloud Computing Masaki.
WHY VIDEO SURVELLIANCE
Data Warehousing Concepts
Introducing Citilabs’ Scenario Based Master Network Data Model
Performance And Scalability In Oracle9i And SQL Server 2000
Seminarium Amadeus Merchant Content
Field installable, upgradeable and scaleable
Product Overview.
Operational Context and Use Case Focus Group
Operational Context and Use Case Focus Group
Operational Context and Use Case Focus Group
Net Report Statistics Dashboard Summary
Presentation transcript:

DataHub Product Overview Cover example with photo inside the shape Insert new photo: Click on Insert photo-icon on slide and Insert new photo Use Crop Tool under Picture Tools to pan and zoom Beware: when you add or replace a picture, it may come to the front. Right click on it and select ‘Send to back’ to re-arrange it. To update the text, just click on the text To get more slides with this layout just copy this slide and paste Please insert the other company’s logo in the same size as the Amadeus logo, with no background and reverse out colour © Amadeus IT Group and its affiliates and subsidiaries Jorge Jarrin; Lead Developer, AODB Clinton Aurin; Solution Design Engineer Amadeus Airport IT Americas, Inc. – 2017 User Conference

What is the DataHub and what motivated its development. Major Features. How does the system work? Design Goals. System Overview. FAA Feeds. Airline Feeds. Airlines. Other Data Sources. © Amadeus IT Group and its affiliates and subsidiaries

DataHub: Definition and Motivation © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

DataHub: Definition and Motivation Past strategy consists of interfacing directly with operational data sources. Costly and time consuming to maintain as our software install base grows. Linking different feeds (FAA and airlines) into one ‘hub’ provides useful aggregated data. This system consumption and dissemination of operational data from a centralized location. In a nutshell: It consumes data from N number of external sources, processes and persists data, and provides an enriched fusion of useful data. © Amadeus IT Group and its affiliates and subsidiaries

2. Major Features © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

Major Features Centralized processing of major airline and flight data sources (FAA). Extremely fast on-ramping of new installation sites. Centralized monitoring, and command and control. High performance and scalable data processing. Rapid addition of new input and output nodes. To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

3. How does it work? Divider example with no photo You can change the colour to Amadeus blue, Light Blue and Pale Blue To update the text, just click on the text To get more slides with this layout just copy this slide and paste © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

How does it work? Consuming input data: Raw data in any format from any transport. Pre-processing data: Build unique keys (identifiers) from raw data. Filtering data: What data is relevant for processing based on criteria. Data normalization: Relevant information is reformed into a coherent model. Data cache: Semi-persistent In-memory cache of data for fast queries. Outbound data: Live subscription mechanism for interested consumers. Dataset requests: Bulk requests from the central cache. To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

How does it work? Volatile high volume data: High throughput data feeds (5000+ transaction/s) System administration: CLI based administration console. System monitoring: Health and status of topologies deployed. Permanent Storage: Traditional SQL database storage for reporting and BI. Watchdog mechanisms: To monitor hung processes/nodes. To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

4. Design Goals Divider example with no photo You can change the colour to Amadeus blue, Light Blue and Pale Blue To update the text, just click on the text To get more slides with this layout just copy this slide and paste © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

Design Goals The system should be one thing about all others: FAST. Typical transaction should not take more than 10 milliseconds. Each component in the system has an error recovery strategy. Horizontally scalable across N-number of nodes. Utilization of HTTPS/SSL standards where available. To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

5. System Overview Divider example with no photo You can change the colour to Amadeus blue, Light Blue and Pale Blue To update the text, just click on the text To get more slides with this layout just copy this slide and paste © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

Centralized Storage/Cache System Overview External Data Sources Inbound Node Inbound Node Inbound Node Inbound Data Centralized Storage/Cache Central Cache To update the text, just click on the text More slides with this layout: Copy slide and paste Outbound Node Outbound Node Data Delivery External Consumer External Consumer © Amadeus IT Group and its affiliates and subsidiaries Data Query Dataset Servicer

Centralized Storage/Cache System Overview External Data Sources Inbound Node Inbound Node Inbound Node Inbound Data Centralized Storage/Cache Central Cache To update the text, just click on the text More slides with this layout: Copy slide and paste Outbound Node Outbound Node Data Delivery External Consumer External Consumer © Amadeus IT Group and its affiliates and subsidiaries Data Query Dataset Servicer

System Overview Inbound Data Route Ingress Hash Filter Data Enrichment Variety of transports. VFS, JMS, CSV, etc. Hot-cache mapping. Used for records diffs. Record aggregation and versioning. Key Extraction Data Extraction Serialization Unique identifying key for records. Dynamic filtering. To update the text, just click on the text More slides with this layout: Copy slide and paste Raw data to normalized data. JSON format for storage in in-memory database. © Amadeus IT Group and its affiliates and subsidiaries

Centralized Storage/Cache System Overview External Data Sources Inbound Node Inbound Node Inbound Node Inbound Data Centralized Storage/Cache Central Cache To update the text, just click on the text More slides with this layout: Copy slide and paste Outbound Node Outbound Node Data Delivery External Consumer External Consumer © Amadeus IT Group and its affiliates and subsidiaries Data Query Dataset Servicer

System Overview Central Cache Inbound Pipe Key Calculation To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries Outbound Pipe

Centralized Storage/Cache System Overview External Data Sources Inbound Node Inbound Node Inbound Node Inbound Data Centralized Storage/Cache Central Cache To update the text, just click on the text More slides with this layout: Copy slide and paste Outbound Node Outbound Node Data Delivery External Consumer External Consumer © Amadeus IT Group and its affiliates and subsidiaries Data Query Dataset Servicer

System Overview Data Delivery Subscriber Channels Arrival Channel Departure Channel Read Data from Channel Fetch Data Payload from Key To update the text, just click on the text More slides with this layout: Copy slide and paste Invoke Subscriber Endpoint © Amadeus IT Group and its affiliates and subsidiaries VPN/External Network ESB/Consumer

Centralized Storage/Cache System Overview External Data Sources Inbound Node Inbound Node Inbound Node Inbound Data Centralized Storage/Cache Central Cache To update the text, just click on the text More slides with this layout: Copy slide and paste Outbound Node Outbound Node Data Delivery External Consumer External Consumer © Amadeus IT Group and its affiliates and subsidiaries Data Query Dataset Servicer

System Overview Data Query Capable of limiting requests to prevent excessive resource utilization. Capable of producing a set of keys to produce relevant data from the in- memory database. Queries are limited by potential key-space in order to manage memory. To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

System Overview Control mechanism: Command line interface (CLI) Command and Control Control mechanism: Command line interface (CLI) Capability to dynamically start and stop routes. Monitor the simple status of routes and runtime components. Manage cluster priorities and route assignments. Manage and modify subscription information. Provide remote access to logs and error messages. Provide basic data query mechanisms. To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

System Overview Monitoring and Alarming See fine grained statistics per route per interface, including message/second metrics and error counts. Defines alarms and alert outcomes based on the emitted metrics. Provides a simple real-time graph to show system load and throughput. To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

System Overview Monitoring and Alarming To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

System Overview Monitoring and Alarming To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

6. FAA Feeds Divider example with no photo You can change the colour to Amadeus blue, Light Blue and Pale Blue To update the text, just click on the text To get more slides with this layout just copy this slide and paste © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

FAA Feeds Positional Track Updates (1/min.) TFMS (Traffic Flow Management System) Positional Track Updates (1/min.) Position/Speed/Altitude (We Calculate Heading) Airspace ETA, ATA, ATD Callsign, Departure/Arrival Airport Routes (Airspace Routes) Flight Cancellations To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

FAA Feeds TFMS (Traffic Flow Management System): Example "metadata": { "aircraftId": "JBU148", "airlineCode": "JBU", "arrivalAirport": "OAK", "departureAirport": "LGB", "flightRef": "LGB:OAK:32875214", "operationTime": "2017-04-07", "source": "TFMS" }, "data": { "id": "LGB:OAK:32875214", "eta": "2017-04-07T15:04:59+0000", "lon": -118.58333333333333, "speed": "266", "alt": "080", "bearing": 0.0, "timeAtPosition": "2017-04-07T14:13:37+0000", "type": "HCS_TRACK_MSG", "lat": 33.95, "airline": "JBU" } To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

FAA Feeds Same as TFMS, but Update 1/10 sec. Registrations FDPS (Flight Data Publication Service) Same as TFMS, but Update 1/10 sec. Registrations To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

FAA Feeds FDPS (Flight Data Publication Service) : Example "metadata": { "aircraftId": "SWA1538", "arrivalAirport": "KSNA", "departureAirport": "KOAK", "operationTime": "2017-04-07", "source": "FDPS" }, "data": { "eta": "2017-04-07T14:21:00+0000", "ractCode": "B737", "etd": "2017-04-07T13:10:00+0000", "registration": "N952WN", "originDate": "2017-04-07", "atd": "2017-04-07T13:18:00+0000" } To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

FAA Feeds Update Rate 1/sec. STDDS (SWIM Terminal Data Distribution System) Update Rate 1/sec. ‘Spot Out’ – Ramp to Movement Area Transition ‘Spot In’ – Movement Area to Ramp Transition ATA, ATD, Mode-S Address, Callsign, Aircraft Type Runway Assignment Wake Turbulence Category Position/Speed/Heading/Altitude Aircraft Type RVR Status To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

FAA Feeds TRACON Precipitation (Graphical Data Run Length Encoded) ITWS (Integrated Terminal Weather System) TRACON Precipitation (Graphical Data Run Length Encoded) To update the text, just click on the text More slides with this layout: Copy slide and paste © Amadeus IT Group and its affiliates and subsidiaries

7. Airline Feeds Divider example with no photo You can change the colour to Amadeus blue, Light Blue and Pale Blue To update the text, just click on the text To get more slides with this layout just copy this slide and paste © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

Airline Feeds Airline Name* Flight Number* STA* Registration* ETA* Data Types Airline Name* STA* ETA* ATA Onblock* STD* ETD* ATD Offblock* Flight Number* Registration* Origin Date* Aircraft Type* Departure Airport* Arrival Airport* Arrival Leg Status Departure Leg Status © Amadeus IT Group and its affiliates and subsidiaries * Preferred Data

Airline Feeds Departure Gate Codeshares Aircraft Sub Type Arrival Gate Data Types (cont.) Departure Gate Arrival Gate Departure Terminal Arrival Terminal Fleet ID Departure Belt Arrival Bag Claim Trip Number Codeshares Aircraft Sub Type Service Type Departure Spot Arrival Spot Passenger Information Weight Class Estimated Touchdown International Status © Amadeus IT Group and its affiliates and subsidiaries

Airline Feeds Emaples "metadata": { "sta": "2017-04-08T00:31:00+0000", "airline": "AS", "arrivalAirport": "OAK", "departureAirport": "SEA", "originDate": "2017-04-07", "source": "AS", "tripNumber": "538" }, "data": { "aircraftSubType": "9WX", "eta": "2017-04-08T00:31:00+0000", "tripNumber": "538", "tailNumber": "303", "aircraftType": "739", "sta": "2017-04-08T00:31:00+0000", "etd": "2017-04-07T22:35:00+0000", "std": "2017-04-07T22:35:00+0000", "flightNumber": "AS538", "registration": "N303AS", "serviceType": "J", "originDate": "2017-04-07", "internationalStatus": "D", "departureAirport": "SEA", "arrivalAirport": "OAK", "airline": "AS", "arrivalGate": "14", "arrivalBelt": "1", "arrivalSpot": "14" } © Amadeus IT Group and its affiliates and subsidiaries

8. Airlines Divider example with no photo You can change the colour to Amadeus blue, Light Blue and Pale Blue To update the text, just click on the text To get more slides with this layout just copy this slide and paste © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

Airlines Airlines on DataHub © Amadeus IT Group and its affiliates and subsidiaries

Airlines Airlines in the works © Amadeus IT Group and its affiliates and subsidiaries

9. Other Data Sources Divider example with no photo You can change the colour to Amadeus blue, Light Blue and Pale Blue To update the text, just click on the text To get more slides with this layout just copy this slide and paste © Amadeus IT Group and its affiliates and subsidiaries © Amadeus IT Group and its affiliates and subsidiaries

Other Data Sources All Other Data Sources © Amadeus IT Group and its affiliates and subsidiaries

Thank you! AmadeusITgroup amadeus.com amadeus.com/blog © Amadeus IT Group and its affiliates and subsidiaries amadeus.com amadeus.com/blog You can follow us on: AmadeusITgroup