1. When Big Data Meets Fast Data
23 November 2016
When Big Data Meets Fast Data
- Paris 2016
Nicolas Baret
Senior Pre-Sales Consultant

2. When Big Data Meets Fast Data
The Evolution of Hadoop
Enterprise ready
From batch to real-time
Now add Cloud
It’s all About the Architecture
Lambda / Kappa
How Change Data Capture (CDC) Enables Big and Fast Data

3. The Evolution of Hadoop
The First 10 Years
Operationalising Hadoop
Real-time and streaming
Hadoop and the cloud
Compose automates the DW process to enable agile BI and tighter collaboration between IT and the business. This entails three primary benefits: accelerating DW projects, optimizing the DW process and reducing risk.

4. Operationalising Hadoop
Hadoop has won the battle
Moved out of Dev and Test
Enterprise demands more
Closer to production
Business impact
Sqoop
Financial Services Use Case
1000+ business applications
Classic data lake
Moved to level 3 infrastructure supporting level 1 applications

5. The Evolution of Hadoop
The First 10 Years
Operationalising Hadoop
Real-time and streaming
Hadoop and the cloud
The second primary benefit of Attunity Compose is optimizing the DW process.

6. Real-time Streaming with Kafka
Real-time processing
Real-time monitoring
Real-time Hadoop
Big and Fast Data
Scalable to 1000’s applications
Online Retail – Use Case
Streaming Data to Kafka
Multiple data Feeds
Multiple data Consumers
Online Credit card transaction failure
 Under 20 seconds a real person calling you back and helping with the transaction

7. The Evolution of Hadoop
The First 10 Years
Operationalising Hadoop
Real-time and streaming
Hadoop and the cloud
The final major benefit of Attunity Compose is risk reduction.

8. Combining Hadoop and the Cloud
Targets
Sources
On Premises
Cloud Platform
Hadoop
RDBMS
Data Warehouse
Replicate provides a single centralized solution for both the enterprise and the Cloud. You are able to configure, manage and monitor the movement of data to Amazon Web Services, Microsoft Azure and Google Cloud using the same user interface.

9. Universal Data Availability
Fortune 100 automotive maker
Results
Consolidating massive data volumes for global analytics
Hadoop Data Lake with Kafka
Minimising labour and cost
Realising faster insights and competitive advantage
4500 applications
DB2 MF
SQL
Oracle

10. The Evolution of Hadoop
Operationalising Hadoop
Financial services – enterprise use cases
Real-time and streaming
Online retail – customer success
Hadoop and the cloud
Global Data Lake
The final major benefit of Attunity Compose is risk reduction.

11. It’s all About the Architecture
Lambda or Kappa

12. What is Lambda / Kappa ? The Speed/Event Layer The Batch Layer
Has the Stream Processing Architecture where we will be processing the Streaming data
The Batch Layer
Holds all the historical Data - has two functions:
Managing the master dataset (an immutable, append-only set of raw data)
To pre-compute the batch views
The Serving Layer
Simply queries the batch and real-time views and merges them

13. What is Lambda?
Lambda architecture describes a system consisting of three layers:
Batch processing
Speed (or real-time) processing,
Serving layer for responding to queries

14. Lambda – Batch, Speed, Server
Speed Layer
Server Layer
Query1 n 2
Query2
Batch Layer
Data Feeds
View1 n 2 1
View2
View3

15. Kappa –Speed, Server then Batch
Server Layer
Speed Layer
Query1 n 2
Query2
Batch Layer
Data Feeds
View1 n 2 1
View2
View3

16. MapR - Architecture

17. How Change Data Capture (CDC) Enables Big and Fast Data
With Attunity Replicate

18. CDC Enables the Flow  Kafka  Streams
In memory optimised metadata management and data transport
CDC
Data Streaming
JSON data
format
MSG n 2 1
Message
broker
Transaction logs
Bulk Load
Data Streaming
JSON data format
MSG n 2 1
Message
broker
Batch data

19. Intuitive User Experience
Configurable, Pre-defined Automation
Intuitive and easy to use web-based interface
Simple to configure and manage replication tasks
Single interface for any supported source to target
Easy management with alerts and notifications
First and foremost our customers find that the product is very easy to deploy and use. It provides a single web-based interface - regardless of the type of source systems or target systems. All of the functions to configure, control and monitor the replication tasks are provided through an intuitive graphical interface.

20. Easily Create and Manage Kafka Endpoints
Attunity Replicate
Eliminate manual coding
Drag and drop interface for all sources and targets
Monitor and control data stream through web console
Bulk load or CDC
Multi-topic and multi-partitioned data publication
Command Line
"table": "table-name",
"schema": "schema-name",
"op": "operation-type",
"ts": "change-timestamp",
"data": [{"col1": "val1"}, {"col2": "val2"}, …., {"colN": "valN"}]
"bu_data": [{"col1": "val1"}, {"col2": "val2"}, …., {"colN": "valN"}],

21. Attunity Replicate’s Differentiators
Easy – Configurable, powered by automation (no dev or scripting)
Change Data Capture (CDC) – Efficient, low latency and no downtime
Zero Footprint – No agent on source database server
Heterogeneous – Supports many data sources and targets
Optimised – Integrated with native target system APIs

22. Attunity Corporate Overview
Global Organisation
Over 2000 Customers in 65 Countries
Financial Services
Manufacturing / Industrials
Health Care
Government
EMEA
USA
APAC
Enterprise Data Management
On Premise | Cloud | Across Platforms
Technology / Telecommunications
Other Industries
Attunity is a publicly traded, global organization – with offices around the United States, Europe and Asia Pacific.
We have over 2000 customers in 65 countries.
And our focus is delivering Enterprise Data Management solutions across platforms for both on-premises and the cloud.
Our mission is to help organizations:
accelerate the data delivery across enterprise and cloud
enable organization to gain value our of the data quickly and
continually improve the management of data with intelligent insight.
Accelerate data delivery across enterprise and cloud
Empower rapid utilisation of data by the business
Continually optimise with intelligent insight

23. Attunity – Trusted Technology and Partner
Trusted by Microsoft with 3 OEMs, bundled inside SQL Server
Trusted by Amazon (AWS) with technology licensing for cloud migration service
Trusted by IBM and Oracle with respective OEMs of Attunity technology
Trusted by Teradata as a reseller for Data warehouse and Hadoop market
Trusted by HP as a reseller for Data warehouse and analytics market
Trusted by Accenture, Capgemini and Cognizant as SI partners
Trusted by Hortonworks, Cloudera and MapR for Hadoop solutions
Trusted by over 2000 customers in over 65 countries

24. CDC enables the Evolution of Hadoop
Operationalising Hadoop
Financial services – enterprise use cases
Real-time and streaming
Online Retail – customer success
Hadoop and the cloud
Global Data Lake
The final major benefit of Attunity Compose is risk reduction.

25. Q&A and Additional Resources
Contact Us
Follow Us
Come see us at our stand
FREE TRIAL
attunity.com/replicateexpress