Real-time data delivery may be easier than you think Mark Van de Wiel | Chief Data Officer #493 | Silicon Valley 2016
Real-time Data Delivery Introduction Requirements Architecture Demo Q&A Raffle SQL SATURDAY | #493 | Silicon Valley 2016
Introduction
Who – and Where – is HVR Software? Heterogeneous, high volume replication Started in 1995 in Dutch Postal Services Spun out in 2000 Independent since 2013 Global presence, with offices in San Francisco, CA Amsterdam (Netherlands) Shanghai Sydney
Real-Time Integration Use Cases Real-time Business Intelligence Hybrid Cloud Computing Big Data Enterprise Data Integration Geographic Distributed Computing Migrations High Availability
Requirements
Requirements Log-based Change Data Capture Real-time transaction capture Efficient and secure network communication Compression Large block transfer Encryption Efficient data integration Destination dependent (columnar, MPP) Optimized
Architecture
Architecture
Demo
Demo Setup TARGET ORACLE 192.168.197.138 localhost HVR agent HVR hub sqlhub bidb tpcc SQL Server SQL Server ORACLE
Solution Summary Heterogeneous sources/targets Quick implementation On live system No downtime End-to-end capabilities DDL generation Initial load Log-based Change Data Capture Compare
Real-time Data Delivery Introduction Requirements Architecture Demo Q&A Raffle SQL SATURDAY | #493 | Silicon Valley 2016
Q&A
Mark Van de Wiel | Chief Data Officer #493 | Silicon Valley 2016