Download presentation
Presentation is loading. Please wait.
Published byLambert Mosley Modified over 9 years ago
1
INNOV-4: Breaking Down Enterprise Application Data Silos with Data Services Ken Rugg Vice President, Data Services
2
© 2006 Progress Software Corporation2 INNOV-4 Breaking Down Data Silos with Data Services Agenda What are Data Services? …and why would I want them? How does it work? The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services
3
© 2006 Progress Software Corporation3 INNOV-4 Breaking Down Data Silos with Data Services The Silos run the asylum ERP CRM SRM PLM BI/DW B2B / B2CB2B CPM Warranty Asset Tracking Vendor Compliance Billing Reservations
4
© 2006 Progress Software Corporation4 INNOV-4 Breaking Down Data Silos with Data Services ETL Tools Integration Brokers Database APIs/ Gateways File Transfer/ FTP Virtual Data Federation ("EII") Complexity and Breadth of Applicability Data Integration Landscape Data Latency Range NarrowWide Data Transformation Support Simplistic Rich Data Integration Forms the Technology Foundation of EIM, January 25th 2005 Data Xtend Data Services How is data delivered to applications today? Replication Data Xtend TM Data Services
5
© 2006 Progress Software Corporation5 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM provides Data integration for distributed, service-oriented applications. Delivering: transactional views of shared data in a form that applications need in real time in real world environments with no change to your applications or business logic Delivering Data to Applications
6
© 2006 Progress Software Corporation6 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications
7
© 2006 Progress Software Corporation7 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications
8
© 2006 Progress Software Corporation8 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications
9
© 2006 Progress Software Corporation9 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications
10
© 2006 Progress Software Corporation10 INNOV-4 Breaking Down Data Silos with Data Services Data Services and SOA “…we believe this idea of data services is a very important part of an overall approach to SOA. Enterprises need to use data integration technology to create data services which provide data to all these new and different consumers in a consistent, timely, high-quality, and reliable manner.” Ted Friedman, Gartner
11
© 2006 Progress Software Corporation11 INNOV-4 Breaking Down Data Silos with Data Services Agenda What are Data Services? …and why would I want them? How does it work? The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services
12
© 2006 Progress Software Corporation12 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Addressing Business Challenges Application versioning Data integration Master Data Management Disconnected Applications Service Oriented Architectures (SOA) Optimized data access Data Xtend TM Data Services ESB Delivering Data to Applications
13
© 2006 Progress Software Corporation13 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Application Versioning Description Side-by-side deployment of old and new application Database schemas differ Benefits No change to apps Application & data correctness Transparent data conversion App* App DB DB* Delivering Data To Applications
14
© 2006 Progress Software Corporation14 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Data Integration Description Integrate applications by integrating their data Database schemas are known Benefits No impact to existing apps Application & data correctness Transparent data conversion App 2 App 1 DB 1 DB 2 Delivering Data To Applications
15
© 2006 Progress Software Corporation15 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Master Data Management Description Multiple data sources Standard schema for integrated data Complex process for transforming data Benefits Incremental change capture Map data sources to standard schema No impact to existing apps App 3App 2 App 1 DB 1 DB 3 DB 2 Master DB New app Delivering Data To Applications
16
© 2006 Progress Software Corporation16 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Disconnected Operations Description Enable mobile use of database application Mostly connected or mostly disconnected Benefits No change to apps Application & data correctness Transparent replication Efficient operation Data Xtend Data Xtend Data Services Data Xtend Mobile App Local DB App DB Delivering Data To Applications
17
© 2006 Progress Software Corporation17 INNOV-4 Breaking Down Data Silos with Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC Sonic Enterprise Service Bus Each Service adds more data increasing the size of the “snow bank”
18
© 2006 Progress Software Corporation18 INNOV-4 Breaking Down Data Silos with Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC Each Service adds more data increasing the size of the “snow bank”
19
© 2006 Progress Software Corporation19 INNOV-4 Breaking Down Data Silos with Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC Each Service adds more data increasing the size of the “snow bank” By the end of the process the “snow can be very dirty” as the data becomes out of date
20
© 2006 Progress Software Corporation20 INNOV-4 Breaking Down Data Silos with Data Services SQL Server Oracle OpenEdge® Sonic Enterprise Service Bus Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC …with Data Services, information can be “passed by reference” to accelerate processing Data Xtend TM Data Services.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge®
21
© 2006 Progress Software Corporation21 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Xtend TM : Optimized Data Access Description Customized object view of relational data Relational database is system of record Benefits Java object binding No change to legacy apps Transactional consistency In-memory performance New app Legacy app DB of record Legacy app Data Cache Delivering Data To Applications
22
© 2006 Progress Software Corporation22 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Optimized Data Access Sonic Enterprise Service Bus.NET SQL Server J2EE OpenEdge® Oracle OpenEdge® …in the context of SOA SOA enables reuse of critical business functions as services
23
© 2006 Progress Software Corporation23 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Optimized Data Access Sonic Enterprise Service Bus.NET SQL Server J2EE Oracle SOA enables reuse of critical business functions as services OpenEdge® …But these reusable components can become bottlenecks and single points of failure …in the context of SOA
24
© 2006 Progress Software Corporation24 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Optimized Data Access Sonic Enterprise Service Bus.NET SQL Server J2EE Oracle SOA enables reuse of critical business functions as services Data Services enables “Optimized Services” with: Optimized data model for specialized processing Increased throughput and availability through redundant services OpenEdge® …in the context of SOA
25
© 2006 Progress Software Corporation25 INNOV-4 Breaking Down Data Silos with Data Services Agenda What are Data Services? …and why would I want them? How does it work? The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services
26
© 2006 Progress Software Corporation26 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization Distributed Transaction Management Similar to database clustering, (e.g. Oracle RAC) What is a transaction An atomic unit of work with respect to –Consistency –Recovery Transactions provide –Atomicity –Correctness –Isolation –Durability Before Execution During Execution After Execution Consistent State Potentially Inconsistent State Consistent State
27
© 2006 Progress Software Corporation27 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization What is a transaction (continued) Serialization of updates –If each transaction is correct, serial execution of these transactions is also correct Avoid conflicts with lock management TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6
28
© 2006 Progress Software Corporation28 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization Distributed Serialization Each replicated copy applies transactions in a common order Avoid conflicts with distributed lock management TXN 1 TXN 2 TXN 3 TXN 1 TXN 2 TXN 1 TXN 2 TXN 3 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 1 TXN 2 TXN 3 TXN 4 Server 1 Server 3 Server 2 Server 4 Server 5
29
© 2006 Progress Software Corporation29 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization Distributed Serialization Each replicated copy applies transactions in a common order Avoid conflicts with distributed lock management Similar to XA… Distributed transactions Strong transactional guarantees …but different All data goes every place –each transaction can execute locally Highly scalable, performant and available TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 Server 1 Server 3 Server 2 Server 4 Server 5
30
© 2006 Progress Software Corporation30 INNOV-4 Breaking Down Data Silos with Data Services Response Time: Data Xtend TM vs. 2PC Response time in seconds of DataXtend Protocol vs. two phase commit across distributed servers
31
© 2006 Progress Software Corporation31 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? File System Application Database Triggers C. Tables S. Tables Replication Engine File Replicator Distribution Manager Data Xtend ™ RE ~10-15% overhead for change detection Transparent Change Detection
32
© 2006 Progress Software Corporation32 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Transactional Data Mapping
33
© 2006 Progress Software Corporation33 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Data Type Translation Transactional Data Mapping
34
© 2006 Progress Software Corporation34 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Format Translation Transactional Data Mapping
35
© 2006 Progress Software Corporation35 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Identity Translation Transactional Data Mapping
36
© 2006 Progress Software Corporation36 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Data Xtend TM Data Services CRM System Customer Self-Service Data Warehouse Order Entry Transactional Data Mapping
37
© 2006 Progress Software Corporation37 INNOV-4 Breaking Down Data Silos with Data Services Agenda What are Data Services? …and why would I want them? How does it work? The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services
38
© 2006 Progress Software Corporation38 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend Data Xtend Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus Enables Data Integration as SOA enables Process Integration OpenEdge® SQL Server.NET Oracle J2EE OpenEdge®
39
© 2006 Progress Software Corporation39 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend Data Xtend Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus Enables Data Integration as SOA enables Process Integration OpenEdge® SQL Server.NET Oracle J2EE OpenEdge® Data Xtend
40
© 2006 Progress Software Corporation40 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend Data Xtend Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus Enables Data Integration as SOA enables Process Integration OpenEdge® SQL Server.NET Oracle J2EE OpenEdge® Data Xtend Data Cache
41
© 2006 Progress Software Corporation41 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration
42
© 2006 Progress Software Corporation42 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration
43
© 2006 Progress Software Corporation43 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration
44
© 2006 Progress Software Corporation44 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration
45
© 2006 Progress Software Corporation45 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Remote Edition Remote Office Operations Support geographically dispersed operations of an enterprise Allows local office to continue operation when corporate network connection drops Field Force Automation Enterprise applications for users usually not connected to the corporate network User can continue to do business with no change in the quality of service of the application Disconnected Operations
46
© 2006 Progress Software Corporation46 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Remote Edition US Army Troop Deployment & Readiness System Issues: Information regarding troops did not give an accurate picture of current units’ state of readiness Material asset readiness was old and outdated Battlefield conditions were not being captured and delivered to where they were needed Solution: Embed two-way Hub & Spoke replication in FusionNet Data can be sliced for each field commander and his specific troops Results: All personal records, material assets, and troop readiness can be viewed from the unit level “DataXtend TM has been a great help in achieving our disconnected client and server replication goals” Major Kurt Warner Corps Knowledge Management Officer Multi-National Corps Iraq, Office of the ACoS C6
47
© 2006 Progress Software Corporation47 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Caching EditionDBDBDBDBDBDBDBDBDBDB Equities Trading ServiceServiceServiceServiceService Enterprise Service Bus 40 global trading applications, $7B trades/day Each application “re-invents” the data access layer: Reduces developer productivity Increases maintenance costs Raises operating risks, system failures, downtime
48
© 2006 Progress Software Corporation48 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Caching EditionDBDBDBDBDBDBDBDBDBDB Equities Trading ServiceServiceServiceServiceService Enterprise Service Bus 40 global trading applications, $7B trades/day Each application “re-invents” the data access layer: Reduces developer productivity Increases maintenance costs Raises operating risks, system failures, downtime Data Xtend TM Caching Edition Integrated Data Access And Caching
49
© 2006 Progress Software Corporation49 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Delivering Data to Applications Data Xtend TM Data Services ESB Data Xtend TM provides Data integration for distributed, service-oriented applications. Delivering: transactional views of shared data in a form that applications need in real time in real world environments with no change to your applications or business logic
50
© 2006 Progress Software Corporation50 INNOV-4 Breaking Down Data Silos with Data Services Questions?
51
© 2006 Progress Software Corporation51 INNOV-4 Breaking Down Data Silos with Data Services Thank you for your time
52
© 2006 Progress Software Corporation52 INNOV-4 Breaking Down Data Silos with Data Services
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.