INNOV-4: Breaking Down Enterprise Application Data Silos with Data Services Ken Rugg Vice President, Data Services.

Slides:



Advertisements
Similar presentations
October 10-13, 2006 San Diego Convention Center, San Diego California VoIP/SOA Integration Impact on IT Apps, Processes, & Overall Business.
Advertisements

Data Services for Service Oriented Architecture in Finance D. Britton Johnston Chief Technology Evangelist.
Govern the Flow of Data: Moving from Chaos to Control
Service Oriented Architecture for Mobile Applications Swarupsingh Baran University of North Carolina Charlotte.
Database Architectures and the Web
Cloud Computing: Theirs, Mine and Ours Belinda G. Watkins, VP EIS - Network Computing FedEx Services March 11, 2011.
Lars Frank: 1971 Cand. Scient. in computer science (Datalog) and math HD in organization Database consultant (primært i banksektoren) 1994-
Service Oriented Architecture Terry Woods Session 50.
1 Vladimir Knežević Microsoft Software d.o.o.. 80% Održavanje 80% Održavanje 20% New Cost Reduction Keep Business Up & Running End User Productivity End.
1 TM Allstream Corp. Allstream Proprietary. Use pursuant to company instructions. Oracle Data Hubs, concept to reality? Atlanta OAUG February 18 th, 2005.
Service Oriented Architecture Concepts March 27, 2006 Chris Armstrong
SAS® Data Integration Solution
Adding More Value to Your ERP System Using Service-Oriented Architecture (SOA) Copyright © 2001 iWay Software 1 Information Builders.
1 Software architecture adjustments for a changing business.
SOA with Progress Philipp Walther Consultant. © 2007 Progress Software Corporation2 Agenda  SOA  Enterprise Service Bus (ESB)  The Progress SOA Portfolio.
Business Continuity and DR, A Practical Implementation Mich Talebzadeh, Consultant, Deutsche Bank
Agenda: ISUG : :05 Välkomna och agendaöversikt
US Strategy Days /16/2017 7:46 PM Richard Moore Server & Tools Business Group Lead Microsoft Ireland ©2006 Microsoft.
Overview Distributed vs. decentralized Why distributed databases
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 17 Client-Server Processing, Parallel Database Processing,
WORKDAY TECHNOLOGY Stan Swete CTO - Workday 1.
Client-Server Processing and Distributed Databases
David Besemer, CTO On Demand Data Integration with Data Virtualization.
® IBM Software Group © IBM Corporation IBM Information Server Service Oriented Architecture WebSphere Information Services Director (WISD)
Private Cloud: Application Transformation Business Priorities Presentation.
TIBCO Service-Oriented Architecture (SOA) Our SOA solutions help organizations migrate to an infrastructure composed of services that can be assembled,
Data Integration in Service Oriented Architectures Rahul Patel Sr. Director R & D, BEA Systems Liquid Data – XML-based data access and integration for.
Word Wide Cache Distributed Caching for the Distributed Enterprise.
© 2011 IBM Corporation Smarter Software for a Smarter Planet The Capabilities of IBM Software Borislav Borissov SWG Manager, IBM.
SOA-06: Get On the Bus with the OpenEdge ® Adapter for Sonic ESB ® David Cleary Principal Software Engineer, Progress.
IMS 4212: Distributed Databases 1 Dr. Lawrence West, Management Dept., University of Central Florida Distributed Databases Business needs.
SOA-4: Introduction to OpenEdge ® Integration Technologies Jamie Townsend Applied Architect.
1 Progress Software’s OpenEdge Platform Which database is right for your environment? Simon Epps.
PowerTier EJB in High-Performance Applications John Killoran European Technical Services Manager Persistence Software.
Client Server Technologies Middleware Technologies Ganesh Panchanathan Alex Verstak.
Sofia, Bulgaria | 9-10 October SQL Server 2005 High Availability for developers Vladimir Tchalkov Crossroad Ltd. Vladimir Tchalkov Crossroad Ltd.
INT-11: It’s Monday Morning, Do You Know Where Your Service Has Been? Service Management with Sonic ™ and Actional Marv Stone Progress Software.
© 2007 by Prentice Hall 1 Introduction to databases.
OpenACS: Porting Oracle Applications to PostgreSQL Ben Adida
Progress SOA Reference Model Explained Mike Ormerod Applied Architect 9/8/2008.
Embeddable Database Products Mike Olson Vice President, Embedded Technologies.
SOA-14: Deploying your SOA Application David Cleary Principal Software Engineer.
Why Governance? SOA Governance allows to n Master complexity of IT n Support business process change.
Introduction to DFS. Distributed File Systems A file system whose clients, servers and storage devices are dispersed among the machines of a distributed.
SOA-21: Integrating SAP and Other Packaged Applications into your SOA Infrastructure Wayne Lockhart Sr. Product Manager.
SONIC-3: Creating Large Scale Installations & Deployments Andrew S. Neumann Principal Engineer, Progress Sonic.
SOA-3: You Need to Integrate, But What do You Need to Know and Do? Bob Trabucchi Sr Presales Consultant Sandy Caiado Sr Presales Consultant.
SOA-25: Data Distribution Solutions Using DataXtend ® Semantic Integrator for Sonic ™ ESB Users Jim Barton Solution Architect.
SOA-02: Sonic SOA Products Overview Luis Maldonado Technical Product Manager Sonic Software.
SONIC-3: Creating Large Scale Installations & Deployments Andrew S. Neumann Principal Engineer Progress Sonic.
1 BPEL based Service Oriented B2B Integration Solution for 3PAR October 3, 2007.
GLOBAL EDGE SOFTWERE LTD1 R EMOTE F ILE S HARING - Ardhanareesh Aradhyamath.
2015 NetSymm Overview NETSYMM OVERVIEW December
SOA-05: Building an Enterprise SOA Using ESB Dave Chappell Vice President & Chief Technology Evangelist, Sonic Software.
SOA-19: Combining the Power of Sonic ™, DataXtend ® Semantic Integrator, and Actional ® for SOA Operations Joining forces … Jiri De Jagere Senior Solution.
SQL Server 2008 R2 Report Builder 3.0 SQL Server 2008 Feature Pack Report Builder 2.0 SQL Server 2008 General Availability Authoring & Collaboration (Acquisition:
The Holmes Platform and Applications
Data Services for Service Oriented Architecture in Finance
SAS® Data Integration Solution
Integrating with Dynamics 365
Overview of MDM Site Hub
Operational & Analytical Database
Maximum Availability Architecture Enterprise Technology Centre.
Oracle Data Hubs, concept to reality? Atlanta OAUG February 18th, 2005
SAS® Data Integration Solution
ARCH-1: Application Architecture made Simple
SOA-1: Fundamentals of Service-Oriented Architecture
Presentation transcript:

INNOV-4: Breaking Down Enterprise Application Data Silos with Data Services Ken Rugg Vice President, Data Services

© 2006 Progress Software Corporation2 INNOV-4 Breaking Down Data Silos with Data Services Agenda  What are Data Services? …and why would I want them?  How does it work?  The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services

© 2006 Progress Software Corporation3 INNOV-4 Breaking Down Data Silos with Data Services The Silos run the asylum ERP CRM SRM PLM BI/DW B2B / B2CB2B CPM Warranty Asset Tracking Vendor Compliance Billing Reservations

© 2006 Progress Software Corporation4 INNOV-4 Breaking Down Data Silos with Data Services ETL Tools Integration Brokers Database APIs/ Gateways File Transfer/ FTP Virtual Data Federation ("EII") Complexity and Breadth of Applicability Data Integration Landscape Data Latency Range NarrowWide Data Transformation Support Simplistic Rich Data Integration Forms the Technology Foundation of EIM, January 25th 2005 Data Xtend Data Services How is data delivered to applications today? Replication Data Xtend TM Data Services

© 2006 Progress Software Corporation5 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM provides Data integration for distributed, service-oriented applications. Delivering:  transactional views of shared data  in a form that applications need  in real time  in real world environments  with no change to your applications or business logic Delivering Data to Applications

© 2006 Progress Software Corporation6 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications

© 2006 Progress Software Corporation7 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications

© 2006 Progress Software Corporation8 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications

© 2006 Progress Software Corporation9 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Delivering Data to Applications

© 2006 Progress Software Corporation10 INNOV-4 Breaking Down Data Silos with Data Services Data Services and SOA “…we believe this idea of data services is a very important part of an overall approach to SOA. Enterprises need to use data integration technology to create data services which provide data to all these new and different consumers in a consistent, timely, high-quality, and reliable manner.” Ted Friedman, Gartner

© 2006 Progress Software Corporation11 INNOV-4 Breaking Down Data Silos with Data Services Agenda  What are Data Services? …and why would I want them?  How does it work?  The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services

© 2006 Progress Software Corporation12 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Addressing Business Challenges  Application versioning  Data integration  Master Data Management  Disconnected Applications  Service Oriented Architectures (SOA)  Optimized data access Data Xtend TM Data Services ESB Delivering Data to Applications

© 2006 Progress Software Corporation13 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Application Versioning Description  Side-by-side deployment of old and new application  Database schemas differ Benefits  No change to apps  Application & data correctness  Transparent data conversion App* App DB DB* Delivering Data To Applications

© 2006 Progress Software Corporation14 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Data Integration Description  Integrate applications by integrating their data  Database schemas are known Benefits  No impact to existing apps  Application & data correctness  Transparent data conversion App 2 App 1 DB 1 DB 2 Delivering Data To Applications

© 2006 Progress Software Corporation15 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Master Data Management Description  Multiple data sources  Standard schema for integrated data  Complex process for transforming data Benefits  Incremental change capture  Map data sources to standard schema  No impact to existing apps App 3App 2 App 1 DB 1 DB 3 DB 2 Master DB New app Delivering Data To Applications

© 2006 Progress Software Corporation16 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Disconnected Operations Description  Enable mobile use of database application  Mostly connected or mostly disconnected Benefits  No change to apps  Application & data correctness  Transparent replication  Efficient operation Data Xtend Data Xtend Data Services Data Xtend Mobile App Local DB App DB Delivering Data To Applications

© 2006 Progress Software Corporation17 INNOV-4 Breaking Down Data Silos with Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC Sonic Enterprise Service Bus  Each Service adds more data increasing the size of the “snow bank”

© 2006 Progress Software Corporation18 INNOV-4 Breaking Down Data Silos with Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC  Each Service adds more data increasing the size of the “snow bank”

© 2006 Progress Software Corporation19 INNOV-4 Breaking Down Data Silos with Data Services Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC  Each Service adds more data increasing the size of the “snow bank”  By the end of the process the “snow can be very dirty” as the data becomes out of date

© 2006 Progress Software Corporation20 INNOV-4 Breaking Down Data Silos with Data Services SQL Server Oracle OpenEdge® Sonic Enterprise Service Bus Data Xtend TM : Service Oriented Architectures “Passing all the data that is required to complete a business process around as XML documents is like a snowplow pushing a snow bank down the street” – Carl Olofson, IDC …with Data Services, information can be “passed by reference” to accelerate processing Data Xtend TM Data Services.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge®

© 2006 Progress Software Corporation21 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Xtend TM : Optimized Data Access Description  Customized object view of relational data  Relational database is system of record Benefits  Java object binding  No change to legacy apps  Transactional consistency  In-memory performance New app Legacy app DB of record Legacy app Data Cache Delivering Data To Applications

© 2006 Progress Software Corporation22 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Optimized Data Access Sonic Enterprise Service Bus.NET SQL Server J2EE OpenEdge® Oracle OpenEdge® …in the context of SOA  SOA enables reuse of critical business functions as services

© 2006 Progress Software Corporation23 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : Optimized Data Access Sonic Enterprise Service Bus.NET SQL Server J2EE Oracle  SOA enables reuse of critical business functions as services OpenEdge® …But these reusable components can become bottlenecks and single points of failure …in the context of SOA

© 2006 Progress Software Corporation24 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : Optimized Data Access Sonic Enterprise Service Bus.NET SQL Server J2EE Oracle  SOA enables reuse of critical business functions as services  Data Services enables “Optimized Services” with: Optimized data model for specialized processing Increased throughput and availability through redundant services OpenEdge® …in the context of SOA

© 2006 Progress Software Corporation25 INNOV-4 Breaking Down Data Silos with Data Services Agenda  What are Data Services? …and why would I want them?  How does it work?  The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services

© 2006 Progress Software Corporation26 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization  Distributed Transaction Management Similar to database clustering, (e.g. Oracle RAC)  What is a transaction An atomic unit of work with respect to –Consistency –Recovery Transactions provide –Atomicity –Correctness –Isolation –Durability Before Execution During Execution After Execution Consistent State Potentially Inconsistent State Consistent State

© 2006 Progress Software Corporation27 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization  What is a transaction (continued) Serialization of updates –If each transaction is correct, serial execution of these transactions is also correct Avoid conflicts with lock management TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6

© 2006 Progress Software Corporation28 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization  Distributed Serialization Each replicated copy applies transactions in a common order Avoid conflicts with distributed lock management TXN 1 TXN 2 TXN 3 TXN 1 TXN 2 TXN 1 TXN 2 TXN 3 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 1 TXN 2 TXN 3 TXN 4 Server 1 Server 3 Server 2 Server 4 Server 5

© 2006 Progress Software Corporation29 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Distributed transactional synchronization  Distributed Serialization Each replicated copy applies transactions in a common order Avoid conflicts with distributed lock management  Similar to XA… Distributed transactions Strong transactional guarantees  …but different All data goes every place –each transaction can execute locally Highly scalable, performant and available TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 TXN 1 TXN 2 TXN 3 TXN 4 TXN 5 TXN 6 Server 1 Server 3 Server 2 Server 4 Server 5

© 2006 Progress Software Corporation30 INNOV-4 Breaking Down Data Silos with Data Services Response Time: Data Xtend TM vs. 2PC Response time in seconds of DataXtend Protocol vs. two phase commit across distributed servers

© 2006 Progress Software Corporation31 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? File System Application Database Triggers C. Tables S. Tables Replication Engine File Replicator Distribution Manager Data Xtend ™ RE ~10-15% overhead for change detection Transparent Change Detection

© 2006 Progress Software Corporation32 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Transactional Data Mapping

© 2006 Progress Software Corporation33 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Data Type Translation Transactional Data Mapping

© 2006 Progress Software Corporation34 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Format Translation Transactional Data Mapping

© 2006 Progress Software Corporation35 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM : How does it work? CRM System Customer Self-Service Data Warehouse Order Entry Identity Translation Transactional Data Mapping

© 2006 Progress Software Corporation36 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM : How does it work? Data Xtend TM Data Services CRM System Customer Self-Service Data Warehouse Order Entry Transactional Data Mapping

© 2006 Progress Software Corporation37 INNOV-4 Breaking Down Data Silos with Data Services Agenda  What are Data Services? …and why would I want them?  How does it work?  The DataXtend TM Product Line Breaking Down Enterprise Data Silos with Data Services

© 2006 Progress Software Corporation38 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend Data Xtend Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus Enables Data Integration as SOA enables Process Integration OpenEdge® SQL Server.NET Oracle J2EE OpenEdge®

© 2006 Progress Software Corporation39 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend Data Xtend Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus Enables Data Integration as SOA enables Process Integration OpenEdge® SQL Server.NET Oracle J2EE OpenEdge® Data Xtend

© 2006 Progress Software Corporation40 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend Data Xtend Data Services Data Xtend TM Data Services Sonic Enterprise Service Bus Enables Data Integration as SOA enables Process Integration OpenEdge® SQL Server.NET Oracle J2EE OpenEdge® Data Xtend Data Cache

© 2006 Progress Software Corporation41 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration

© 2006 Progress Software Corporation42 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration

© 2006 Progress Software Corporation43 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration

© 2006 Progress Software Corporation44 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Data Xtend TM Enterprise Sonic Enterprise Service Bus.NETJ2EE OpenEdge® SQL Server Oracle OpenEdge® Enables Data Integration as SOA enables Process Integration

© 2006 Progress Software Corporation45 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Remote Edition Remote Office Operations Support geographically dispersed operations of an enterprise Allows local office to continue operation when corporate network connection drops Field Force Automation Enterprise applications for users usually not connected to the corporate network User can continue to do business with no change in the quality of service of the application Disconnected Operations

© 2006 Progress Software Corporation46 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Remote Edition US Army Troop Deployment & Readiness System Issues:  Information regarding troops did not give an accurate picture of current units’ state of readiness  Material asset readiness was old and outdated  Battlefield conditions were not being captured and delivered to where they were needed Solution:  Embed two-way Hub & Spoke replication in FusionNet  Data can be sliced for each field commander and his specific troops Results:  All personal records, material assets, and troop readiness can be viewed from the unit level “DataXtend TM has been a great help in achieving our disconnected client and server replication goals” Major Kurt Warner Corps Knowledge Management Officer Multi-National Corps Iraq, Office of the ACoS C6

© 2006 Progress Software Corporation47 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Caching EditionDBDBDBDBDBDBDBDBDBDB Equities Trading ServiceServiceServiceServiceService Enterprise Service Bus 40 global trading applications, $7B trades/day Each application “re-invents” the data access layer: Reduces developer productivity Increases maintenance costs Raises operating risks, system failures, downtime

© 2006 Progress Software Corporation48 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Caching EditionDBDBDBDBDBDBDBDBDBDB Equities Trading ServiceServiceServiceServiceService Enterprise Service Bus 40 global trading applications, $7B trades/day Each application “re-invents” the data access layer: Reduces developer productivity Increases maintenance costs Raises operating risks, system failures, downtime Data Xtend TM Caching Edition Integrated Data Access And Caching

© 2006 Progress Software Corporation49 INNOV-4 Breaking Down Data Silos with Data Services Data Xtend TM Data Services Delivering Data to Applications Data Xtend TM Data Services ESB Data Xtend TM provides Data integration for distributed, service-oriented applications. Delivering:  transactional views of shared data  in a form that applications need  in real time  in real world environments  with no change to your applications or business logic

© 2006 Progress Software Corporation50 INNOV-4 Breaking Down Data Silos with Data Services Questions?

© 2006 Progress Software Corporation51 INNOV-4 Breaking Down Data Silos with Data Services Thank you for your time

© 2006 Progress Software Corporation52 INNOV-4 Breaking Down Data Silos with Data Services