SOA-13: Introduction to DataXtend ® Semantic Integrator (DX SI) Abstract data management from the application level using a common data model
© 2008 Progress Software Corporation2 SOA-13: Introduction to DataXtend Semantic Integrator Agenda Data challenges in integration solutions DX SI enables the data layer in integration DX SI Lifecycle DX SI Demonstration
© 2008 Progress Software Corporation3 SOA-13: Introduction to DataXtend Semantic Integrator Traditional approaches to data integration Message Oriented Middleware Inventory TT ProvisioningBillingCMR1CRM2 Call Center Data W/house TT Provisioning Billing Inventory CRM1 CRM2 Call Center ‘Integration Spaghetti’ Data W/house
© 2008 Progress Software Corporation4 SOA-13: Introduction to DataXtend Semantic Integrator A new approach to data integration Provisioning Billing Inventory CRM1 TT CRM2 Call Center Data W/house ‘Integration Spaghetti’Messaged Oriented Middleware Inventory TT ProvisioningBillingCRM1CRM2 Call Center Data W/house ESB and Semantic Data Integration Provision -ing Billing Inventory CRM1 TT CRM2 Call Center Common Data Model A common data model enables transformation of all interfaces to a single semantic meaning.
© 2008 Progress Software Corporation5 SOA-13: Introduction to DataXtend Semantic Integrator Can’t We All Just Get Along? No central management Costly to modify Not easily adapted to change The Problem Database 2 Database 1 Application 3 Application 2 Database 3 Translation Application 1 Translation
© 2008 Progress Software Corporation6 SOA-13: Introduction to DataXtend Semantic Integrator Model Driven Integration Database 2 Database 1 Application 3 Application 2 Application 1 Database 3 Common Model The Solution Distributed Transformation Engine Centralized management Rapid development and deployment Lower TCO
© 2008 Progress Software Corporation7 SOA-13: Introduction to DataXtend Semantic Integrator Challenges of Common Model Integration A good Common Model should be Comprehensive Abstract Extensible But… a comprehensive, abstract model is Large Complex for simple things Hard to maintain DataXtend SI addresses these issues
© 2008 Progress Software Corporation8 SOA-13: Introduction to DataXtend Semantic Integrator Agenda Data challenges in integration solutions DX SI enables the data layer in integration DX SI Lifecycle DX SI Demonstration
© 2008 Progress Software Corporation9 SOA-13: Introduction to DataXtend Semantic Integrator Progress ® DataXtend SI ENTERPRISE SERVICE BUS NMSInventoryOMSBillingCRM System Integration Layer - Infrastructure Abstraction Common Data Model Customer Product Resource Partner Common Market Service Data Interoperability Layer - Semantic Abstraction Business Process Layer - Process Abstraction BPM BAM - Enables the data layer in Integration BPM Layer ESB/EAI Layer Progress DataXtend SI Utilizes a Common Model Semantic Brokering Model based Mappings Visual Round-Trip Testing 360º End-to-End Impact Analysis Governance Change and Lifecycle Management
© 2008 Progress Software Corporation10 SOA-13: Introduction to DataXtend Semantic Integrator Visual tool for designing integration Stateless for scalability Runs in any Java container Connects to any bus DataXtend SI Product Capabilities Runs in Eclipse DISTRIBUTED RUNTIME CENTRALIZED DESIGN Generate Deploy TESTING
© 2008 Progress Software Corporation11 SOA-13: Introduction to DataXtend Semantic Integrator Agenda Data challenges in integration solutions DX SI enables the data layer in integration DX SI Lifecycle DX SI Demonstration
© 2008 Progress Software Corporation12 SOA-13: Introduction to DataXtend Semantic Integrator Runtime Automate rules execution Audit and Validate every exchange Lifecycle Management Manage rules, aggregations and maps over time Design Time Import, enrich, define rules, aggregations and maps needed to exchange valid data between enterprise systems Change integrations of adaptive infrastructure with build-in change management facilities The DataXtend SI Lifecycle
© 2008 Progress Software Corporation13 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend Exchange Model Import directly from a database ( default validation rules to enforce constraints ) Import directly from XML Import directly from a WSDL Import directly from a UML 1080 Classes 5000 Classes 1000 Classes 1020 Classes Your Own Model! Semantic Mappings: Validate Data Match incompatible data Flag Data Errors Conditionally Map
© 2008 Progress Software Corporation14 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend Common Model Navigator Component View Detail about the component in tabular form: attributes, types, classes, collections and relationships Graph View Shows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationships Tree View Allows you to navigate through the containment hierarchy of the component.
© 2008 Progress Software Corporation15 SOA-13: Introduction to DataXtend Semantic Integrator Computed Attributes Simplify Common Models for Ease of Use Contact Mobile Type = Home Type = Work Type = Mobile TelephoneCustomer Centralized design Virtual attributes simplify models without deviating from the standard
© 2008 Progress Software Corporation16 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend Mapping and Rule Designer All assets are visually mapped to and from the common model Even complex expressions are designed without coding
© 2008 Progress Software Corporation17 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend Tester
© 2008 Progress Software Corporation18 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend Deployment 1: Creating the DX SI service interfaces Interface wrappers Simplify access to DX SI service interface Build-in to DX SI IBM SDOs Sonic ™ ESB BEA Beehive JMS Java™ Beans EJB Sessions Create one or more wrappers for every data service DX SI Java Runtime No wrappers. DX SI Java interface is used Can run standalone or packaged build
© 2008 Progress Software Corporation19 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend Deployment 2: Packaging Application and Service packagers Fully deployable solution generated Build-in packagers to DX SI Web service, EJB, EAR Supported platforms: JBOSS, IBM, BEA, Oracle ® DX SI Java Runtime 1. Define wrappers 2. Build 3rd Party IDE Examples: Sonic Workbench IBM WID BEA Workshop Application ServerBPM ServerESB 3. Package & Deploy 3. Package
© 2008 Progress Software Corporation20 SOA-13: Introduction to DataXtend Semantic Integrator Runtime Automate rules execution Audit and Validate every exchange Lifecycle Management Manage rules, aggregations and maps over time Design Time Import, enrich, define rules, aggregations and maps needed to exchange valid data between enterprise systems Change integrations of adaptive infrastructure with build-in change management facilities The DataXtend SI Lifecycle
© 2008 Progress Software Corporation21 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend SI Runtime DataXtend SI Engine runtime process: 1.Input data is mapped to the Common Model 2.Common Model is enriched with extra data if required 3.Data is mapped from Common Model to Data Source (writing) 4.Results are mapped back to the Common Model and Data Services Rules engine automates validation of the data at all stages Runtime report is available detailing all issues
© 2008 Progress Software Corporation22 SOA-13: Introduction to DataXtend Semantic Integrator ESB Solution without DataXtend SI Goal: To provide an aggregated view of a customer’s accounts Issues Solution assumes all data is equivalent i.e. canonical and on the same version, for message and data No controls to map data types –E,g. TVAccounts – maps Mr as ‘0’ –Wireless maps Mr as ‘A’ –To solve requires multiple transformation svcs Possibly 10 XForm and Enrichment steps
© 2008 Progress Software Corporation23 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend SI and ESB ESB and DX SI Intermediate services replaced by DX SI DX SI handles Data and Message layout impedance –Using XML based invocation framework similar to WS 11 Intermediate services to 1
© 2008 Progress Software Corporation24 SOA-13: Introduction to DataXtend Semantic Integrator Runtime Automate rules execution Audit and Validate every exchange Lifecycle Management Manage rules, aggregations and maps over time Design Time Import, enrich, define rules, aggregations and maps needed to exchange valid data between enterprise systems Change integrations of adaptive infrastructure with build-in change management facilities The DataXtend SI Lifecycle
© 2008 Progress Software Corporation25 SOA-13: Introduction to DataXtend Semantic Integrator DataXtend SI Lifecycle Management Features Impact Analysis view and report: Identify interdependencies in a project. An Impact Analysis report provides a snapshot of an element's current state for future reference. Comparison of exchange model elements: Provides an interface for comparing elements in the same project or in different projects. Synchronize model changes: Allows you to selectively accept changes from one exchange model into another.
© 2008 Progress Software Corporation26 SOA-13: Introduction to DataXtend Semantic Integrator Select the DataXtend Impact Analysis tab with an entity selected The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editor You can generate an HTML Impact Analysis Report that displays all entities related to the selected entity DataXtend SI Impact Analysis
© 2008 Progress Software Corporation27 SOA-13: Introduction to DataXtend Semantic Integrator Use the Compare Editor to compare: Entities in the same or in different projects Two files in the same project This example shows how to compare two files in the same project. DataXtend SI Compare Editor Changes are highlighted in the Compare Editor
© 2008 Progress Software Corporation28 SOA-13: Introduction to DataXtend Semantic Integrator You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source). You can also use project synchronization to create a new project based on another, exported one. Synchronizing Model Changes
© 2008 Progress Software Corporation29 SOA-13: Introduction to DataXtend Semantic Integrator Agenda Data challenges in integration solutions DX SI enables the data layer in integration DX SI Lifecycle DX SI Demonstration
© 2008 Progress Software Corporation30 SOA-13: Introduction to DataXtend Semantic Integrator Summary DX SI Differentiator vs. Traditional Mappers Comparison with traditional point-to-point message mapping tools
© 2008 Progress Software Corporation31 SOA-13: Introduction to DataXtend Semantic Integrator In Summary DataXtend SI reduces costs to create and maintain data transformation DataXtend SI utilizes a common model DataXtend SI deploy as a service
© 2008 Progress Software Corporation32 SOA-13: Introduction to DataXtend Semantic Integrator For More Information, go to… PSDN DataXtend SI Product Center Documentation Progress.com DataXtend SI Home Page DataXtend SID Model BrowserDataXtend SID Model Browser
© 2008 Progress Software Corporation33 SOA-13: Introduction to DataXtend Semantic Integrator Relevant Exchange Sessions SOA-18 Combining the Power of Sonic, DataXtend Semantic Integrator, and Actional for SOA Operations SOA-25 Data Distribution Solutions Using DataXtend Semantic Integrator for Sonic ESB Users SOA-31 Progress SOA Portfolio Roadmap
© 2008 Progress Software Corporation34 SOA-13: Introduction to DataXtend Semantic Integrator Questions ?
© 2008 Progress Software Corporation35 SOA-13: Introduction to DataXtend Semantic Integrator Thank You
© 2008 Progress Software Corporation36 SOA-13: Introduction to DataXtend Semantic Integrator