C5: Introduction to DataXtend® Semantic Integrator (DX SI) Dean Elliott Client Solutions Manager

Agenda Data challenges in integration solutions DX SI enables the data layer in integration DX SI Lifecycle DX SI Demonstration

Traditional approaches to data integration CMR1 CRM2 Billing Provisioning Billing CRM1 CRM2 Provisioning Inventory TT Data W/house Call Center Inventory TT Call Center Data W/house ‘Integration Spaghetti’ Message Oriented Middleware

Increasing complexity Increasing maintenance costs Business Challenges resulting from traditional approaches to data integration TT Provisioning Billing Inventory CRM1 CRM2 Call Center ‘Integration Spaghetti’ Data W/house Business Challenges Agility Managing Change Increasing complexity Increasing maintenance costs Message Oriented Middleware Inventory TT Provisioning Billing CMR1 CRM2 Call Center Data W/house

A new approach to data integration Provision -ing Billing CRM1 CRM2 Billing Provisioning CRM1 CRM2 Billing CRM1 CRM2 Provisioning Common Data Model Inventory TT Data W/house Call Center Inventory TT Call Center Data W/house Inventory TT Call Center A common data model enables transformation of all interfaces to a single semantic meaning. ‘Integration Spaghetti’ Messaged Oriented Middleware ESB and Semantic Data Integration

Can’t We All Just Get Along? The Problem Application 2 Translation Application 1 Translation Application 3 Translation Translation Translation Translation Translation Translation Translation Translation Translation Translation Translation Database 3 No central management Costly to modify Not easily adapted to change Database 1 Translation Database 2 Translation Translation

Model Driven Integration The Solution Application 2 Application 1 Application 3 Common Model Distributed Transformation Engine Database 3 Database 1 Centralized management Rapid development and deployment Lower TCO Database 2

Why DataXtend Semantic Integrator? Data has different meanings in different systems (semantics) “age” means something different to an insurance company issuing a premium than to a government agency issuing a driver’s permit Many data transformations between systems are complex XSLT is not enough In SOA, everybody needs to know how to talk to everybody else!

DataXtend Semantic Integrator Address the accidental architecture of data Customer Care Common model architecture for semantic mediation Visual mapping of large, complex integrations Robust project life cycle support Round-trip testing and impact analysis Flexible, distributed deployment options Web services, ESB, app server, or Java container Invoicing TM Forum SID Provisioning Services Customers Products

Challenges of Common Model Integration A good Common Model should be Comprehensive Abstract Extensible But… a comprehensive, abstract model is Large Complex for simple things Hard to maintain DataXtend SI addresses these issues

Industry Standard Common Data Models P&C Insurance (ACORD P&C) Health Care Payers and Providers (HL7) Financial Derivatives (FpML) Telecommunication (TMF SID) Horizontal (OAGIS) Retail (ARTS) Mortgage Banking (MISMO) Utilities (IEC 61968) Life Insurance (ACORD Life) Financial Services Messages (ISO20022) B2B Supply Chain (RosettaNet, GS1/EAN)

Agenda Data challenges in integration solutions DXSI enables the data layer in integration DXSI in the Systems Development Lifecycle Summary

Progress® DataXtend SI - Enables the data layer in Integration BPM Layer BPM BAM Business Process Layer - Process Abstraction Progress DataXtend SI Utilizes a Common Model Semantic Brokering Model based Mappings Visual Round-Trip Testing 360º End-to-End Impact Analysis Governance Change and Lifecycle Management Common Data Model Customer Product Resource Partner Common Market Service Data Interoperability Layer - Semantic Abstraction ENTERPRISE SERVICE BUS NMS Inventory OMS Billing CRM System Integration Layer - Infrastructure Abstraction ESB/EAI Layer

DataXtend SI Product Capabilities CENTRALIZED DESIGN DISTRIBUTED RUNTIME TESTING Deploy Generate Visual tool for designing integration Stateless for scalability Runs in any Java container Connects to any bus Runs in Eclipse

Agenda Data challenges in integration solutions DXSI enables the data layer in integration DXSI in the Systems Development Lifecycle Summary

The DataXtend SI Lifecycle Design Time Import, enrich, define rules, aggregations and maps needed to exchange valid data between enterprise systems Runtime Automate rules execution Audit and Validate every exchange Lifecycle Management Manage rules, aggregations and maps over time Change integrations of adaptive infrastructure with build-in change management facilities

DataXtend Exchange Model Import directly from a UML Import directly from a database (default validation rules to enforce constraints) Import directly from XML Semantic Mappings: Validate Data Match incompatible data Flag Data Errors Conditionally Map 1000 Classes Your Own Model! 1020 Classes 1080 Classes 5000 Classes Import directly from a WSDL

DataXtend Common Model Navigator Component View Detail about the component in tabular form: attributes, types, classes, collections and relationships Graph View Shows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationships Tree View Allows you to navigate through the containment hierarchy of the component.

Computed Attributes Simplify Common Models for Ease of Use Centralized design Virtual attributes simplify models without deviating from the standard Contact Mobile Type = Home Type = Work Type = Mobile Telephone Customer

DataXtend Mapping and Rule Designer All assets are visually mapped to and from the common model Even complex expressions are designed without coding

DataXtend Tester

Deployment Options: Distributed Execution The DXSI Runtime is stateless and each executes independently There is no central hub to limit performance or single point of failure Multiple deployment options can be used simultaneously Source Application DXSI Adaptor DXSI Assembly DXSI Data Services Target System Target System App Server DXSI Runtime Influences Message Content, Not Transport Architecture

DXSI Exchange Model Packaging DXSI services can be wrapped with a variety of code generators to provide easily deployed, high performance packages for many platforms including: Sonic ESB Itineraries Websphere SCA / SDO WebLogic 8 and 9 XMLBeans WAR, EAR, EJB etc. Packagers are designed to leverage the infrastructure and tools of the chosen platform

DataXtend Deployment 1: Creating the DX SI service interfaces Interface wrappers Simplify access to DX SI service interface Build-in to DX SI IBM SDOs Sonic™ ESB BEA Beehive JMS Java™ Beans EJB Sessions Create one or more wrappers for every data service No wrappers. DX SI Java interface is used build DX SI Java Runtime build Can run standalone or packaged

DataXtend Deployment 2: Packaging Application and Service packagers Define wrappers Build Package DX SI Java Runtime Examples: Sonic Workbench IBM WID BEA Workshop Fully deployable solution generated Build-in packagers to DX SI Web service, EJB, EAR Supported platforms: JBOSS, IBM, BEA, Oracle® 3rd Party IDE Package & Deploy Application Server BPM Server ESB

The DataXtend SI Lifecycle Design Time Import, enrich, define rules, aggregations and maps needed to exchange valid data between enterprise systems Runtime Automate rules execution Audit and Validate every exchange Lifecycle Management Manage rules, aggregations and maps over time Change integrations of adaptive infrastructure with build-in change management facilities

DataXtend SI Runtime DataXtend SI Engine runtime process: Input data is mapped to the Common Model Common Model is enriched with extra data if required Data is mapped from Common Model to Data Source (writing) Results are mapped back to the Common Model and Data Services Rules engine automates validation of the data at all stages Runtime report is available detailing all issues

ESB Solution without DataXtend SI Goal: To provide an aggregated view of a customer’s accounts Issues Solution assumes all data is equivalent i.e. canonical and on the same version, for message and data No controls to map data types E,g. TVAccounts – maps Mr as ‘0’ Wireless maps Mr as ‘A’ To solve requires multiple transformation svcs Possibly 10 XForm and Enrichment steps

DataXtend SI and ESB ESB and DX SI Intermediate services replaced by DX SI DX SI handles Data and Message layout impedance Using XML based invocation framework similar to WS 11 Intermediate services to 1

The DataXtend SI Lifecycle Design Time Import, enrich, define rules, aggregations and maps needed to exchange valid data between enterprise systems Runtime Automate rules execution Audit and Validate every exchange Lifecycle Management Manage rules, aggregations and maps over time Change integrations of adaptive infrastructure with build-in change management facilities

DataXtend SI Lifecycle Management Features Impact Analysis view and report: Identify interdependencies in a project. An Impact Analysis report provides a snapshot of an element's current state for future reference. Comparison of exchange model elements: Provides an interface for comparing elements in the same project or in different projects. Synchronize model changes: Allows you to selectively accept changes from one exchange model into another.

DataXtend SI Impact Analysis The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editor Select the DataXtend Impact Analysis tab with an entity selected You can generate an HTML Impact Analysis Report that displays all entities related to the selected entity

DataXtend SI Compare Editor Changes are highlighted in the Compare Editor Use the Compare Editor to compare: Entities in the same or in different projects Two files in the same project This example shows how to compare two files in the same project.

Synchronizing Model Changes You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source). You can also use project synchronization to create a new project based on another, exported one.

Agenda Data challenges in integration solutions DXSI enables the data layer in integration DXSI Lifecycle Summary

Summary DX SI Differentiator vs. Traditional Mappers Comparison with traditional point-to-point message mapping tools

What if…? What if… you could accurately turn around change impact assessments in hours rather than days? What if… you could radically increase systems agility and responsiveness to business requests through a loosely coupled architecture? What if… you could significantly reduce maintenance costs (through re-use, consistency, reduction in custom code, end-to-end visibility of data, and leverage of open inter-operable standards)

In Summary DataXtend SI reduces costs to create and maintain data transformation DataXtend SI utilizes and enables a common model approach DataXtend SI deploy as a service

For More Information, go to… PSDN DataXtend SI Product Center Documentation Progress.com DataXtend SI Home Page DataXtend SID Model Browser

Relevant PTW Sessions C4: Common Applications of Sonic ESB C8: Enterprise Integration Patterns in Sonic ESB C9: SOA Management with Actional for Sonic live at work

? Questions

Thank You