iWay Solutions - EIM Vincent Deeney – Solutions Architect 6/25/2009
Information Builders Agenda Information Builders and iWay Software Technology Overview Demonstration Use-Case Technical Demonstration
iWay Software Integration of all content –data warehouse, files, queues, CMS, documents, , ERP, CRM, SFA. Support spectrum of all integration patterns ETL, SOA, B2B, MFT etc. Integrated data quality and master data management Enrich and feed business events and data extracts to operational data stores, data warehouses, applications, enterprise search engines Enable real-time dashboards, scoring and analytics through embedded complex event processing
Technology Overview iWay Software Enterprise Integration
A typical problem Receiving data in multiple formats from external partners (csv, txt, edi, etc.) Data of varying quality. Lack of visibility into full process (end-to-end). Various Manual Steps
Upstream Data Data/Information Enters from Multiple Points Manual Data Entry B2B Gateway Call Center Self-Service Portal EIM Issues Accuracy Completeness Business Rule Validation Correlation
In-stream Data Data is a Flowing, Dynamic thing Complex Processes Derived Data Evolving Semantics Operational BI EIM Issues Error Detection and Correction Lost or Mismatched Information Duplication Validation as Evolves
Downstream Data Data is collected, manipulated, and analyzed DM/DW/Cubes/Analytical BI Performance Management Compliance Auditing EIM Issues Access Accuracy Completeness Mismatched Semantics
Enterprise Information Management Requirements Single View Data Quality Master Data Management Operational Data Store Customer Data Integration Citizen Services Master Patient Index Product Information Management Real Time Data Warehouse
Master Data Management Defined MDM for customer data systems are software products that: Support the global identification, linking and synchronization of customer information across heterogeneous data sources Create and manage a central, database-based system of record Enable the delivery of a single customer view for all stakeholders MDM architectural styles vary in: Instantiation of the customer master data — varying from the maintenance of a physical customer profile to a more-virtual, metadata-based indexing structure The latency of customer master data maintenance — varying from real-time, synchronous, reading and writing of the master data in a transactional context to batch, asynchronous harmonization of the master data across systems An MDM program potentially encompasses the management of customer, product, asset, person or party, supplier and financial masters.
MDM Architecture – Coexistence Master is Single Version of Truth Data Quality is Ongoing Updates occur at Sources or Master Updates propagated to other Sources Master Source
MDM Architecture – Consolidation Master is Single Version of Truth Data Quality at Master Updates occur at Sources Updates propagated to Master Master Source
MDM Architecture – Registry Multiple Versions of Truth Data Quality is Ongoing Updates occur at Sources Keys and Metadata updated in Registry Updates propagated to other Sources (Optional) Master Source
MDM Architecture – Centralized Master Source Master is Single Version of Truth Data Quality at Master Updates occur at Master Updates propagated to Sources
iWay Solution
Data Quality Profiling: Analysis of data to provide insight into the quality of the data and aid in the identification of data quality issues. Parsing and standardization: Decomposition of fields into component parts and formatting of values into consistent layouts based on industry standards, local standards, user- defined business rules and knowledge bases of values and patterns. Generalized "cleansing": Modification of data values to meet domain restrictions, integrity constraints or other business rules that define sufficient data quality for the organization. Matching: Identification, linking or merging related entries within or across sets of data. Monitoring: Deployment of controls to ensure ongoing conformance of data to business rules that define data quality for the organization. Enrichment: Enhancing the value of internally held data by appending related attributes from external sources (for example, consumer demographic attributes or geographic descriptors).
iWay Solution CRM iWay Service Manager SFA Content ETL ERP FIN B2B EAI Legacy BI Golden Record Golden Record Index Identify MDM Registry MDM Registry Sync Data Quality Data Quality
iWay Solution Enable online, real-time, near real-time and batch integration Event based Push Pull Scheduled Transformation services Intelligent routing Correlation of information Multiple protocol Transactional update of end systems Guaranteed delivery of messages
SSNFull NamePhone Number AddressCityStateZip Code John George Malkovich Wachovsky PhD th StNewtownPA Dr Charles Becker GAPPA Mr. Daniel Deutsch Broad StreetWaynePA Dr C. Becker Kennedy Blvd `-3423Gregory K Thoben Mallory StKennett SqurPA19348 “Dirty Data” issues Problems : Missing Data Inconsistent Formats Incorrect Data Duplicate Information
SSNFull NamePhone Number AddressCityStateZip Code John George Malkovich Wachovsky PhD th StreetNewtownPA Dr Charles Becker GAPPA Mr. Daniel Deutsch Broad StWaynePA Dr C. Becker Kennedy Blvd `-3423Gregory K Thoben Mallory StKennett SqurPA19348 Data Cleansing Correct Address AddressCityStateZipcode th StNewton SquarePA Kennedy BlvdGAPPA Mallory StKennett SquarePA19348
SSNFull NamePhone Number AddressCityStateZip Code John George Malkovich Wachovsky PhD th StNewtown SquarePA Dr Charles Becker GAPPA Mr. Daniel Deutsch Broad StWaynePA Dr C. Becker Kennedy Blvd GAPPA `-3423Gregory K Thoben Mallory StKennett SquarePA19348 Data Cleansing Phone Number
SSNFull NamePhone Number AddressCityStateZip Code John George Malkovich Wachovsky PhD th StNewtown SquarePA Dr Charles Becker GAPPA Mr. Daniel Deutsch Broad StWaynePA Dr C. Becker Kennedy Blvd GAPPA `-3423Gregory K Thoben Mallory StKennett SquarePA19348 Data Cleansing Reformat Name FirstFirst MiddleInitialLast MiddleLastTitle JohnGeorgeMalkovichWachovskyPhD CharlesBeckerDr DanielDeutschMr. GregoryKThoben
Data Cleansing SSNTitleFirst Name F. Middle Int.L.MiddleLast NamePhoneAddrCitySt.Zip PhdJohnGeorgeMalkovichWachovsky th StNewtown Square PA Dr.CharlesBecker GAPPA MrDanielDeutsch Broad St WaynePA Dr.C.Becker Kennedy Blvd GAPPA GregoryKThoben Mallory St Kennett Square PA19348 DeDuplicate and Create Golden Record SSNTitleFirst Name F. Middle Int.L.MiddleLast NamePhoneAddrCitySt.Zip PhdJohnGeorgeMalkovichWachovsky th StNewtown Square PA Dr.CharlesBecker Kennedy Blvd GAPPA MrDanielDeutsch Broad StWaynePA GregoryKThoben Mallory StKennett Square PA19348
Live Demonstration
Demonstration Use Case Replacing with iWay Infrastructure: Provides graphical tools to manage process. End to End visibility. Real-time and batch data cleansing and validation