Copyright © President & Fellows of Harvard College Building a Reusable Data Integration Framework Strategic Agility David Aznavoorian Director, Database.

Slides:



Advertisements
Similar presentations
Copyright © 2006 Data Access Technologies, Inc. Open Source eGovernment Reference Architecture Approach to Semantic Interoperability Cory Casanave, President.
Advertisements

Service Oriented Architecture for Mobile Applications Swarupsingh Baran University of North Carolina Charlotte.
How to commence the IT Modernization Process?
State of Indiana Business One Stop (BOS) Program Roadmap Updated June 6, 2013 RFI ATTACHMENT D.
Test Automation Success: Choosing the Right People & Process
Applying the SOA RA Utah Public Safety ESB Project Utah Department of Technology Services April 10, 2008 Prepared by Robert Woolley.
Chapter 2 – Software Processes
Building an Operational Enterprise Architecture and Service Oriented Architecture Best Practices Presented by: Ajay Budhraja Copyright 2006 Ajay Budhraja,
Software Modeling SWE5441 Lecture 3 Eng. Mohammed Timraz
Ginnie Mae MISMO Adoption Update Tamara Togans and Nicole Jackson Ginnie Mae January 13, 2014 MISMO Winter 2014 Summit The MISMO Winter 2014 Summit Education.
ITIL: Service Transition
Copyright 2009  Develop the project charter: working with stakeholders to create the document that formally authorizes a project—the charter  Develop.
Leveraging CPQ Cloud for Channel Enablement Self Service Quoting for One and Two Tier Networks.
SOA Pilot BC Ferries BC OAUG 22 May 2008 Speakers: Chetan Sondagar – BC Ferries – Manager, Business & Safety Applications Mark Allen – Impac.
SAS® Data Integration Solution
Copyright © 2009 Rolta International, Inc., All Rights Reserved a c c e l R12™ Upgrade Approach.
Model Driven Architecture (MDA) Partha Kuchana. Agenda What is MDA Modeling Approaches MDA in a NutShell MDA Models SDLC MDA Models (an Example) MDA -
McGraw-Hill/Irwin Copyright © 2008, The McGraw-Hill Companies, Inc. All rights reserved.
Page 1Prepared by Sapient for MITVersion 0.1 – August – September 2004 This document represents a snapshot of an evolving set of documents. For information.
Systems Integration & Consulting June Copyright ® 2009 Ayenda Agenda Introduction to Systems Integration System Integration Challenges and Opportunities.
Supplement 02CASE Tools1 Supplement 02 - Case Tools And Franchise Colleges By MANSHA NAWAZ.
McGraw-Hill/Irwin Copyright © 2008, The McGraw-Hill Companies, Inc. All rights reserved.
Introduction to Systems Analysis and Design
ACL Solutions for Continuous Auditing and Monitoring John Verver CA, CISA, CMC Vice President, Professional Services & Product Strategy ACL Services Ltd.
Enterprise Architecture
Jason Morrill NCOAUG Training Day February, 2008
95-843: Service Oriented Architecture 1 Master of Information System Management Service Oriented Architecture Oracle SOA Suite 11g.
Sage User Network 11 th June 2009 Andrew Credland - Product Development Manager.
Developing Enterprise Architecture
a Service Oriented Architecture
Copyright 2013, Net.Orange, Inc. All rights reserved.Confidential and proprietary. Do not distribute without permission. Net.Orange App Development Net.Orange.
Engineering, Operations & Technology | Information TechnologyAPEX | 1 Copyright © 2009 Boeing. All rights reserved. Architecture Concept UG D- DOC UG D-
Compuware Corporation Business Driven SOA Edwin Schumacher Director of Product Management
An Introduction to Software Architecture
Demystifying the Business Analysis Body of Knowledge Central Iowa IIBA Chapter December 7, 2005.
The Challenge of IT-Business Alignment
Service Transition & Planning Service Validation & Testing
ISYS 562 Microcomputer Business Applications David Chao.
The Minnesota State Colleges and Universities system is an Equal Opportunity employer and educator. Information Technology Enterprise Strategic Investment.
Middleware for FIs Apeego House 4B, Tardeo Rd. Mumbai Tel: Fax:
9 Systems Analysis and Design in a Changing World, Fourth Edition.
Data Strategy  Status Update  SSIM  RID  Technology Strategies.
Introduction to soarchitect. agenda SOA background and overview transaction recorder summary.
ANKITHA CHOWDARY GARAPATI
Chapter © 2012 Pearson Education, Inc. Publishing as Prentice Hall.
I Copyright © 2007, Oracle. All rights reserved. Module i: Siebel 8.0 Essentials Training Siebel 8.0 Essentials.
Chapter 2 – Software Processes Lecture 1 Chapter 2 Software Processes1.
Stages of design  High level design  High level data structure  Architecture  Low level design-code design  Algorithms  Low level data structures.
Process Asad Ur Rehman Chief Technology Officer Feditec Enterprise.
Software Development Process CS 360 Lecture 3. Software Process The software process is a structured set of activities required to develop a software.
Software Engineering Lecture 10: System Engineering.
LECTURE 5 Nangwonvuma M/ Byansi D. Components, interfaces and integration Infrastructure, Middleware and Platforms Techniques – Data warehouses, extending.
ITIL: Service Transition
Electronic Business Systems
Rapid Launch Workshop ©CC BY-SA.
CIM Modeling for E&U - (Short Version)
The Development Process of Web Applications
Overview of MDM Site Hub
Chapter 18 Maintaining Information Systems
The Systems Engineering Context
Chapter 18 MobileApp Design
Enterprise Data Model Enterprise Architecture approach Insights on application for through-life collaboration 2018 – E. Jesson.
Object-Oriented Systems Development Life Cycle (CH-3)
Enterprise Architecture at Penn State
Agenda Purpose for Project Goals & Objectives Project Process & Status Common Themes Outcomes & Deliverables Next steps.
Introduction to SOA Part II: SOA in the enterprise
Demo for Partners and Customers
Mulesoft Anypoint Connector for AS/400 and Web Transaction Framework
Presentation transcript:

Copyright © President & Fellows of Harvard College Building a Reusable Data Integration Framework Strategic Agility David Aznavoorian Director, Database Services HBS Information Technology June 2011 Matt Siano Principal Database Engineer HBS Information Technology June 2011

Evolution of Enterprise Data Integration The Need for a Data Integration Framework Why Change? Steps Taken by HBS Enabling Change Where to Start? Key Considerations The Result A Look Inside Success Cases Lessons Learned Questions 2 Agenda

An evolution away from point solutions coding. While traditional data interfaces are ‘hardcoded’ solutions, specific to one use. A data integration framework is intended to define the components of a reusable information architecture, whereby publishing and consuming updates across the Enterprise are based on common Business Entity Objects (Master data). 3 What’s changing in Enterprise Data Integration at HBS?

Why develop a Data Integration Framework? Information is an asset – as long as you can share it consistently 4

5 Traditional data interfaces are ‘hardcoded’ solutions, specific to one use… Even experienced developers have trouble managing the data flow at this level

1.Application upgrades and new releases cause significant data integration re-development cycles – Database to Database 2.Business process improvements difficult to implement without changing code – Hardcode Business Rules 3.Only “Matt” knows how that works – Single points of failure! What’s your favorite problem? Bottom Line: We all pay the price in Time ($), Credibility and Quality 6 What are the warning signs for change?

1.Being a Change Agent o Recognize you have a problem o Communicate and build a group of internal advocates 2.Build a Clear Case/DI Strategy o Market this as an Enterprise level strategy change o Remediating current problems is only a short-term goal. Plan and invest for the future, or you might never get that chance “next year” 3.Create a Governance model o Identify the HBS Groups that will influence, either directly or indirectly, the requirements upon which the HBS Enterprise Data Integration Strategy will be developed and deployed. 7 The steps taken at HBS towards change

Enabling Change Turning a Roadmap into Reality 8

PowerCenter (Advanced Edition) An enterprise data integration platform for accessing, discovering, and integrating data from virtually any business system, in any format, and delivering that data throughout the enterprise. Some major options procured: Power Exchange for Web Services to act as a web services provider and consumer with 3 rd party systems by using predefined transformations. Real Time Option to service requests on demand, as opposed to batch, for web services provider or other event based protocols. High Availability Option minimizes service interruptions during hardware and/or software outages and reduces costs associated with data downtime. Data Cleanse and Match Option features powerful, integrated cleansing and matching capabilities to correct and remove duplicate customer data. 9 Where did we start?…Informatica is at the core of the DI Framework

Thinking about data as a Business Object Shared Business Entity Objects within the HBS Enterprise database are defined by a common object XSD, as an abstraction of the base tables that make up that entity. Thereby they relieve the Source applications from having to understand the direct database table interrelationships. Designing a reusable Transformation Layer Mappings are the details of the transaction data handling (i.e. Transformations) that occur from Source to Target. Examples of typical transformations can include derived data capture, complex calculations, data validation and cleansing. Define an Interface Protocol The primary role of the interface, or abstraction layer is to transform Source data inputs into a common format for transaction processing. The format we chose to represent these data inputs in a common form is XML. 10 From building blocks to a DI Framework

Let’s take a look inside Informatica and HEDEx 11

12 HBS Enterprise Data Exchange (HEDEx)

When to use a DI framework Guidelines for your team 13

14 When to use a DI framework

External Relations – Alumni Data Management An enhanced reporting solution for Donor Behavior which interfaces with our external Alumni clubs (Alumni Magnet) and data from the Harvard University Advance system. Type – Bulk Data Load Publisher “I am so grateful and excited that we finally have these reports to guide and evaluate our fundraising strategies” – Charlotte Smith, Director, Development Marketing and Production Executive Education – Program Delivery Transfers participant and program data, and enables the transition from enrollment (CRM) to program delivery tools that are Enterprise-based applications. Type – Change Data Publisher Reduced maintenance hours - 40% drop from the same review period in the previous year and provides early notification of errors and self-service correction. 15 Start with small success stories to build upon

16 The real value in a DI Framework!

Form a Data Integration Special Interest Group to address Define standards around Business Entity Objects for DI use across the enterprise. Create a framework for documentation, review, development and consumption of DI components. Draft a DI Strategy and Roadmap: A DI framework is a product like any other! Not everything works the way its advertised Informatica is an enterprise level tool suite (e.g. not Toad for Oracle). The greater the effort put into building the Mappings and Workflows the first time, the better the opportunity for re-use. Caution: allow for the unexpected Training is not optional While skill and determination will get you into a new technical tool suite, there is no substitute for formal training. 17 Lessons we’ve learned so far

Share Point Integration… Oracle PeopleSoft (Campus Solutions) Integration… Restate our HEDEx Roadmap… 18 So what’s next…