Copyright 2008 Tieto Corporation Database merge. Copyright 2008 Tieto Corporation Table of contents Please, do not remove this slide if you want to use.

Slides:



Advertisements
Similar presentations
Introducing DB-123 A New Approach to Database Management Systems Thomas Schneider February 2004.
Advertisements

Chapter 10: Designing Databases
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Extended Learning Module J (Office 2010 Version) Implementing.
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Extended Learning Module J (Office 2010 Version) Implementing.
Systems Analysis and Design in a Changing World
Chapter 8: Evaluating Alternatives for Requirements, Environment, and Implementation.
Database Processing: Fundamentals, Design, and Implementation, 9/e by David M. KroenkeChapter 5/1 Copyright © 2004 Please……. No Food Or Drink in the class.
National Digital Repository ® Preserving the imperfect: reflections from NDAD and elsewhere Kevin Ashley Head of Digital Archives Group ULCC.
Concepts of Database Management Sixth Edition
Chapter 6 Methodology Conceptual Databases Design Transparencies © Pearson Education Limited 1995, 2005.
Extended Learning Module J (Office 2007 Version) Implementing a Database with Microsoft Access McGraw-Hill/Irwin Copyright © 2010 by the McGraw-Hill Companies,
Database Design Concepts INFO1408 Term 2 week 1 Data validation and Referential integrity.
Concepts of Database Management Seventh Edition
Methodology Conceptual Database Design
1 Source cartography & modeling Source technical objcts (DDL, programs, jcl,..) DATA MIGRATION general method Models compatibility & migration rules definition.
TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS.
Michael F. Price College of Business Chapter 6: Logical database design and the relational model.
Leaving a Metadata Trail Chapter 14. Defining Warehouse Metadata Data about warehouse data and processing Vital to the warehouse Used by everyone Metadata.
Logical Database Design Nazife Dimililer. II - Logical Database Design Two stages –Building and validating local logical model –Building and validating.
CSC271 Database Systems Lecture # 21. Summary: Previous Lecture  Phases of database SDLC  Prototyping (optional)  Implementation  Data conversion.
L/O/G/O Metadata Business Intelligence Erwin Moeyaert.
Database System Development Lifecycle © Pearson Education Limited 1995, 2005.
Copyright © 2012 Pearson Education, Inc. Publishing as Prentice Hall 9.1.
Database Design - Lecture 1
ITEC224 Database Programming
MIS 385/MBA 664 Systems Implementation with DBMS/ Database Management Dave Salisbury ( )
Chapter 16 Methodology - Conceptual Database Design.
Methodology - Conceptual Database Design Transparencies
Software School of Hunan University Database Systems Design Part III Section 5 Design Methodology.
Methodology Conceptual Databases Design
9/14/2012ISC329 Isabelle Bichindaritz1 Database System Life Cycle.
1 Chapter 15 Methodology Conceptual Databases Design Transparencies Last Updated: April 2011 By M. Arief
TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE ACCURACY OF THE RESULTS.
Session 4: The HANA Curriculum and Demos Dr. Bjarne Berg Associate professor Computer Science Lenoir-Rhyne University.
More ETL. ETL in a nutshell ETL is an abbreviation of the three words Extract, Transform and Load. It is an ETL process to –extract data, mostly from.
Database Design (Normalizations) DCO11310 Database Systems and Design By Rose Chang.
0 A Workable Solution for Basic Metadata January 9, 2006.
Building Information Systems & Managing Projects.
Salt Suite User Guide (Copyright Salt ).
Methodology - Conceptual Database Design. 2 Design Methodology u Structured approach that uses procedures, techniques, tools, and documentation aids to.
CSCI 3140 Module 3 – Logical Database Design for the Relational Model Theodore Chiasson Dalhousie University.
1/26/2004TCSS545A Isabelle Bichindaritz1 Database Management Systems Design Methodology.
DATABASE MGMT SYSTEM (BCS 1423) Chapter 5: Methodology – Conceptual Database Design.
Team Dosen UMN Database Design Connolly Book Chapter
ETL Extract. Design Logical before Physical Have a plan Identify Data source candidates Analyze source systems with data- profiling tools Receive walk-through.
Oracle Data Integrator Transformations: Adding More Complexity
MIS 327 Database Management system 1 MIS 327: DBMS Dr. Monther Tarawneh Dr. Monther Tarawneh Week 2: Basic Concepts.
Concepts of Database Management Sixth Edition Chapter 6 Database Design 2: Design Method.
Methodology - Conceptual Database Design
DataBase Management System What is DBMS Purpose of DBMS Data Abstraction Data Definition Language Data Manipulation Language Data Models Data Keys Relationships.
Microsoft ® Office Excel 2003 Training Using XML in Excel SynAppSys Educational Services presents:
Chapter 9 Logical Database Design : Mapping ER Model To Tables.
Oracle Data Integrator Data Quality (Integrity Control)
Information Integration BIRN supports integration across complex data sources – Can process wide variety of structured & semi-structured sources (DBMS,
Database Management Systems (DBMS)
Issues in Ontology-based Information integration By Zhan Cui, Dean Jones and Paul O’Brien.
Physical Database Design Purpose- translate the logical description of data into the technical specifications for storing and retrieving data Goal - create.
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Extended Learning Module J (Office 2007 Version) Implementing.
CS523 Database Design Instructor : Somchai Thangsathityangkul You can download lecture note at Class Presence 10% Quiz 10%
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
IST 210 Database Design Process IST 210, Section 1 Todd S. Bacastow January 2004.
Investigate Plan Design Create Evaluate (Test it to objective evaluation at each stage of the design cycle) state – describe - explain the problem some.
Generating XML Data from a Database Eugenia Fernandez IUPUI.
Logical Database Design and the Rational Model
Data Model.
Database solutions Chosen aspects of the relational model Marzena Nowakowska Faculty of Management and Computer Modelling Kielce University of Technology.
COMP 208/214/215/216 – Lecture 7 Documenting Design.
CS 8532: Advanced Software Engineering
Reportnet 3.0 Database Feasibility Study – Approach
Presentation transcript:

Copyright 2008 Tieto Corporation Database merge

Copyright 2008 Tieto Corporation Table of contents Please, do not remove this slide if you want to use the Create table of contents functionality. How to use: First finalize your presentation When your done choose Create table of contents from the TE Tools tab Title slide headings will get the first level bullets Content slide headings the second level bullets Front page and Table of contents page will not be included If you have content slides without headings, those will not be included Note! Table of contents will be always created on the second slide of your presentation. If you have removed the slide or used it as content slide, insert a new empty slide on that place. 2

Copyright 2008 Tieto Corporation I have 2 DB that I have to merge. Which are the different alternatives and how to solve the merging riskless, quickly and with an appropriate cost ?

Copyright 2008 Tieto Corporation Types of merging Database Data Objectives Data transfer to a “ not empty ” target Database Examples Data integration in existing Databases Data & structures Objectives Databases consolidation Examples Datawarehouse Applications Data & structures & programs Objectives Application merging Examples Organizations merging, applications integration

Copyright 2008 Tieto Corporation merge scenario’s prog C C prog A A progB B merge A & B into C prog A A prog B B prog A A merge B to A (or A to B) prog A A prog B B prog A A+B prog B merge A & B to obtain (A+B) What does this mean for IT

Copyright 2008 Tieto Corporation A MERGE SCENARIO 1 MERGE A INTO B (or B to A) Risk & complexity from a technical point of view it is a simple problem of “ data migration ” the data of applications A have to be moved to database B business have to decide the “ best ” application (A or B) for their needs for data migration two main problems must be solved the compatibility between the source (A) and source (B) the “ deduplication ” question prog A A prog B B prog A A SCENARIO 1

Copyright 2008 Tieto Corporation A MERGE SCENARIO 2 MERGE A & B INTO C Risk & complexity prog C C prog A A progB B business selected application C which is a new or an existing application a package the database structure C is different from database A structure and database B structure from a technical point of view it is a problem of two “ data migration ” the data of applications A have to be moved to database C the data of applications B have to be moved to database C this scenario is the same as the previous one: the problems are same but must be solved two times SCENARIO 2

Copyright 2008 Tieto Corporation A MERGE SCENARIO 3 MERGE A & B TO OBTAIN (A+B) Risk & complexity the database structure (A+B) is a “ meta structure ” integrating database A structure and database B structure  the target (A+B) are obviously “ compatible ” with source A & B from technical point of view it is a problem of two “ application migration ” the database (A+B) have to be defined for A application the data have to be “ moved ” to (A+B) programs must be adapted to use (A+B) for B application the data have to be “ moved ” to (A+B) programs must be adapted to use (A+B) for “ data ” only the problem of “ deduplication ” must be solved prog A A prog B B prog A A+B prog B SCENARIO 3

Copyright 2008 Tieto Corporation prog C C A merge scenario’s Risk & complexity scenario impacts business & organization technical programs database structurescontent (data) 1) merge B to A (or A to B)training for users B (or users A) no impact on programs no impact on target structure A + B 2) merge A & B to obtain C new application training for users A & B new devpt ? package ? rewriting ? CA + B 3) merge A & B to obtain (A+B) no training for users adapt prgs. A & adapt prgs. B new structure covering (A & B) A + B prog A A progB B prog A A prog B B prog A A A prog B B prog A A+B prog B 123 IMPACTS OF THE 3 SCENARIO

Copyright 2008 Tieto Corporation WHAT IS THE BEST SCENARIO ? THE BEST SCENARIO IS THE ONE PRODUCING A SOLUTION COMPLIANT TO BUSINESS NEEDS Two ways to know the business needs : a classical top-down approach starting from “ business needs ” a bottom-up approach starting from the existing applications (A &/or B) this two approaches are complementary REVER ’ s technologies help the “ project owner ” (business) to understand, based on the semantic model, which system of the two existing application is the most appropriate to answer their needs to evaluate differences between the 2 sources. to check how far they are compatible

Copyright 2008 Tieto Corporation WHAT IS THE PROBLEM OF THE IS“COMPATIBILITY” two Information Systems are “ compatible ” if they share the same concepts at the semantic level (IS definitions)  This means that for a merge of two databases it is necessary  to compare concepts and definition of the two semantics schemas (semantic level)  to compare the database structure implementation of the logical schemas (logical level)  to compare the data value of the two databases (physical level)

Copyright 2008 Tieto Corporation EXAMPLES OF SEMANTIC DIFFERENCES contracts disasters additional clauses Source 1Source 2 example 2 : relational differences example 1 : definition differences contracts disasters additional clauses contracts : a contract can be signed by one person Or by a group contracts : a contract can only be signed by one person impoverishment enrichment ?

Copyright 2008 Tieto Corporation EXAMPLES OF LOGICAL DIFFERENCES Source 1Source 2 example 1 : differences in transformation a multivalued field : PHONENBR (5) is designed as 5 columns PHONE1, … PHONE5 is designed as 1 table with a foreign key PHONENBR, FK example 2 : differences in implementation a relation between two entities is implemented as a « set » in a CODASYL DBMS  records must be accessed via the « record owner » is implemented as a « FOREIGN KEY » in a relational DBMS  records can be accessed directly

Copyright 2008 Tieto Corporation EXAMPLES OF PHYSICAL DIFFERENCES Source 1Source 2 example 1 : differences in format a field « BIRTHDATE » is define as 6 digit is define as « date » example 2 : differences in value a field « SEX » is filled by « M » or « F » is filled by « 1 » or « 2 »

Copyright 2008 Tieto Corporation WHAT DOES REVER’s TECHNOLOGIES BRING TO A DATABASE MERGE for scenario 1 & 2 : REVER ’ s technologies rebuild the three level (physical, logical, semantic) models for the source and the target database allow the business to compare the two semantic models and to define the “ mapping ” between source and target model at semantic level based on this mapping compare automatically source and target models at logical and physical level check the data quality in the source and target databases identify where are the ‘ incompatibility ” between source and target databases allow to define mapping “ rules ” to “ map ” the data from source to target database generate automatically programs to move, transform and load data identify which programs present higher risks and must be tested

Copyright 2008 Tieto Corporation for scenario 3 : REVER ’ s technologies rebuild automatically the three level (physical, logical, semantic) models for the two databases build a “ meta ” model for the “ target ” database ” which included all structures and relations of both databases generate automatically programs to move data from the two sources databases to the target adapt automatically programs of the two source applications to use the target database identify which programs present higher risks and must be tested this solution is very useful when the source databases are implemented in different DBMS (e.g. IMS and IDMS) and the target is a third DBMS (e.g. : relational) It is the solution of choice to have a “ quick and riskless merge ” giving time to think more in detail which other scenario would best fit the business needs and evolution ( rewrite the application, buy a package … ) WHAT DOES REVER’s TECHNOLOGIES BRING TO A DATABASE MERGE

Copyright 2008 Tieto Corporation The different steps for scenario 3 SCENARIO 3 DETAILS

Copyright 2008 Tieto Corporation In a nutshell, where can REVER help ? Before deploying the right approach The first decision is a business decision Rever can highlight the risk linked to the chosen approach REVER can highlight the order of migration of each procedure (group) Identification of all links between procedures Technical phasing integrating programs & data During deployment of the selected approach Target DB conception Data quality control and compatibility with the new structure Automatic generation of the unload/load programs Mapping help Source/target Automatic programs transformation if needed After migration Logical dataset extraction Knowledge base available for future evolutions XML comparator

Copyright 2008 Tieto Corporation REVER ADDED VALUE On top of the added value induced by the MDDE: Automatic generation of the programs Documentation always available Models available after migration REVER solutions provide several added values: Choice between “ soft ” evolution or “ Big Bang ” Optimized native target base, ready for new developments Integration into the target model of new functions and/or constraints if needed Data validation before merging Consistency of the merged data Merging checks Automatic modification of the existing programs to access the new DB

Copyright 2008 Tieto Corporation MERGING ACTIVITIES

Copyright 2008 Tieto Corporation Questions & Answers