TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS.

Slides:



Advertisements
Similar presentations
Wrapper-Based Evolution of Legacy Information Systems From the article by P. Thiran, J. Hainaut, G. Houben and D Benslimane Presentation by: Alex Saville,
Advertisements

Data Modeling and Database Design Chapter 1: Database Systems: Architecture and Components.
1. 2 Summary 1. REVER presentation 2. REVER solutions 3. REVER added value 4. REVER Business model.
Copyright 2008 Tieto Corporation Database merge. Copyright 2008 Tieto Corporation Table of contents Please, do not remove this slide if you want to use.
1 Source cartography & modeling Source technical objects (DDL, programs, jcl,..) DATABASE MIGRATION The general method Target base re-engineering Data.
TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS.
Management Information Systems, Sixth Edition
Mainframe Modernization
Unified theory of software evolution Reengineering – Business process reengineering and software reengineering BPR model – Business definition, process.
Corporate Overview.
1 Introduction The Database Environment. 2 Web Links Google General Database Search Database News Access Forums Google Database Books O’Reilly Books Oracle.
Introduction to z/OS Basics © 2006 IBM Corporation Chapter 8: Designing and developing applications for z/OS.
Multiple Tiers in Action
CASE Tools CIS 376 Bruce R. Maxim UM-Dearborn. Prerequisites to Software Tool Use Collection of useful tools that help in every step of building a product.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 2 Introduction to Database Development.
Chapter 1: The Database Environment
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Database Management COP4540, SCS, FIU An Introduction to database system.
1 Source cartography & modeling Source technical objcts (DDL, programs, jcl,..) DATA MIGRATION general method Models compatibility & migration rules definition.
Chapter 2 Database System Concepts and Architecture
Cool:gen CIS 764, Fall 2007 Presentation By Mandar Haridas.
1 technical objects functional objects persistent objectsdescriptive objectsprocessing objects files content copybook, programs, DTD, …, directly managed.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Emerging Technologies Committee eForms and XML at NYS Dept of Taxation and Finance Jim Lieb, Director – Common Services NYS Department of Taxation and.
Data Warehousing: Tools & Technologies by: Er. Manu Bansal Assistant Professor Deptt of IT
Management Information Systems, 4 th Edition 1 Chapter 8 Data and Knowledge Management.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
Copyright © 2006, SAS Institute Inc. All rights reserved. Enterprise Guide 4.2 : A Primer SHRUG : Spring 2010 Presented by: Josée Ranger-Lacroix SAS Institute.
Intro to MIS – MGS351 Databases and Data Warehouses Chapter 3.
Compuware Corporation Business Driven SOA Edwin Schumacher Director of Product Management
Oracle Application Express (Oracle APEX), formerly called HTML DB, is a Free rapid web application development tool for the Oracle database.
Codeigniter is an open source web application. It occupies a very small amount of space in the memory and is most useful for developers who aim to develop.
9/14/2012ISC329 Isabelle Bichindaritz1 Database System Life Cycle.
TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE ACCURACY OF THE RESULTS.
More ETL. ETL in a nutshell ETL is an abbreviation of the three words Extract, Transform and Load. It is an ETL process to –extract data, mostly from.
CS480 Computer Science Seminar Introduction to Microsoft Solutions Framework (MSF)
Automatic GIS Feature Generation using SDE Java API Chuck Carufel - Indianapolis/ Marion County GIS Joe LaCombe – Woolpert.
Adma Archana CSC532 TERM PAPER LOUISIANA TECH UNIVERSITY DATABASE REVERSE ENGINEERING.
INFS614, Dr. Brodsky, GMU1 Database Management Systems INFS 614 Instructor: Professor Alex Brodsky
1/26/2004TCSS545A Isabelle Bichindaritz1 Database Management Systems Design Methodology.
ETL Extract. Design Logical before Physical Have a plan Identify Data source candidates Analyze source systems with data- profiling tools Receive walk-through.
Announcements. Data Management Chapter 12 Traditional File Approach  Structure Field  Record  File  Fixed All records have common fields, and a field.
Enterprise Transformation Methodology PIs Leo Mark - Georgia Tech, Spencer Rugaber, Georgia Tech, Wayne.
Chapter 2 Database System Concepts and Architecture Dr. Bernard Chen Ph.D. University of Central Arkansas.
® IBM Software Group © IBM Corporation DB2 DataWarehouse Edition Patrick SARFATY Channel Technical Sales IBM Software
Management Information Systems, 4 th Edition 1 Chapter 8 Data and Knowledge Management.
SimDB Implementation & Browser IVOA InterOp 2008 Meeting, Theory Session 1. Baltimore, 26/10/2008 Laurent Bourgès This work makes use of EURO-VO software,
® IBM Software Group © 2007 IBM Corporation Rational Transformation Workbench Analyzer for Eclipse V3.1 Name Title address.
Assoc. Prof. Dr. Ahmet Turan ÖZCERİT.  The concept of Data, Information and Knowledge  The fundamental terms:  Database and database system  Database.
TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS.
RoOUG Iunie Bucuresti, 26 Iunie Agenda Inregistrarea participantilor ODI – Common Use Cases 2Iunie 2013.
Enterprise Modernization Made Easy with IBM Development Tools
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
2) Database System Concepts and Architecture. Slide 2- 2 Outline Data Models and Their Categories Schemas, Instances, and States Three-Schema Architecture.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. Oracle Data Integrator By Lera Technologies.
Managing Data Resources File Organization and databases for business information systems.
Software Testing Training Online. Software testing is ruling the software business in current scenario. It provides an objective, independent view of.
ETL Design - Stage Philip Noakes May 9, 2015.
Intro to MIS – MGS351 Databases and Data Warehouses
OVirt Data Warehouse 02/11/11 Yaniv Dary BI Software Engineer, Red Hat.
Data Staging Data Staging Legacy System Data Warehouse SQL Server
An Introduction to database system
Chapter 2 Database System Concepts and Architecture
Overview of MDM Site Hub
tRelational/DPS Overview
Data Warehousing Concepts
UFCEUS-20-2 Web Programming
Presentation transcript:

TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS

DOMAIN REVER DBMS Data Access Processes Presentation Programs management (web server, transactional, jcl, …) Data DBMS Data Access Processes Presentation Programs management REVER DATA are at the HEART of I.S. And guaranteeing BUSINESS CONTINUITY DATA are at the HEART of I.S. And guaranteeing BUSINESS CONTINUITY

SOLUTIONS EVOLVE-EASY DEV-EASY D.I.S.Q. S.E.A.L. DOC-EASY SHARED KNOWLEDGE SHARED KNOWLEDGE RISKLESS ÉVOLUTIONS DATA QUALITY I.S. QUALITY DATA QUALITY I.S. QUALITY DB-MAIN KNOWLEDGE MODELLING TESTS ACCELERATOR EXTRACTIONS, ANONYMIZATIONS, GENERATIONS, COMPARISONS TESTS ACCELERATOR EXTRACTIONS, ANONYMIZATIONS, GENERATIONS, COMPARISONS DEVELOPMENT ACCELERATOR DATA ACCESS LAYER DEVELOPMENT ACCELERATOR DATA ACCESS LAYER

MODELLING DB-MAIN GENERATORS ANALYZERS. DATABASES STRUCTURES AND RULES DATABASES STRUCTURES AND RULES PROGRAMS & PROCESSES SOURCE CODE DATA DATABASE SOURCE CODE DATABASE SOURCE CODE PROGRAMS & PROCESSES SOURCE CODE DATA DOC EASY EVOLVE EASY S.E.A.L.DEV EASY D.I.S.Q. DB_MAIN REPOSITORY LEGACY DB programs COBOL, PLI,.. programs COBOL, PLI,.. jcl Rel. DB programs JAVA, PHP,… programs JAVA, PHP,… Web services ARCHITECTURE

CHARACTERISTICS INDUSTRIAL  AUTOMATIC  CONTROL REVER SOLUTIONS AGILES  GENERIC  FLEXIBLE  PROGRAMMABLE SERVICES  SUBCONTRACTING  SUPPORT

BENEFITS DEADLINE DECREASE DEADLINE DECREASE WORKLOAS DECREASE WORKLOAS DECREASE RISKS DECREASE RISKS DECREASE PROCESSES AUTOMATISATION OBJECTS MODELLING SOLUTIONS FLEXIBILITY RESULTS RELIABILITY COMPLETE AND CONTINUOUS CONTROL OF THE PROGRAMS AND THE APPLICATIONS In order to act WITHOUT RISKS COMPLETE AND CONTINUOUS CONTROL OF THE PROGRAMS AND THE APPLICATIONS In order to act WITHOUT RISKS EXHAUSTIVENESS SPEED EXHAUSTIVENESS SPEED UNDERSTANDING RISKLESS UNDERSTANDING RISKLESS ADEQUACY AGILITY ADEQUACY AGILITY SECURITY QUALITY SECURITY QUALITY

SOLUTIONS EVOLVE-EASY DEV-EASY D.I.S.Q. S.E.A.L. DOC-EASY DB-MAIN

EVOLVE-EASY  APPLICATION RE_ENGINEERING  Re-writing  Use of a new database  Technical re-architecture  Applications spread over several DBMS types  Simplification of redundancy within application  …  DATA MIGRATION  To a new DB  To a software package  …  DATABASE MIGRATION  DATABASE MERGE  DATABASE SPLIT

PHASE IIIPROGRAMS ADAPTATION PHASE II DATA MIGRATION PHASE I I.S. UNDERSTANDING AND MASTERY PROJECT APPROACH ETL SOURCE I.S. understanding Data validation validation migration Wrappers Source code adaptation SOURCE - TARGET correspondences TARGET I.S. understanding TARGET I.S. design or

Data DBMS Data access Processes Presentation Programs management REVER I.S. UNDERSTANDING

DDL source code Source code inventory Source code inventory Programs source code & JCL Application technical schema (data logical model) structures & implicit links  Data – data links Application technical schema (data logical model) structures & implicit links  Data – data links Application architecture  Links data-programs  Links programs-programs  Links data-data  Applic.Cartography  Specific markings Application architecture  Links data-programs  Links programs-programs  Links data-data  Applic.Cartography  Specific markings REPOSITORY (DB-MAIN) Missing Source code Data validation conceptua- lization Non compliant data or rules DB technical schema (data physical model) structures & explicit links DB technical schema (data physical model) structures & explicit links Applic. «business» schema (data conceptual model) « Business » concepts Applic. «business» schema (data conceptual model) « Business » concepts Technical risk control  Galois graph  « weight watcher » Technical risk control  Galois graph  « weight watcher » I.S. UNDERSTANDING

APPLICATION TECHNICAL SCHEMA APPLICATION « BUSINESS » SCHEMA REVERSE- EASY DB-MAIN DB TECHNICAL SCHEMA THE DATA SCHEMA I.S. UNDERSTANDING Links via programs

APPLICATION CARTOGRAPHY APPLICATION ARCHITECTURE DATA - DATA PROGRAMS- PROGRAMS DATA - PROGRAMS I.S. UNDERSTANDING Applic.link

APPLICATION ARCHITECTURE DATA - DATA PROGRAMS - PROGRAMS DATA - PROGRAMS DATA FLOW I.S. UNDERSTANDING.

WEIGHT WATCHER RISKS CONTROL DATA LINKS PROGRAMS LINKS DATA PROGRAMS LINKS + += I.S. UNDERSTANDING

PHASE I I.S. UNDERSTANDING AND MASTERY PROJECT APPROACH SOURCE I.S. understanding TARGET I.S. understanding TARGET I.S. design or

RESULTS Database creation source code (DDL) TARGET I.S. DESIGN DB-MAIN Conceptual model SOURCE Model SOURCE Model TARGET model

PHASE II DATA MIGRATION PROJECT APPROACH ETL Data validation validation migration SOURCE - TARGET correspondences

RESULTS SOURCE-TARGET Incompatibility list Help tool for establishing the correspondences SOURCE - TARGET List of SOURCE tables and columns without correspondence List of TARGET tables and columns without correspondences DATA MIGRATION Conceptual model SOURCE model TARGET model DB-MAIN Correspondences

RESULTS DATA MIGRATION « Neutral » DB (only the tables) « Neutral » DB (only the tables) Unload/ Load Unload/ Load Validation requests execution Unload/ Load Unload/ Load Validation requests Non compliant data report (HTML) SOURCE I.S. Conceptual model SOURCE model TARGET model DB-MAIN Correspondences

RESULTS « Specific » transformations code « Standards » Transformations code Data migration code Migration securisation and validation code DATA MIGRATION Conceptual model SOURCE model TARGET model DB-MAIN Correspondences

DATA MIGRATION

PHASE IIIPROGRAMS ADAPTATION PROJECT APPROACH Wrappers Source code adaptation

PROGRAMS ADAPTATION Wrappers source code + which wrapper in which program Wrappers source code + which wrapper in which program Conceptual model SOURCE model TARGET model DB-MAIN Correspondences

Programs source code adapted to the use of the wrappers Programs source code PROGRAMS ADAPTATION

DATABASE MIGRATION

TARGET DATABASE MIGRATION scenario 1 : New DB design + data migration (with replication) After project Before project New prog. Data access New DB Replication SOURCE Processes Presentation DB Data access jcl, server,... SOURCE Processes Presentation DB Data access jcl, server,...

TARGET DATABASE MIGRATION After project Before project new programs data access new DB SOURCE processings presentation DB data access jcl, server,... SOURCE procesings presentation wrappers jcl, server,... scenario 2 : New DB design + data migration + access modifications

TARGET DATABASE MIGRATION After project Before project new programs data access new DB SOURCE processings presentation DB data access jcl, server,... processings presentation wrappers jcl, server,... scenario 3 : New DB design + data migration + access modifications + programs modifications

CUSTOMERPARTNEROBJECTIVEQUANTITYTIMELOAD Ministère des Finances (BE) BULL belgium DB Replication GCOS8, IDS2  SOLARIS, DB2 380 tables3 months3 m*m O.E.S.C.(US)Bull US DB Migration GCOS8, IDS2  UNIX, POSTGRESS 3 bd – 780 tables 4500 prog. 6 months9 m*m Xxxx (FR)Metaware Application Migration Z/OS, IMS  UNIX, ORACLE 300 tables 3500 prog. 6 months4 m*m GIAL (BE)Anubex DB Migration BS2000, leasy  UNIX, ORACLE 140 tables3 months4 m*m Ministère des Finances (BE) CSCFlat file data migration 1 file  86 tables 2 months2 m*m PROJECTS

THANK YOU FOR YOUR ATTENTION