TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS
DOMAIN REVER DBMS Data Access Processes Presentation Programs management (web server, transactional, jcl, …) Data DBMS Data Access Processes Presentation Programs management REVER DATA are at the HEART of I.S. And guaranteeing BUSINESS CONTINUITY DATA are at the HEART of I.S. And guaranteeing BUSINESS CONTINUITY
SOLUTIONS EVOLVE-EASY DEV-EASY D.I.S.Q. S.E.A.L. DOC-EASY SHARED KNOWLEDGE SHARED KNOWLEDGE RISKLESS ÉVOLUTIONS DATA QUALITY I.S. QUALITY DATA QUALITY I.S. QUALITY DB-MAIN KNOWLEDGE MODELLING TESTS ACCELERATOR EXTRACTIONS, ANONYMIZATIONS, GENERATIONS, COMPARISONS TESTS ACCELERATOR EXTRACTIONS, ANONYMIZATIONS, GENERATIONS, COMPARISONS DEVELOPMENT ACCELERATOR DATA ACCESS LAYER DEVELOPMENT ACCELERATOR DATA ACCESS LAYER
MODELLING DB-MAIN GENERATORS ANALYZERS. DATABASES STRUCTURES AND RULES DATABASES STRUCTURES AND RULES PROGRAMS & PROCESSES SOURCE CODE DATA DATABASE SOURCE CODE DATABASE SOURCE CODE PROGRAMS & PROCESSES SOURCE CODE DATA DOC EASY EVOLVE EASY S.E.A.L.DEV EASY D.I.S.Q. DB_MAIN REPOSITORY LEGACY DB programs COBOL, PLI,.. programs COBOL, PLI,.. jcl Rel. DB programs JAVA, PHP,… programs JAVA, PHP,… Web services ARCHITECTURE
CHARACTERISTICS INDUSTRIAL AUTOMATIC CONTROL REVER SOLUTIONS AGILES GENERIC FLEXIBLE PROGRAMMABLE SERVICES SUBCONTRACTING SUPPORT
BENEFITS DEADLINE DECREASE DEADLINE DECREASE WORKLOAS DECREASE WORKLOAS DECREASE RISKS DECREASE RISKS DECREASE PROCESSES AUTOMATISATION OBJECTS MODELLING SOLUTIONS FLEXIBILITY RESULTS RELIABILITY COMPLETE AND CONTINUOUS CONTROL OF THE PROGRAMS AND THE APPLICATIONS In order to act WITHOUT RISKS COMPLETE AND CONTINUOUS CONTROL OF THE PROGRAMS AND THE APPLICATIONS In order to act WITHOUT RISKS EXHAUSTIVENESS SPEED EXHAUSTIVENESS SPEED UNDERSTANDING RISKLESS UNDERSTANDING RISKLESS ADEQUACY AGILITY ADEQUACY AGILITY SECURITY QUALITY SECURITY QUALITY
SOLUTIONS EVOLVE-EASY DEV-EASY D.I.S.Q. S.E.A.L. DOC-EASY DB-MAIN
EVOLVE-EASY APPLICATION RE_ENGINEERING Re-writing Use of a new database Technical re-architecture Applications spread over several DBMS types Simplification of redundancy within application … DATA MIGRATION To a new DB To a software package … DATABASE MIGRATION DATABASE MERGE DATABASE SPLIT
PHASE IIIPROGRAMS ADAPTATION PHASE II DATA MIGRATION PHASE I I.S. UNDERSTANDING AND MASTERY PROJECT APPROACH ETL SOURCE I.S. understanding Data validation validation migration Wrappers Source code adaptation SOURCE - TARGET correspondences TARGET I.S. understanding TARGET I.S. design or
Data DBMS Data access Processes Presentation Programs management REVER I.S. UNDERSTANDING
DDL source code Source code inventory Source code inventory Programs source code & JCL Application technical schema (data logical model) structures & implicit links Data – data links Application technical schema (data logical model) structures & implicit links Data – data links Application architecture Links data-programs Links programs-programs Links data-data Applic.Cartography Specific markings Application architecture Links data-programs Links programs-programs Links data-data Applic.Cartography Specific markings REPOSITORY (DB-MAIN) Missing Source code Data validation conceptua- lization Non compliant data or rules DB technical schema (data physical model) structures & explicit links DB technical schema (data physical model) structures & explicit links Applic. «business» schema (data conceptual model) « Business » concepts Applic. «business» schema (data conceptual model) « Business » concepts Technical risk control Galois graph « weight watcher » Technical risk control Galois graph « weight watcher » I.S. UNDERSTANDING
APPLICATION TECHNICAL SCHEMA APPLICATION « BUSINESS » SCHEMA REVERSE- EASY DB-MAIN DB TECHNICAL SCHEMA THE DATA SCHEMA I.S. UNDERSTANDING Links via programs
APPLICATION CARTOGRAPHY APPLICATION ARCHITECTURE DATA - DATA PROGRAMS- PROGRAMS DATA - PROGRAMS I.S. UNDERSTANDING Applic.link
APPLICATION ARCHITECTURE DATA - DATA PROGRAMS - PROGRAMS DATA - PROGRAMS DATA FLOW I.S. UNDERSTANDING.
WEIGHT WATCHER RISKS CONTROL DATA LINKS PROGRAMS LINKS DATA PROGRAMS LINKS + += I.S. UNDERSTANDING
PHASE I I.S. UNDERSTANDING AND MASTERY PROJECT APPROACH SOURCE I.S. understanding TARGET I.S. understanding TARGET I.S. design or
RESULTS Database creation source code (DDL) TARGET I.S. DESIGN DB-MAIN Conceptual model SOURCE Model SOURCE Model TARGET model
PHASE II DATA MIGRATION PROJECT APPROACH ETL Data validation validation migration SOURCE - TARGET correspondences
RESULTS SOURCE-TARGET Incompatibility list Help tool for establishing the correspondences SOURCE - TARGET List of SOURCE tables and columns without correspondence List of TARGET tables and columns without correspondences DATA MIGRATION Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
RESULTS DATA MIGRATION « Neutral » DB (only the tables) « Neutral » DB (only the tables) Unload/ Load Unload/ Load Validation requests execution Unload/ Load Unload/ Load Validation requests Non compliant data report (HTML) SOURCE I.S. Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
RESULTS « Specific » transformations code « Standards » Transformations code Data migration code Migration securisation and validation code DATA MIGRATION Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
DATA MIGRATION
PHASE IIIPROGRAMS ADAPTATION PROJECT APPROACH Wrappers Source code adaptation
PROGRAMS ADAPTATION Wrappers source code + which wrapper in which program Wrappers source code + which wrapper in which program Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
Programs source code adapted to the use of the wrappers Programs source code PROGRAMS ADAPTATION
DATABASE MIGRATION
TARGET DATABASE MIGRATION scenario 1 : New DB design + data migration (with replication) After project Before project New prog. Data access New DB Replication SOURCE Processes Presentation DB Data access jcl, server,... SOURCE Processes Presentation DB Data access jcl, server,...
TARGET DATABASE MIGRATION After project Before project new programs data access new DB SOURCE processings presentation DB data access jcl, server,... SOURCE procesings presentation wrappers jcl, server,... scenario 2 : New DB design + data migration + access modifications
TARGET DATABASE MIGRATION After project Before project new programs data access new DB SOURCE processings presentation DB data access jcl, server,... processings presentation wrappers jcl, server,... scenario 3 : New DB design + data migration + access modifications + programs modifications
CUSTOMERPARTNEROBJECTIVEQUANTITYTIMELOAD Ministère des Finances (BE) BULL belgium DB Replication GCOS8, IDS2 SOLARIS, DB2 380 tables3 months3 m*m O.E.S.C.(US)Bull US DB Migration GCOS8, IDS2 UNIX, POSTGRESS 3 bd – 780 tables 4500 prog. 6 months9 m*m Xxxx (FR)Metaware Application Migration Z/OS, IMS UNIX, ORACLE 300 tables 3500 prog. 6 months4 m*m GIAL (BE)Anubex DB Migration BS2000, leasy UNIX, ORACLE 140 tables3 months4 m*m Ministère des Finances (BE) CSCFlat file data migration 1 file 86 tables 2 months2 m*m PROJECTS
THANK YOU FOR YOUR ATTENTION