Data: Migrating, Distributing and Audit Tracking Michelle Ayers, Advisory Solution Consultant Mark Scanlon, UKI Regional Director 1 visionsolutions.com October 2013

Vision Solution Offerings

Data Migration visionsolutions.com 3 Traditional Approach – ‘Big Bang’ All Users Off System Users Back On System Monday AM EOD Friday SundaySaturday DOWNTIME Backups Copy Data Transform DataTesting/verify Issues: Hope you can complete all steps in available time window… Data volumes becoming ever larger – takes longer to copy and convert data Business becoming more 24 x 7 - reduced downtime window opportunities Final testing/verification limited to what remaining time you have Many stages are dependant on completion of previous stage

Data Migration visionsolutions.com 4 Alternative Approach – ‘Continuous Replication’

Data Migration visionsolutions.com 5 Benefits

Data Migration visionsolutions.com 6 More Complex: Source Data Target Data DT Share Captures Changes DT Share Captures Changes DT Share Applies trans to Staging Database DT Share Applies trans to Staging Database IBMiOracle Administration & Monitoring (Director, MonCon & Console) LAN / WAN Data path Custom Programs Custom Programs Custom Programs Custom Programs Staging Data DT Share Captures Changes DT Share Captures Changes DT Share Applies trans to Staging Database DT Share Applies trans to Staging Database LAN / WAN Data path

Data Sharing visionsolutions.com 7 Typical Approaches: Application Database Apps Website ERP Application Business Intelligence User Queries Lots of demands on the central database All users/applications using same data therefore all should be consistent However: Performance issues – too much access of same data Users running inefficient SQL statements Increased security risks from many different communication jobs Can lead to productivity issues for core business processes

Offloaded data warehouses have been around some years However: Data often loaded by batch overnight May even need to reload whole tables each night Issues: Data is out of date quickly Every day the database grows a little bit bigger, therefore each night the load job takes a little bit longer… Data Sharing visionsolutions.com 8 Typical Approach Using Offloaded Data Warehouse: Application Database ERP Application Business Intelligence User Queries Data Warehouse

Data Sharing visionsolutions.com 9 Alternative Approach – ‘CDC’ Change Data Capture Customer Story – Red Wing Shoe Company - USA OFFLOAD QUERY & REPORTING PROJECT Manufacturing MS SQL Server Query reports Data Warehouse load Double-Take Share Real time CDC replication with transformation Reduce CPU and I/O overhead on production system improve user response times Many cost effective tools available on MS SQL server platform for query reports Data is already partially ‘scrubbed’ and available for loading data warehouses and data marts without performance impact on production system Production System Offload Query System IBM System i DB2 Lawson M3 (Movex)

Data Sharing visionsolutions.com 10 Alternative Approach – ‘CDC’ Change Data Capture Customer Example – Application Interface Bi-directional replication IBM System i DB2 Manufacturing ERP Introduced automated manufacturing inspection tracking and also faster Data Warehouse Load. MS SQL Server Double-Take Share Real time CDC replication with transformation Production line information is transformed and sent to ERP Production System APPLICATION INTEGRATION PROJECT Query reports MS SQL Server Double-Take Share Replaced batch reload of data warehouse with DT Share creating incremental extracts of last changed row, and deleted transactions. Third Party Inspection Application

Data Auditing visionsolutions.com 11 Traditional Approach to Field Audit Tracking Application Database Audit Files Before and after changes captured via embedded program code Or trigger programs Older applications may be using embedded code to capture changes – high overhead to maintain and ensure nothing missed Trigger based capture can have database overhead though should ensure call changes captured ERP provided solution can be limited: May only support pre-selected tables/columns Restricted data filtering capabilities

Data Auditing visionsolutions.com 12 Alternative Approach – ‘CDC’ Change Data Capture FIELD AUDIT TRACKING PROJECT Application Database Audit Files Double-Take Share Real time CDC replication captures before and after values IBMi uses journal receiver entries Capture changes made within or outside the ERP application Optionally add row/column filtering Choose columns from any database table, including local modification Target audit files are custom designed Add target columns to hold trans type, timestamp, user id Access to audit data via custom queries/reports IBMi M3 java database has journaling switched on by installation – DT Share can use these journal receivers. Target audit files can be held in same database or different, say MS SQL Server

Double-Take Share visionsolutions.com 13

Thank You! 14 visionsolutions.com facebook.com/vsichannel youtube.com/vsichannel linkedin.com/companies/6542 twitter.com/vsichannel businesscontinuitytoday.com