Data Migration Assurance
Data Migration Assurance - Agenda Data Migration(DM) Assurance Introduction (Why & What) Data Migration process vis-à-vis DM Assurance Process DM Assurance Scenarios Summary
Some Teasing Questions Who is responsible if Data inaccuracy gets into the system? (pl don’t say committee) CIO CISO Head IT CEO / CFO IT Vendor Auditor
Some Teasing Questions Do we have Data Migration Policy in place? Identification of Critical applications and DB’s Migration Process Back up process Roles and Responsibilities Time Lines Approach – Big Bang Vs Moduler Management of Migration Document
Some Teasing Questions Do we have Data Migration verification policy? Need for carrying out the same Coverage – Detail Vs. Sampling, Ledger balances Vs. Masters, Logs etc. When to carry out – Pre Migration Vs. Post Migration or Both Who will do the same – Internal Vs. External
Some Teasing Questions What will be the impact if Data Inaccuracy gets into the system? Many Is there any standard on DM / what has COBIT to say on this? Lets look at some best practices.
What is Data Migration Assurance? is a process of providing assurance to all the stakeholders that the data migrated from source systems to the Target System is Complete Arithmetically Accurate Correct It also provides an assurance on the Data migration process adopted The assurance is provided by developing/Configuring automated data Assurance tool whereby maintaining complete independence. Providing “Data Migration Assurance Report” highlighting errors in the data migrated to the Target system which is at each field level covering various type of data like (Numerical, Text, Date etc.) Objective: is to enusre Completeness Arnitjmentical Accuracy Correctness 11/19/2018
Migration vis-à-vis Migration Assurance Roll Out Post Migration Assurance Migration Strategy Migration Process Assurance Independent Assurance Tool Migration Logic Correction Migration Logic Correction Migration Tool Pre rollout / UAT Phase Pre Migration Assurance MIGRATION PHASES MIGRATION Assurance PHASES
Data Migration Assurance Methodology Migration Process Assurance Independent Assurance Tool Pre Migration Assurance Correction Phase Post Migration Assurance Review of the Data Migration strategy document Perform a walkthrough of the data migration process Value addition by Auditor Identify gaps in the data migration process followed Benchmark the processes followed to best practices. Suggest suitable recommendations to bridge the gaps
Data Migration Assurance Methodology Migration Process Assurance Independent Assurance Tool Pre Migration Assurance Correction Phase Post Migration Assurance Develop an independent migration logic and build the migration result for verification. Value addition by Auditor Maintain complete independence and hence more accurate results Re usability becomes easy once the tool is developed and hence enhances future regression. Knowledge is retained for future use and discussion with vendor in case of any further changes
Data Migration Assurance Methodology Migration Process Assurance Independent Assurance Tool Pre Migration Assurance Correction Phase Post Migration Assurance Stage 3 and 4 will go hand-in-hand Identification of Critical data fields based on the Financial and Non Financial Impact Verification of sample data, covering all modules and representing 100% data population Fine Tuning of Migration Logic Number of anomalies will reduce before GO-Live Value Add by Auditor
Data Migration Assurance Methodology Migration Process Assurance Independent Assurance Tool Pre Migration Assurance Correction Phase Post Migration Assurance After GO-Live, 100% data verification for completeness, accuracy and correctness Submission of detail exception reports to enable organization to make necessary changes Value addition by Auditor Supports 100% data analysis at any volume where by removing the major bottleneck of manual sample verification process Provides automation capability whereby analysis done faster with utmost accuracy and reliance.
Some Hypothetical cases Migration Assurance Scenarios 11/19/2018
Core DB To Data Ware House Migration Assurance Scenarios Legacy To New Solution Challenges Multiple Legacy EOD (Legacy) to BOD (New Solution) data availability Vendor Management Version Migration High Volume Online Migration Post Migration Window time is limited Core DB To Data Ware House Multiple Input sources Scenario 1 Scenario 2 Scenario 3
Critical Success Factor Scenario 1 - Legacy To New Solution Challenges Multiple Legacy Systems Legacy and Core system Data Availability Vendor Management Critical Success Factor Techno Functional Experts Data Backup strategy Migration Strategy Documents and its Versions Project Management Skills
Critical Success Factor Scenario 2 – Core Version X To New Version Challenges High Volume Post Migration Window Time is limited Online Migration Critical Success Factor Hardware Availability Identification of Business Critical Data Pre migration Assurance Migration Strategy Documents and its Versions Split of project on immediate critical verification and what can be analyzed later on. Project Management Skills
Critical Success Factor Scenario 3 – Core DB To Data Ware House Challenges Multiple inputs to centralized system High Volume Online Migration Critical Success Factor Hardware Availability Migration Strategy Documents and its Versions Project Management Skills
Case Study - Scenario 1 COMPANY NAME IN NUMBERS PROJECT COMPLEXITY Large Size PSU Bank COMPANY NAME Legacy Systems – 14 Target System – 1 Branches – 2200 Time Line – 6 Months IN NUMBERS Non availability of strategy documents and field mapping files Multiple versions of same legacy system Multiple Data formats Interest Accrual Calculation PROJECT COMPLEXITY
Scenario 1 (Contd…) PHASES INVOLVED CRITICAL SUCCESS FACTOR Post Migration Assurance Compliance PHASES INVOLVED Legacy and Target systems Technical and Functional Knowledge Team combination of Technical and Functional Escalation of Project Issues CRITICAL SUCCESS FACTOR Bank has made recovery of Rs. 1.90 Crore of Interest, which was not charged to the customers during Live Migration Identified various anomalies having cascading effect and hence saved future losses. Immediate ROI
Case Study - Scenario 2 COMPANY NAME IN NUMBERS PROJECT COMPLEXITY Largest Depository of India – Largest DB migration project as on date. COMPANY NAME Number of DPs - 367 Data Size - 900 GB GO Live Window Time – 16 Hrs. IN NUMBERS High Volume Data Limited GO Live Window PROJECT COMPLEXITY Hardware Availability Business Critical Fields Identification Accurate project planning and execution CRITICAL SUCCESS FACTOR
Scenario 2 (Value Add) 25% of Total Data Population Errors reduced to 3% of total data population in non critical area
Summary - DM Assurance Despite the best IT initiative – Data inconstancy can jeopardize the entire effort and can be very expensive for the organization. As any other QA process Data migration assurance also requires an independent / third party assurance. This is also recommended by regulators like RBI. Migration assurance process starts from migration strategy phase (Design) and delivers best results if part of the pre and post migration verification stage. Since our business derives intelligence from Data – this process gives tremendous comfort to all the key stakeholders, Statutory Auditors, Regulators and the Data users. 11/19/2018
Data Migration Assurance Thanks www.auditimeindia.com