The Art of DR Auditing By Acmeware, Inc. Edward Chisam – Senior Consultant.

Slides:



Advertisements
Similar presentations
Complete Event Log Viewing, Monitoring and Management.
Advertisements

CHAPTER OBJECTIVE: NORMALIZATION THE SNOWFLAKE SCHEMA.
Unveiling ProjectWise V8 XM Edition. ProjectWise V8 XM Edition An integrated system of collaboration servers that enable your AEC project teams, your.
Module 12: Auditing SQL Server Environments
Basics Of Spreadsheets Chapter Spreadsheet spreadsheet: grid of cells, each of which can contain text data or numeric data.
Complete Event Log Viewing, Monitoring and Management.
Advanced Database Systems September 2013 Dr. Fatemeh Ahmadi-Abkenari 1.
CAATTs for Data Extraction and Analysis
Data Conversion to a Data warehouse Presented By Sanjay Gunasekaran.
SRDR Quarterly Training Brown Evidence-based Practice Center Brown University September 12 th, :00pm-2:00pm SRDR Data Import Tool A Tool to Import.
Intro Informatica Productivity Pack Save Time and Money while Increasing the Quality of Your PowerCenter Deployment Louis Hausle.
September 5, 2015 Office Setup. Lesson Overview: Office Setup  In this lesson we will cover:  Adding new offices to COM  Individual office setup 
Maintaining a Microsoft SQL Server 2008 Database SQLServer-Training.com.
SSIS Over DTS Sagayaraj Putti (139460). 5 September What is DTS?  Data Transformation Services (DTS)  DTS is a set of objects and utilities that.
FireRMS SQL Audit, Archiving & Purging Presented by Laura Small FireRMS Quality Assurance.
Copyright 2003 Accenture. All rights reserved. Accenture, its logo, and Accenture Innovation Delivered are trademarks of Accenture. Data Migration in Oracle.
Crystal And Elliott Edward M. Kwang President. Crystal Version Standard - $145 Professional - $350 Developer - $450.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
What is Sure BDCs? BDC stands for Batch Data Communication and is also known as Batch Input. It is a technique for mass input of data into SAP by simulating.
Introduction to database systems
Microsoft Office 2003: Advanced 1 ADVANCED MICROSOFT ACCESS Lesson 17 – Utilizing Advanced Management Tools.
Informix IDS Administration with the New Server Studio 4.0 By Lester Knutsen My experience with the beta of Server Studio and the new Informix database.
Web Scale Discovery Service Vs Federated Search NIKESH NARAYANAN
Design and Programming Chapter 7 Applied Software Project Management, Stellman & Greene See also:
DTS Conversion to SSIS Conversion Best Practices Mike Davis
Module 5 Planning for SQL Server® 2008 R2 Indexing.
Learningcomputer.com SQL Server 2008 – Administration, Maintenance and Job Automation.
IT 456 Seminar 5 Dr Jeffrey A Robinson. Overview of Course Week 1 – Introduction Week 2 – Installation of SQL and management Tools Week 3 - Creating and.
ETLity Speed up your ETL development! → faster time to market → guaranteed quality → fix price development.
The Initiative For School Empowerment and Excellence (i.4.see) “Empowering teachers, administrators, policy makers, and parents to increase student achievement.”
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
Crystal And Elliott Edward M. Kwang President. Objective A brief demo of Crystal Report to entice you –People spend thousand of dollars to attend Crystal.
Today’s Agenda Chapter 7 Review for Midterm. Data Transfer Tools DTS (Data Transformation Services) BCP (Bulk Copy Program) BULK INSERT command Other.
Moving Beyond Standard BMV Reports Using Data Repository Session 373 Presented by: Ian Proffer.
Week 7 : Chapter 7 Agenda SQL 710 Maintenance Plan:
FY 2011 Public Libraries Survey WebPLUS Software Training.
Power at Your Fingertips –Overlooked Gems in Oracle EM John Sheaffer Principal Sales Consultant – Oracle Corporation.
6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.
NEED AT The National Equipment Exchange Depot Pass It On Center.
Metadata By N.Gopinath AP/CSE Metadata and it’s role in the lifecycle. The collection, maintenance, and deployment of metadata Metadata and tool integration.
Using MS Excel to validate & load your data into Oracle EBS.
Database Projects in Visual Studio Improving Reliability & Productivity.
Keeping your Data Repository in Top Health By: Ian Proffer MUSE Session 359.
10 Chapter 101 Using Menus and Validating Input Programming Logic and Design, Second Edition, Comprehensive 10.
Session id: Darrell Hilliard Senior Delivery Manager Oracle University Oracle Corporation.
Module 5: Managing Content. Overview Publishing Content Executing Reports Creating Cached Instances Creating Snapshots and Report History Creating Subscriptions.
Integrating and Extending Workflow 8 AA301 Carl Sykes Ed Heaney.
Libraries in the digital age Collection & preservation for generational access part two The LOCKSS Program.
Ontolica Fusion 4.0 The easy Automation Tool for SharePoint Steen Jakobsen Fusion Principal Architect
An Overview of Data Warehousing and OLAP Technology
AA202: Performance Enhancers for Laserfiche Connie Anderson, Technical Writer.
Brian Knight Founder Pragmatic Works BIN207 About the Speaker Brian is a SQL Server MVP Founder of Pragmatic Works Co-founder of SQLServerCentral.com.
Capture This! PO105 James Green. Table of Contents Capture Overview Laserfiche Tools Case Scenarios Questions and Answers.
Forum to improve your experience entering data into SRDR 1 SRDR is being developed and maintained by the Brown EPC under contract with the Agency for Healthcare.
Building a Home Grown Auditing Infrastructure for SQL Server
Computer aided teaching of statistics: advantages and disadvantages
Database Performance Tuning and Query Optimization
Vice President of Business Development
Populating a Data Warehouse
Database Vs. Data Warehouse
Populating a Data Warehouse
Steps to add the company where a user works to unmigrated records
Two methods to observe tutorial
Make Your PACKAGES Communicate BETTER
Doing t-tests by hand.
Chapter 11 Database Performance Tuning and Query Optimization
Developing and testing enterprise Java applications
Data Warehousing Concepts
Performance Tuning ETL Process
Presentation transcript:

The Art of DR Auditing By Acmeware, Inc. Edward Chisam – Senior Consultant

Course Overview Our Experience with Auditing Writing your own Audits DR Auditor Task Management

Lots of Examples Examples are derived from real problems experienced by our clients Some examples have been simplified for purposes of this discussion We will provide tools demonstrated in this session to all those who are interested in them via

Acmeware’s experience with Auditing Glen was the manager at MEDITECH responsible for development of the DR product Intimately involved in original design decisions Has written audits, reports, and applications against DR while at Acmeware Ed was a senior developer in DR at MEDITECH Lead developer for the DR Manager product Has run numerous audits using DR Auditor

The MEDITECH Auditor MEDITECH is working on its own Auditor of DR. Drawbacks to it at the current time include: Slow performance Limited choices of sample rates Uses same routines as initial load to populate sample tables By definition there is a lack of independent objectivity

Developing your own Audits Possible approaches that might be tried: NPR Report Writer Use Report Writer to save DPM subscripts to a file Import the file into a SQL table using Data Transformation Services Write a computer program that compares your table against the SQL table from MEDITECH Open Database Access Use 3 rd party ODBC or.NET product to extract DPM subscripts, and save these to a SQL Table Write a computer program that compares your table against the SQL table from MEDITECH

Developing your own Audits Drawbacks to these methods: Programming background required (C#,ODBC,.NET,SQL, etc.) Your program will break with the next MEDITECH schema change Cost of acquiring 3 rd party tools Not optimized for speed

DR Auditor Overview DR Auditor from Blue Elm  Relatively inexpensive  Has a long history of uncovering problems leading to MEDITECH correction.  Audits may be scheduled  Easy to use – no programming background needed

Using the DR Auditor After a MEDITECH update, it is critical to run a Schema Upload before running further audits This automates the process of accounting for MEDITECH changes to table structures Only takes about 45 minutes for this routine to execute

Using the DR Auditor Tables with <= 100,000 rows should be audited at a 1:1 sample rate Tables > 100,000 rows may be audited at a rate such that 100,000 rows will sampled. ( 1 million row would be audited at a 1:10 sample rate ) However, I have run audits on 12 million row tables at a 1:1 sample rate when it is absolutely required to guarantee table accuracy.

Using the DR Auditor The DR Auditor has the great ability to group multiple related audits from the same DPM together The method of sampling all the data works equally as fast if the DR Auditor is sampling ten tables at time, or if it is only sampling one Take advantage of this ability when sampling MEDITECH DPMS containing large amounts of data, such as BAR.PAT or LAB.L.SPEC.

Using the DR Auditor Re-analyzing vs. Re-sampling  Before submitting errors to MEDITECH, use the Re-analysis routine to run a second comparison of the sample versus the MEDITCH table.  This prevents errors due to MEDITECH transmission lag  Audits more than 3 days old should be re- sampled instead, as significant edits may invalidate the sample  The re-sample takes longer to run than the re- analysis

Using the DR Auditor  Only Audit DR tables you are either reporting from or are planning on using  MEDITECH has limited resources for Data Repository support, you only want them to work on the issues that can most help you  Audits do use up some system resources

Using the DR Auditor  When reporting issues, always include examples of missing data  Obtain these by running a Report on an audit, then choosing the Export to a text file routine  Copy the contents of the text file and paste it into the MEDITECH task, so they have the example available to work with

Using the DR Auditor  A new ability involves using the DR auditor to re-queue missing rows  This process has been automated for Saint John’s Hopkins -- Bayview  After Audits are run, missing rows are saved to a file, and then are automatically re-queued to transmit to the Data Repository  When the number of missing rows is not too large, this helps preserve data integrity