Download presentation
Presentation is loading. Please wait.
1
This is the cover slide.
2
Best Practices for Purging Data
This is your session title slide
3
Best Practices for Purging
Newscycle Purging Recommendations & Associated Utilities Other Newscycle Purge Utilities and Purge Scripts Discussion: What tools is your site using? Discussion: effect of never purged financial data on systems that have been live for several years. Should a method to purge this data be developed? Is it necessary?
4
Newscycle Recommendations
SequelEPSF Purger - run this on a regular basis as it deletes most of the blobs and space in the database. Purges Classified EPS & HTML files past pub date. Personal Finance Purge - this deletes old credit card data if site has not moved to tokenization. Graphic Purge Utility – Purges specific graphics. Audit Trail Purge Utility - this only deletes audit trail - does not clean up a large amount of space. Customer Purge Utility - Only deletes customers that have never been used - will not delete a customer with financial or order history. Ad Order Purge Utility – most sites run on a scheduled basis. Usually scheduled after being live for quite a while. This is a notes slide.
5
SequelEPSF Purger Run this on a regular basis.
Deletes no longer relevant blobs in the database. Purge EPSF Purge HTML Clears the largest amount of space. This is a different application than the EPSFPurger.
6
Personal Finance Purger
Settings AdBase Importer Scenario file Preview Execute
7
Graphic Purge Utility Select Logo Groups to Purge from
Use “Save to…” feature Log will show many of the following: 03/18/ :15:55 3 <GraphicPurgeUtilityAppManager.cpp,824> Graphic accessed recently 03/18/ :15:55 3 <GraphicPurgeUtilityAppManager.cpp,824> Placeholder graphic in use by AdOrder: Inconsistencies Quits in Citrix Fixed in
8
Audit Trail Purge Utility
This only deletes audit trail This does not clean up a large amount of space We don’t run this; don’t want to run this as the history of ads is valuable so long as we are keeping the ad itself. Hoping to get this from Newscycle.
9
Customer Purge Utility
Only deletes customers that have never been used - will not delete a customer with financial or order history. Locked customers (by AdBase, AdBooker, Customer Manager, etc.) Customers with outstanding balances Customers connected to a contract instance or other constraint There are several recommended actions that should be taken before running this utility, including: Make a full backup of the AdBase database. Complete all billing against the targeted customers. Run the Data Analysis Export Tool to record all historical data.
10
Ad Order Purge Utility Recommended to be run on a scheduled basis
It will delete the audit trail, EPSF files and ad orders The most data intensive files are removed Removes corrupt orders Features: Checkbox selection Only purge order number Ad Orders List
11
Other Purge Utilities Campaign Purge Utility Custom Purge Scripts
Associated with AdSales Campaign_Purge_Utility_Guide_3.1_1.0 Delete Campaigns. Delete Campaign Contact Tasks. Custom Purge Scripts Purge Utilities to only use prior to go-live
12
Other Purge Scripts Database Backup to FTP:
Restore production database to instance of test/dev environment. Set credit card data to test credit card number: UPDATE CustomerCreditCard SET CardNumber='I/oXVmNaIiRrSCYnuw==‘ Run DBTableUtil Drop Constraints on shblobdata : Open DBUtility, open the plus sign and drill down to SHBLOBDATA, highlight this only and Drop Constraints (you can only tell this is done because ‘Success’ is displayed at the end of the status message). Remove shblobdata data by issuing SQL statement: TRUNCATE TABLE shblobdata; Drop and Add Constraints on all tables : Open DBTableUtil and Drop and Add Constraints on all tables (not just shblobdata -There are many tables that have constraints to shblobdata). The log will show some of the constraints being added failed – this is due to the shblobdata having no records. Other Purge/Delete data scripts at other sites?
13
What are Sites Doing? DISCUSSION: What tools is your site using?
What processes do you have scheduled? What purge processes have to be run on weekends or off hours to meet business needs?
14
Discussion - Propose Financial Data Purge?
Financial Data Purge does not exist Request over past several years has been to create a forum to discuss how this could be accomplished to remove no longer used financial data from the core system. Interstate Media, one of the sites on AdBase the longest, has been leader in this conversation. Why? Financial processing slow down Searches slower and more system intensive Intensive searches slow down user experience Suggestions from past years: Managing very old data to a specific date in the past with specific balances or zero. Purging all transactions past the given date. Orders would also be purged. Historical Data remains in BI.
15
Questions?
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.