Educause 2009 Data Administration Constituent Group November 5th, /5/20091Educause DASIG Constituent Group

23 states report higher unemployment in September Worst recession in three decades Endowments lose billions Grant funding cut 11/5/2009Educause DASIG Constituent Group2

Layoffs Harvard Stanford Arizona State Yale Washington University of Chicago 11/5/2009Educause DASIG Constituent Group3

Budgets Cut Frozen Salaries Research Reduced 11/5/2009Educause DASIG Constituent Group4

Aren’t we here to talk about Data Management ??? 11/5/2009Educause DASIG Constituent Group5

All the President’s Men (1976) Robert Redford Hal Holbrook 11/5/2009Educause DASIG Constituent Group6

Use Data Management to Follow the Money !!!!! 11/5/2009Educause DASIG Constituent Group7

Data Management can contribute to the bottom line by ….. Cost Savings Cost Avoidance 11/5/2009Educause DASIG Constituent Group8

Questions How many of you are engaged in a full time data management role ? How many of you full time data managers have other responsibilities besides data management ? How many of you are in roles that require data management assistance ? 11/5/2009Educause DASIG Constituent Group9

Data Management Data Management comprises all the disciplines related to managing data as a valuable resource. Wikipedia 11/5/2009Educause DASIG Constituent Group10

Data Management Data Management is the development and execution of architectures, policies, practices, and procedures that properly manage the full data lifecycle needs of an enterprise. DAMA 11/5/2009Educause DASIG Constituent Group11

So what are some of these practices, procedures, and policies ? 11/5/2009Educause DASIG Constituent Group12

Metadata Management Data About Data Knowing where your data is … … And everything about it Promotes consistency, quality, standardization 11/5/2009Educause DASIG Constituent Group13

Data Classification Classify data by sensitivity HIPAA, FERPA, SSN’s, Personal Privacy, etc. Develop policies for various levels of classification Develop guidelines for usage and security Develop training in use of the data 11/5/2009Educause DASIG Constituent Group14

Data Classification Valuable to prevent compromises Guides usage of data Directs reporting and BI Encryption, archiving, removable storage 11/5/2009Educause DASIG Constituent Group15

Data Integration Data from system of record needed somewhere else Do you want that data moved somewhere else ? Consistency /integrity once it leaves the source system Reporting across systems 11/5/2009Educause DASIG Constituent Group16

Data Integration Traditional Feed Approach – Extract, ship it somewhere, load it up SOA/Web Services 11/5/2009Educause DASIG Constituent Group17

Traditional Feed Approach Proven Can be accomplished in many technologies Can result in many, many feeds Each one is hand crafted Timing issues 11/5/2009Educause DASIG Constituent Group18

SOA/Web Services Limited number Real time or “batch” Don’t have to hand craft every time Granularity of data Security Technology 11/5/2009Educause DASIG Constituent Group19

Data Governance The discipline embodies a convergence of data quality, data management, business process management, and risk management surrounding the handling of data in an organization. Through data governance, organizations are looking to exercise positive control over the processes and methods used by their data stewards to handle data. Wikipedia 11/5/2009Educause DASIG Constituent Group20

Data Governance Who has Data Governance bodies in place ? What types of activities do those groups undertake ? 11/5/2009Educause DASIG Constituent Group21

Master Data Management Data items used by multiple applications Codes Department numbers Building identifiers Class identifiers 11/5/2009Educause DASIG Constituent Group22

Why Should I Manage Master Data ? Provides data consistency IPEDS reporting I-9 Dept of Homeland Security Business Intelligence 11/5/2009Educause DASIG Constituent Group23

Data Archiving Legal records Institutional records Research data 11/5/2009Educause DASIG Constituent Group24

Data Archiving Where is it, and what is it ? How to search archives ? How to access archives ? Volume 11/5/2009Educause DASIG Constituent Group25

Ediscovery Discovery and securing of electronic information Required by some form of litigation or criminal proceedings Court ordered , IM chats, documents, databases, logs, web sites, other forms of electronic data May also require associated metadata 11/5/2009Educause DASIG Constituent Group26

Ediscovery Zubulake v. UBS Warburg LLC Court found that defendant deleted s and/or failed to produce files Adverse inference jury instructions given Plaintiff awarded $29.2 Million 11/5/2009Educause DASIG Constituent Group27

Ediscovery Coleman Holdings Inc. v. Morgan Stanley Defendant failed to disclose and process numerous backup tapes until late in the proceedings Adverse inference jury instructions given, reversing the burden of proof Jury verdict for plaintiff in the amount of $1.5 Billion Court awarded $15 Million in fines for failing to comply with discovery obligations 11/5/2009Educause DASIG Constituent Group28

Ediscovery Talk to your legal department Make info handling routines routine and consistent Keep a trail – DOCUMENT IT !!!!! Avoid spoilation – The deliberate or negligent destruction, withholding, or hiding of evidence when an investigation or litigation is under way 11/5/2009Educause DASIG Constituent Group29

Ediscovery Know what you have Backups Archives Files Databases Optical media 11/5/2009Educause DASIG Constituent Group30

Data Management Following the Money to Cost Savings & Cost Avoidance 11/5/2009Educause DASIG Constituent Group31

Almost the Final Slide Plug DASIG Listhost 11/5/2009Educause DASIG Constituent Group32

Mike Fary Enterprise Data Architect University of Chicago 11/5/2009Educause DASIG Constituent Group33