Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 1.

Slides:



Advertisements
Similar presentations
1.
Advertisements

<Insert Picture Here>
1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
5 Copyright © 2005, Oracle. All rights reserved. Managing Database Storage Structures.
Oracle Universal Content Management and Storage Systems
A Java Architecture for the Internet of Things Noel Poore, Architect Pete St. Pierre, Product Manager Java Platform Group, Internet of Things September.
11© 2011 Hitachi Data Systems. All rights reserved. HITACHI DATA DISCOVERY FOR MICROSOFT® SHAREPOINT ® SOLUTION SCALING YOUR SHAREPOINT ENVIRONMENT PRESENTER.
Oracle Database Compression with Oracle Database 12c
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Advanced Metadata Modeling Modeling for the Oracle Business Intelligence Cloud.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Architecting for the Internet of Things
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle SQL Developer For the DBA Jeff Smith
The Safe Harbor The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated.
Oracle Database 12c Data Protection and Multitenancy on Oracle Solaris 11 Xiaosong Zhu Senior Software Engineer Copyright © 2014, Oracle and/or its affiliates.
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Title Slide without Picture Subtitle Presenter’s Name Presenter’s Title Organization,
Genie Backup ManagerServer 7.0 Product Profile. Copyright© Genie-Soft Corporation All rights reserved. Overview GBM Server 7.0 is a fully integrated.
Working with SQL and PL/SQL/ Session 1 / 1 of 27 SQL Server Architecture.
Agenda  Overview  Configuring the database for basic Backup and Recovery  Backing up your database  Restore and Recovery Operations  Managing your.
Navigating the Oracle Backup Maze Robert Spurzem Senior Product Marketing Manager
© 2009 Oracle Corporation. S : Slash Storage Costs with Oracle Automatic Storage Management Ara Vagharshakian ASM Product Manager – Oracle Product.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Preview of Oracle Database 12 c In-Memory Option Thomas Kyte
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. JD Edwards Summit PaaS from an Applications Perspective Charles McGuinness Director,
CHAPTER 11 Large Objects. Need for Large Objects Data type to store objects that contain large amount of text, log, image, video, or audio data. Most.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 1.
1Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 Reporting from Contract.
Introduction. 
1. Automate a Secure Historical Data Store with Oracle Total Recall Venky RadhakrishnanKevin Jernigan Database DeveloperSenior Director Product Management.
I Copyright © 2004, Oracle. All rights reserved. Introduction.
1. Oracle Database 11g SecureFiles and Database File System (DBFS) Kevin JerniganAmit Ganesh Senior Director Product ManagementVice President Data and.
The following is intended to outline Oracle’s general product direction. It is intended for information purposes only, and may not be incorporated into.
NetBackup PureDisk Kris Hagerman Sr. Vice President, Data Center Management.
Sofia, Bulgaria | 9-10 October SQL Server 2005 High Availability for developers Vladimir Tchalkov Crossroad Ltd. Vladimir Tchalkov Crossroad Ltd.
5 Database Features Every DBA Needs to Know About THT11267 Doug Chamberlain - Principal Product Manger, Oracle Copyright © 2014, Oracle and/or its affiliates.
1 Oracle Database 11g – Flashback Data Archive. 2 Data History and Retention Data retention and change control requirements are growing Regulatory oversight.
Hadoop 2 cluster with Oracle Solaris Zones, ZFS and unified archives Orgad Kimchi - Principal Software Engineer September 29, 2014 Oracle Confidential.
1Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 Contract Management.
15 Copyright © 2007, Oracle. All rights reserved. Performing Database Backups.
Oracle Advanced Compression – Reduce Storage, Reduce Costs, Increase Performance Session: S Gregg Christman -- Senior Product Manager Vineet Marwah.
1.
CON Software-Defined Networking in a Hybrid, Open Data Center Krishna Srinivasan Senior Principal Product Strategy Manager Oracle Virtual Networking.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Oracle Database 12c Sergey Stetsenko Principal Sales Consultant.
MANAGING DATA RESOURCES ~ pertemuan 7 ~ Oleh: Ir. Abdul Hayat, MTI.
Data resource management
1Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Actualog Social PIM Helps Companies to Manage and Share Product Information Using Secure, Scalable Ease of Microsoft Azure MICROSOFT AZURE ISV PROFILE:
Securely Synchronize and Share Enterprise Files across Desktops, Web, and Mobile with EasiShare on the Powerful Microsoft Azure Cloud Platform MICROSOFT.
GLOBEX INFOTEK Copyright © 2013 Dr. Emelda Ntinglet-DavisSYSTEMS ANALYSIS AND DESIGN METHODSINTRODUCTORY SESSION EFFECTIVE DATABASE DESIGN for BEGINNERS.
2 Copyright © 2007, Oracle. All rights reserved. Configuring for Recoverability.
Flight is a SaaS Solution that Accelerates the Secure Transfer of Large Files and Data Sets Into and Out of Microsoft Azure Blob Storage MICROSOFT AZURE.
Picturex Secures and Scales Event-Photo Sharing for Enterprise and Private Customers by Relying on the Powerful, Scalable Microsoft Azure Platform MICROSOFT.
Axis AI Solves Challenges of Complex Data Extraction and Document Classification through Advanced Natural Language Processing and Machine Learning MICROSOFT.
Tekla Model Sharing and Microsoft Azure Create Secure and Seamless Collaboration Environment for Construction Projects, Locally and Globally MICROSOFT.
Microsoft Azure and ServiceNow: Extending IT Best Practices to the Microsoft Cloud to Give Enterprises Total Control of Their Infrastructure MICROSOFT.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 1.
Abstract MarkLogic Database – Only Enterprise NoSQL DB Aashi Rastogi, Sanket V. Patel Department of Computer Science University of Bridgeport, Bridgeport,
DreamFactory for Microsoft Azure Is an Open Source REST API Platform That Enables Mobilization of Data in Minutes across Frameworks and Storage Methods.
Data Platform and Analytics Foundational Training
What’s New in SQL Server 2016 Master Data Services
Maximum Availability Architecture Enterprise Technology Centre.
Replace with Application Image
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
DeFacto Planning on the Powerful Microsoft Azure Platform Puts the Power of Intelligent and Timely Planning at Any Business Manager’s Fingertips Partner.
Data Security for Microsoft Azure
Unitrends Enterprise Backup Solution Offers Backup and Recovery of Data in the Microsoft Azure Cloud for Better Protection of Virtual and Physical Systems.
Datacastle RED Delivers a Proven, Enterprise-Class Endpoint Data Protection Solution that Is Scalable to Millions of Devices on the Microsoft Azure Platform.
Hybrid Storage Competitive Sales Guide INTERNAL ONLY
Dell Data Protection | Rapid Recovery: Simple, Quick, Configurable, and Affordable Cloud-Based Backup, Retention, and Archiving Powered by Microsoft Azure.
Prepared by Jaroslav makovski
Presentation transcript:

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 1

Information Retention: a Database Perspective Kevin Jernigan Senior Director Oracle Database Performance Product Management

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 3 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 4 Agenda  What is Oracle Database?  SecureFiles  Database File System – DBFS  Information Retention and Oracle Database

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 5 What is Information Retention?  Keep information available and find-able – Structured: databases – Semi- and un-structured: documents  What about: – Bit rot – Format changes – Software and hardware changes

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 6 What is Oracle Database?  A Relational Database Management System – RDBMS – With 30+ years of innovations – With dozens of world record audited performance benchmarks  Store and manage more than “just” structured data – XML – DICOM – RDF / OWL / SPARQL – Spatial / Graph – etc

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 7 Oracle Database Features Related to Retention  Partitioning & Compression: storage tiering & ILM  SecureFiles & DBFS: semi- and un-structured data  Flashback Data Archive & CQN: events / streams & history

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 8 Oracle Database Partitioning & Compression  Partitioning – Transparently split up data in tables – Improves query performance AND admin flexibility  Compression – Advanced Compression – Advanced LOB Compression & Deduplication

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 9  Compress data partitions/tables – OLTP and DW  Compress unstructured data – Compression and deduplication  Compress backups – Faster RMAN compression – Data Pump compression  Compress Data Guard Redo log transport – Network compression  Securely store historic data – Flashback Data Archive now part of Advanced Compression (in 11g) Advanced Compression Option Minimizes database storage, improves performance Active Less Active Less Active Historical Oracle Database Enterprise Edition Partitioning Option Partitioning Option Advanced Compression Advanced Compression 2x to 4x Compression Typical 9 Flashback Data Archive Flashback Data Archive

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle Database Partitioning & Compression  Partitioning – Transparently split up data in tables – Improves query performance AND admin flexibility  Compression – Advanced Compression – Advanced LOB Compression & Deduplication – Hybrid Columnar Compression – Exadata, ZFSSA, Pillar Axiom

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide About Hybrid Columnar Compression Hybrid Columnar Compressed Tables –Compressed tables can be modified using conventional DML operations –Useful for data that is bulk loaded and queried How it Works –Tables are organized into Compression Units (CUs) CUs are multiple database blocks –Within Compression Unit, data is organized by column instead of by row Column organization brings similar values close together, enhancing compression Compression Unit Column 1 Column 2 Column 3 10x to 15x Reduction Column 4 Column 5

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle Database Partitioning & Compression  Partitioning – Transparently split up data in tables – Improves query performance AND admin flexibility  Compression – Advanced Compression – Advanced LOB Compression & Deduplication – Hybrid Columnar Compression – Exadata, ZFSSA, Pillar Axiom  Partitioning + Compression = Information Lifecycle Management (ILM) – Keep more data in database for longer, with better performance

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle Database ILM As data ages: –Activity declines –Volume grows –Older data primarily for reporting This Quarter This Year Prior Years OLTP Reporting Compliance & Reporting Row Store for fast OLTP Compressed Column Store for fast analytics 10x compressed 15x compressed As data cools down, convert data to columnar compressed Archive Compressed Column Store for max compression

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle Database: SecureFiles  SecureFiles gives file system performance for files in the database  Introduced with Oracle Database 11g Release 1  Similar to LOBs but much faster, and with more capabilities – Transparent encryption (with Advanced Security Option) – Compression, deduplication (with Advanced Compression Option) – Extends the security, reliability, and scalability of database to files – Superset of LOB interfaces allows easy migration from LOBs  Enables consolidation of file data with associated relational data – Single security model – Single view of data – Single management of data Consolidated Secure Management of Data

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide SecureFiles Performance & Scalability on Exadata  Small Documents: Extremely High Throughput – Load at 200 Million docs/hr, Read at 780 Million docs/hr  Large Multimedia: Extremely High Bandwidth – Load at 4 GB/s and Read at 8 GB/s

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle Database DBFS  DBFS – Database File System – Make Oracle Database behave like a file server – Access to files inside the database is now same as file system access – Performance and scalability: 1 billion file test

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Database-Enabling File-Based Tools  DBFS allows access to files in the db using file system interfaces – File operations translated into SQL operations – Directories and path names are derived from key columns in tables – Enables access by existing file-based tools /Customers /Lucas /…….. /Contract /Photo Path Names, Directories DBFS Server in DB Select Contract from Customers where Name = ‘Lucas’ Acrobat Reader ID#NameAddressContractPhoto 23Lucas ….. Customers Table SQL Access DBFS Client Network

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide DBFS SecureFiles Store  DBFS: stand-alone file systems in the database – Directory information stored in tables – Files stored in SecureFiles LOBs  Used for operational application files such as ETL files, reports, etc. that are not in application tables – Provides unified data and file backup, DR, management /ETL /Monday.dat /…….. DBFS Server in DB ETL Tool Inode#OwnerFilePath 3768Lucas /ETL/Monday.dat DBFS Client Network DBFS SecureFiles Store

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle DBFS HSM  DBFS Hierarchical Storage Management – Transparently migrate a SecureFiles LOB to tape or cloud – Replace the LOB in the database with a DBFS Link – DBFS Link looks like the LOB to applications and users  Slower “time to first byte”

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide DBFS HSM Store  A DBFS HSM store allows archiving files to tape  Application migrates older files to HSM store (e.g. old invoices) – A DBFS Link replaces the LOB, LOB reads on links are transparent – A LOB can be easily migrated back to the table for updates  HSM store: disk staging area for storing recently accessed files – Seldom accessed files are migrated to tape, brought back on reference Order#CustomerYearInvoice 1234Lucas2003 Sales Table /HSM /Old_Invoices /…….. /Invoice_1234 “/HSM/Old_Invoices/Invoice_1234” DBFS Link LRU Tape

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle DBFS HSM  DBFS Hierarchical Storage Management – Transparently migrate a SecureFiles LOB to tape or cloud – Replace the LOB in the database with a DBFS Link – DBFS Link looks like the LOB to applications and users  Slower “time to first byte”  SecureFiles + DBFS + DBFS HSM – Keep metadata in Oracle Database – Store most files offline, but still part of the database

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle Database Flashback Data Archive & CQN  Flashback Data Archive – FDA – Transparently store history of changes – Automatically delete data that is older than specified retention period – Works with structured AND unstructured – SecureFiles – data – Beginnings of integrated transparent provenance  CQN – Continuous Query Notification – Register SQL – actually CQL – queries in database – Each registration includes notification method / code – Fully contextual event processing – Combine with FDA and SecureFiles

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Rich Capabilities Inherited from DB DBFS CapabilityProvided By Compression, Deduplication, EncryptionSecureFiles Crash ToleranceAtomic transactions, Logging Mirroring, Striping, Online Add StorageASM Disaster Recovery, Readable Remote MirrorData Guard Consistent BackupRMAN, Hot backup Multi-Node Scalability, Transparent FailoverRAC Impromptu SnapshotsConsistent Read Restore to Point in TimeFlashback, Media Recovery Retention / ComplianceTotal Recall Network SecuritySSL

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Build your own “file system”  Similar to how databases allow you to create a data model & an application, you can now build your own file system – Innovate and create new value by creating a file system interface  Database developers can now write a robust file system: No need to be a OS kernel developer or debug kernel crashes  Create a file system interface to data stored in relational tables: Like a “file system view” for an existing database application  Write a file system in Java, SQL/PL/SQL – Or any other language using callouts  Build your application-integrated file system in less than a day – Writing a basic read only file system view on the LOBs that are currently in your database application in 60 seconds!

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide A file system: 100 lines of PL/SQL procedure getPath( store_name in varchar2, path in varchar2, properties in out nocopy dbms_dbfs_content_properties_t, amount in out number, offset in number, buffer out nocopy raw, prop_flags in integer, ctx in dbms_dbfs_content_context_t) is content blob; guid number; begin if (path = '/') then raise dbms_dbfs_content.unsupported_operation; end if; select t.data into content from sys.tbfst t where ('/' || t.key) = path; select ora_hash(path) into guid from dual; dbms_lob.read(content, amount, offset, buffer); properties := dbms_dbfs_content_properties_t( dbms_dbfs_content_property_t( 'std:length', to_char(dbms_lob.getlength(content)), dbms_types.TYPECODE_NUMBER), dbms_dbfs_content_property_t( 'std:guid', to_char(guid), dbms_types.TYPECODE_NUMBER)); end; create table tbfst( key varchar2(256) primary key check (instr(key, '/') = 0), data blob) tablespace users lob(data) store as securefile (tablespace users); grant select on tbfst to dbfs_role; grant insert on tbfst to dbfs_role; grant delete on tbfst to dbfs_role; grant update on tbfst to dbfs_role; function list( store_name in varchar2, path in varchar2, filter in varchar2, recurse in integer, ctx in dbms_dbfs_content_context_t) return dbms_dbfs_content_list_items_t pipelined is begin for rws in (select * from sys.tbfst) loop pipe row(dbms_dbfs_content_list_item_t( '/' || rws.key, rws.key, dbms_dbfs_content.type_file)); end loop; end;

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Files in the Database Reinvented File Capabilities – File System Interface – High Performance – Compression – Encryption – Deduplication – HSM Database Capabilities – Transactions – Query Consistency – Advanced Backup and Recovery – Powerful Security – Flashback – Scale up and out  Files are an integral part of modern database applications – Product images, contracts, XML, ETL files, manuals, etc.  Applications developers want to store business data files in the database to benefit from transactional consistency, and unify HA and Security – Poor performance, limited functionality, and lack of access by existing file based tools have held them back  Oracle Database 11g reinvents files in the database  SecureFiles provides super fast and powerful file storage – Removes performance barrier to storing files in the database  DBFS provides a file system interface to files in the DB – Enables existing file based tools to easily access DB files

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide Oracle Database and Information Retention  Keep metadata and files together in Oracle Database – Unified backups – Unified security model – ILM and HSM – Leverage other database features  Application developer agility – Much less work to implement content management applications – Just like SQL and RDBMS’s, reduces the amount of “wheel reinvention”

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 28

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 29