Download presentation
Presentation is loading. Please wait.
Published byLawson Clapham Modified over 10 years ago
1
1© Copyright 2010 EMC Corporation. All rights reserved. Mel Shum Technical Marketing Engineer EMC Backup Recovery Systems EMC Data Protection for Oracle Saving Time and Money EMC Data Domain
2
2© Copyright 2010 EMC Corporation. All rights reserved. Agenda Problems many database administrators face Overview of Oracle Recovery Manager (RMAN) functional components Key features of EMC Data Domain deduplication storage systems Impact of Data Domain deduplication in an Oracle environment Customer examples Summary
3
3© Copyright 2010 EMC Corporation. All rights reserved. Problems Many Database Administrators Face Too many for this talk so well focus on just backup and recovery Non-stop growth and proliferation Backup windows remain approximately the same Recovery is just as important and often overlooked Limited online retention –Increased frequency of recovery for audits, troubleshooting, updates, etc. Archive (aka, ILM) becoming increasingly important –Some data must be retained for 5 years, 7 years, forever….
4
4© Copyright 2010 EMC Corporation. All rights reserved. RMAN – What Is It? For those in the audience that dont already know: Oracles included backup / recovery utility –Supports full, incremental, and image backups –Retains backup information in the control file and (optionally) a separate database catalog –Many configuration options to tailor to users requirements –Automatically eliminates unused data blocks from most backups
5
5© Copyright 2010 EMC Corporation. All rights reserved. Overview of RMAN Functional Components RMAN Repository (Control File) Target Database
6
6© Copyright 2010 EMC Corporation. All rights reserved. RMAN Repository (Control File) Target Database RMAN Client Overview of RMAN Functional Components
7
7© Copyright 2010 EMC Corporation. All rights reserved. RMAN Repository (Control File) Target Database RMAN Client Disk Backup Overview of RMAN Functional Components
8
8© Copyright 2010 EMC Corporation. All rights reserved. Third Party Media Managers MML API Backup RMAN Repository (Control File) Target Database RMAN Client Disk Backup Overview of RMAN Functional Components
9
9© Copyright 2010 EMC Corporation. All rights reserved. Third Party Media Managers MML API Backup RMAN Repository (Control File) Target Database RMAN Client Disk Backup Tape Overview of RMAN Functional Components
10
10© Copyright 2010 EMC Corporation. All rights reserved. Third Party Media Managers MML API Backup RMAN Repository (Control File) Target Database RMAN Client Disk Backup Recovery Catalog Tape Overview of RMAN Functional Components
11
11© Copyright 2010 EMC Corporation. All rights reserved. Third Party Media Managers MML API Backup RMAN Repository (Control File) Target Database FRA RMAN Client Disk Backup Recovery Catalog Tape Overview of RMAN Functional Components
12
12© Copyright 2010 EMC Corporation. All rights reserved. Third Party Media Managers MML API Backup RMAN Repository (Control File) Target Database FRA RMAN Client Disk Backup Recovery Catalog Tape Overview of RMAN Functional Components
13
13© Copyright 2010 EMC Corporation. All rights reserved. RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> BACKUP AS COPY TAG MAY9 DATABASE INCLUDE CURRENT CONTROLFILE; RMAN> BACKUP ARCHIVELOGS TAG MAY9 ALL NOT BACKED UP DELETE ALL INPUT; Target DB 1 TB Weekly: Full image backups (nightly would be preferred!) Weekly Full Backup
14
14© Copyright 2010 EMC Corporation. All rights reserved. RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> BACKUP AS COPY TAG MAY9 DATABASE INCLUDE CURRENT CONTROLFILE; RMAN> BACKUP ARCHIVELOGS TAG MAY9 ALL NOT BACKED UP DELETE ALL INPUT; Target DB 1 TB Much more than 1 TB to keep a few days Limits Retention Disk 1 TB Disk 1 TB Disks 1 TB Full images Weekly: Full image backups (nightly would be preferred!) Weekly Full Backup
15
15© Copyright 2010 EMC Corporation. All rights reserved. Disks 1 TB Disks 1 TB RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> BACKUP INCREMENTAL DATABASE …. Daily: Incremental backup after weekly full Target DB 1 TB Weekly Fulls Disks 1 TB Daily Incremental Backup
16
16© Copyright 2010 EMC Corporation. All rights reserved. 1 3 2.. Disks 1 TB 1 3 2.. Disks 1 TB RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /backup/ora.weekly/%U; RMAN> BACKUP INCREMENTAL DATABASE …. Daily: Incremental backup with update Target DB 1 TB Well beyond 1TB of backup storage needed Weekly Fulls 1 3 2.. Disks 1 TB + Daily Incrementals Daily Incremental Backup
17
17© Copyright 2010 EMC Corporation. All rights reserved. Before Data Domain… 18 Cabinets of IBM Tape
18
18© Copyright 2010 EMC Corporation. All rights reserved. After Data Domain… 1 DD690 and 2 Expansion Shelves
19
19© Copyright 2010 EMC Corporation. All rights reserved. Data Deduplication: Under The Hood Store more backups in a smaller footprint Friday Full Backup ABCDAEFG BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
20
20© Copyright 2010 EMC Corporation. All rights reserved. ABCDEFG Friday Full Backup ABCDAEFG WEEKEND FULL 1 TB 2- 4x 250 GB Data Deduplication: Under The Hood Store more backups in a smaller footprint BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
21
21© Copyright 2010 EMC Corporation. All rights reserved. ABCDEFG H Friday Full Backup ABCDAEFG Mon Incr ABH Monday Incr 100 GB 7-10x 10 GB WEEKEND FULL 1 TB 2- 4x 250 GB Data Deduplication: Under The Hood Store more backups in a smaller footprint BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
22
22© Copyright 2010 EMC Corporation. All rights reserved. ABCDEFG HI Friday Full Backup ABCDAEFG Mon Incr ABH Tues Incr CBI Monday Incr 100 GB 7-10x 10 GB Tuesday Incr 100 GB 7-10x 10 GB WEEKEND FULL 1 TB 2- 4x 250 GB Data Deduplication: Under The Hood Store more backups in a smaller footprint BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
23
23© Copyright 2010 EMC Corporation. All rights reserved. ABCDEFG HIJ Friday Full Backup ABCDAEFG Mon Incr ABH Tues Incr CBI Weds Incr EGJ Monday Incr 100 GB 7-10x 10 GB Tuesday Incr 100 GB 7-10x 10 GB Wednesday Incr 100 GB 7-10x 10 GB WEEKEND FULL 1 TB 2- 4x 250 GB Data Deduplication: Under The Hood Store more backups in a smaller footprint BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
24
24© Copyright 2010 EMC Corporation. All rights reserved. ABCDEFG HIJ Friday Full Backup ABCDAEFG Mon Incr ABH Tues Incr CBI Thurs Incr ACK Weds Incr EGJ Monday Incr 100 GB 7-10x 10 GB Tuesday Incr 100 GB 7-10x 10 GB K Wednesday Incr 100 GB 7-10x 10 GB Thursday Incr 100 GB 7-10x 10 GB WEEKEND FULL 1 TB 2- 4x 250 GB Data Deduplication: Under The Hood Store more backups in a smaller footprint BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
25
25© Copyright 2010 EMC Corporation. All rights reserved. Second Friday Full Backup BCDEFLGH ABCDEFG HIJ Friday Full Backup ABCDAEFG Mon Incr ABH Tues Incr CBI Thurs Incr ACK Weds Incr EGJ Monday Incr 100 GB 7-10x 10 GB Tuesday Incr 100 GB 7-10x 10 GB KL Wednesday Incr 100 GB 7-10x 10 GB Thursday Incr 100 GB 7-10x 10 GB 2 nd WEEKEND FULL 1 TB 50-60x 18 GB TOTAL 2.4 TB 7.8x 308 GB WEEKEND FULL 1 TB 2- 4x 250 GB Data Deduplication: Under The Hood Store more backups in a smaller footprint BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
26
26© Copyright 2010 EMC Corporation. All rights reserved. Deduplication at Backup / Recovery Speeds 102,400 lookups/sec.: is it already in the multi-TB store? –800 MB/sec, for 8KB segment: >100K lookups per second –If random lookups: very slow –Each disk: 1 MB/sec E.g. for a 7.2KB RPM Seagate 1TB SATA drive: <120 seeks/second 120/second @ 8KB segment: 0.96 MB/sec/disk –Would need 830 disks to go 800 MB/sec (like most dedupers today) This is 4 full height racks of nothing but SATA disks (16 drives / 3U rack) Same performance, in less than half a full height rack
27
27© Copyright 2010 EMC Corporation. All rights reserved. SISL Scaling Architecture Check uniqueness with Summary Vector Check in-memory fingerprint cache Key results See: http://www.usenix.org/events/fast08/tech/full_papers/zhu/zhu.pdf Data Domain answer: SISL –Stream-informed Segment Layout includes : Summary Vector in RAM says if segment is new Segment Localities minimize seeks if answer is on disk
28
28© Copyright 2010 EMC Corporation. All rights reserved. Data Integrity: Data Invulnerability Architecture Trust but verify – hope is not a strategy
29
29© Copyright 2010 EMC Corporation. All rights reserved. Data Integrity: Data Invulnerability Architecture Trust but verify – hope is not a strategy Data verification – CheckSum – Dedupe, write to disk – Verify
30
30© Copyright 2010 EMC Corporation. All rights reserved. Data Integrity: Data Invulnerability Architecture Trust but verify – hope is not a strategy Data verification – CheckSum – Dedupe, write to disk – Verify Self-healing file system – Cleaning – Expired data – Defrag – Verify
31
31© Copyright 2010 EMC Corporation. All rights reserved. Other – RAID-6 – NVRAM – Snapshots Self-healing file system – Cleaning – Expired data – Defrag – Verify Data Integrity: Data Invulnerability Architecture Trust but verify – hope is not a strategy Data verification – CheckSum – Dedupe, write to disk – Verify
32
32© Copyright 2010 EMC Corporation. All rights reserved. Disk 1 TB Disk 1 TB Disk 1 TB RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> BACKUP AS COPY TAG MAY9 DATABASE INCLUDE CURRENT CONTROLFILE; RMAN> BACKUP ARCHIVELOGS TAG MAY9 ALL NOT BACKED UP DELETE ALL INPUT; Target DB 1 TB Weekly: Full image backups Before: Without deduplication Weekly Full Backup – With Deduplication
33
33© Copyright 2010 EMC Corporation. All rights reserved. RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> BACKUP AS COPY TAG MAY9 DATABASE INCLUDE CURRENT CONTROLFILE; RMAN> BACKUP ARCHIVELOGS TAG MAY9 ALL NOT BACKED UP DELETE ALL INPUT; Target DB 1 TB Weekly: Full image backups Full 500 GB After: With deduplication Weekly Full Backup – With Deduplication
34
34© Copyright 2010 EMC Corporation. All rights reserved. RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> BACKUP AS COPY TAG MAY9 DATABASE INCLUDE CURRENT CONTROLFILE; RMAN> BACKUP ARCHIVELOGS TAG MAY9 ALL NOT BACKED UP DELETE ALL INPUT; Target DB 1 TB Deduplication applied to fulls requiring much less disk Weekly: Full image backups Full 500 GB After: With deduplication Weekly Full Backup – With Deduplication
35
35© Copyright 2010 EMC Corporation. All rights reserved. Target DB 1 TB RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> BACKUP INCREMENTAL DATABASE …. Daily: Incremental backup with update 500 GB Weekly Fulls Incrementals after deduplication Daily Incremental Backup – With Deduplication
36
36© Copyright 2010 EMC Corporation. All rights reserved. Target DB 1 TB RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT /dd/backup/ora.weekly/%U; RMAN> BACKUP INCREMENTAL DATABASE …. Daily: Incremental backup with update 500 GB Weekly Fulls Daily Incrementals Incrementals after deduplication Daily Incremental Backup – With Deduplication
37
37© Copyright 2010 EMC Corporation. All rights reserved. Benefits of Using Inline Deduplication Daily fulls instead of incrementals Longer online retention of full backup images No requirement for other backup software plug-ins Non disruptive introduction into RMAN process Simplified replication using EMC Data Domain Replicator Ideal location for Flashback Recovery Area Incrementally updated backups
38
38© Copyright 2010 EMC Corporation. All rights reserved. Full Sun WedThuMonTueSatFri DB Snap Incremental Merge EMC Data Domain combines rapid cloning and deduplication Results in up-to-date nightly full images available for rapid recovery Incremental First image backup 2X storage savings Nightly take cumulative incremental; apply to snapshot of weekly full
39
39© Copyright 2010 EMC Corporation. All rights reserved. Alternatives RMAN to 3rd Party Backup MML/SBT –Makes random access disk look like streaming tape. Not cost effective –Limits the options available to the DBA for backing up, cloning, merging, etc. –RMAN communicates through MML to agent on 3rd party backup application media server –Can front a Data Domain system as either disk-based backup or VTL –All RMAN I/O is via MML which presents only a DEVICE TYPE TAPE Data Domain can work with an enterprise backup application but does not require it.
40
40© Copyright 2010 EMC Corporation. All rights reserved. Oracle Customers Leveraging Data Domain RMAN and db2backup to NFS mounts on DD690 and DD880 systems replicating to DD690 and DD580 systems 4 week retention schedule, 10% average daily change rate, archive logs backed up hourly All database backups replicated again to SunGard Sustained deduplication ratios of >6:1 (includes archive logs) CN Rail – A Large Canadian Freight Railroad
41
41© Copyright 2010 EMC Corporation. All rights reserved. Oracle Customers Leveraging Data Domain Oracle tablespace archive for data warehouse Large table spaces are written to Data Domain systems and flagged as read only and used for data mining Sustained deduplication ratios of >7:1 Large California-based clothing retailer
42
42© Copyright 2010 EMC Corporation. All rights reserved. EMC Data Domain is just disk to me. Changing RMAN scripts to go straight to Data Domain disk was simple. DBA Manager Oracle RMAN to Disk National supermarket chain testimonial We used to have to go through our backup team for recovery requests and 90% of our actual restore time was spent waiting on tape and administration. With Data Domain, I don't have to wait for someone else to satisfy a restore request or a tape recall. DBA Manager
43
43© Copyright 2010 EMC Corporation. All rights reserved. Summary How deduplication benefits Oracle/RMAN backups Simplification Savings
44
44© Copyright 2010 EMC Corporation. All rights reserved. More Information… For more information on EMC Data Domain and Oracle, visit http://www.datadomain.com/solutions/oracle.html
45
45© Copyright 2010 EMC Corporation. All rights reserved.
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.