Presentation is loading. Please wait.

Presentation is loading. Please wait.

To dedup or not to dedup ? Deduplication Deep Dive.

Published byEdwina Booker Modified over 9 years ago

Similar presentations

Presentation on theme: "To dedup or not to dedup ? Deduplication Deep Dive."— Presentation transcript:

1 To dedup or not to dedup ? Deduplication Deep Dive

2 About Me Kamil Bączyk Core & BPOS Consultant \ Trainer MCT, MCSE, MCSA, MCITP, MCTS, MCP, ITIL, CEHv7, etc …. @ Facebook, LinkedIn, Goldenline, Xing … baczyk.kamil@gmail.com

3 Time to talk Facts Discuss Windows Server 2012 Disk Deduplication Demo

4 Facts Boiling Points: File Data Growth  Data demand rises  Increased stress – backup solutions Storage TCO  Disk cost  Data Management Consolidation Data decentralization  Offline and secure data  WAN / LAN Access IDC Worldwide File-Based Storage Forecast, doc #231910, 2011

5 Facts – what is it ? Goal : use less storage Method : Check and ensure that identical content in multiple files (big) is only stored once Block-based, post-process, transparent solution Dedup

6 Facts – what is it ? MODELS: Source : Prevent transferring data, if duplicate Inline : Perform dedup when data is written (NTFS Compression, Slow Post-Process : Works after, in the background, Used in Windows Server 2012 Dedup

7 Facts – what is it ? Other ways: SIS (Single-Instance-Storage): File based solution in W2K NTFS Compression : Inline, CPU based NTFS hard links : Not transparent, file-based Dedup

8 Facts – how it works ? Segment data into „chunks” Identify duplicate chunks Maintain a single copy of each „chunk” Compress Reference existing files with reparse points Default (5day policy) Free

9 Facts – how it works ? Manage by PowerShell, WMI, Server Manager, Transparent for data – Mini Filter Maintain a single copy of each „chunk” Compress Data Chunks Dedicated Service (DDPSVC) Default (5day policy) Audit - Event Viewer\Applications and Services Logs\Microsoft\Windows\Deduplication\ Chunks files 32-64 KB CRC Checking – Hot Spots

10 Facts – how it works ? Only on Windows Server 2012 Filter Driver Windows Cache – Dedup Aware No GPO Doesn’t work on CSV but supports cluster data No support for Boot Drives or System Drives Works on NTFS, no ReFS support Excluded specified files by default or manually DDPSVC – checks 100Gb ~ 1 hour Default policy 5days Scheduled process Live SQL DBs or Exchange Live Production VMs / VDI

11 Discussion ? When to use it ? VHD backup library Folder redirection servers DB backup volumes Software deployment shares

12 Discussion ? How to check ? Dedup Eval tool PowerShell ?

13 Demo Deduplication Deep Dive

14 Q & A

15 Thank You Kamil Bączyk Core & BPOS Consultant \ Trainer MCT, MCSE, MCSA, MCITP, MCTS, MCP, ITIL, CEHv7, etc …. @ Facebook, LinkedIn, Goldenline, Xing … baczyk.kamil@gmail.com

Download ppt "To dedup or not to dedup ? Deduplication Deep Dive."

Similar presentations

Server Virtualization Backups, Disaster Recovery, Business Continuity Steve Evans

Server Virtualization Backups, Disaster Recovery, Business Continuity Steve Evans
®® Microsoft Windows 7 for Power Users Tutorial 6 Optimizing Your Hard Disk.

®® Microsoft Windows 7 for Power Users Tutorial 6 Optimizing Your Hard Disk.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 9: Implementing and Using Group Policy.

70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 9: Implementing and Using Group Policy.
Denny Cherry Senior Database Administrator / Architect Awareness Technologies MVP, MCSA, MCDBA, MCTS, MCITP.

Denny Cherry Senior Database Administrator / Architect Awareness Technologies MVP, MCSA, MCDBA, MCTS, MCITP.
Configuring Windows Vista Security Chapter 3. IE7 Pop-up Blocker Pop-up Blocker prevents annoying and sometimes unsafe pop-ups from web sites Can block.

Configuring Windows Vista Security Chapter 3. IE7 Pop-up Blocker Pop-up Blocker prevents annoying and sometimes unsafe pop-ups from web sites Can block.
Windows XP File System Management Group D. 3 Layers of Drivers Filter Drivers Filter Drivers –Virus protection, compression, encryption File System Drivers.

Windows XP File System Management Group D. 3 Layers of Drivers Filter Drivers Filter Drivers –Virus protection, compression, encryption File System Drivers.
Denny Cherry Manager of Information Systems MVP, MCSA, MCDBA, MCTS, MCITP.

Denny Cherry Manager of Information Systems MVP, MCSA, MCDBA, MCTS, MCITP.
Chapter 7: Configuring Disks. 2/24 Objectives Learn about disk and file system configuration in Vista Learn how to manage storage Learn about the additional.

Chapter 7: Configuring Disks. 2/24 Objectives Learn about disk and file system configuration in Vista Learn how to manage storage Learn about the additional.
CN2140 Server II Kemtis Kunanuraksapong MSIS with Distinction MCT, MCITP, MCTS, MCDST, MCP, A+

CN2140 Server II Kemtis Kunanuraksapong MSIS with Distinction MCT, MCITP, MCTS, MCDST, MCP, A+
Calvin Keaton Product Planner- Storage Solutions Microsoft Corporation Microsoft Confidential – NDA Use only.

Calvin Keaton Product Planner- Storage Solutions Microsoft Corporation Microsoft Confidential – NDA Use only.
Chapter 7: Configuring Disks. Configuring File Systems Fat32 –First used with Windows 95 OSR2 –Smaller cluster sizes, more efficient storage up to 32.

Chapter 7: Configuring Disks. Configuring File Systems Fat32 –First used with Windows 95 OSR2 –Smaller cluster sizes, more efficient storage up to 32.
MIS 431 Chapter 71 Ch. 7: Advanced File Management System MIS 431 Created Spring 2006.

MIS 431 Chapter 71 Ch. 7: Advanced File Management System MIS 431 Created Spring 2006.
70-270, 70-290 MCSE/MCSA Guide to Installing and Managing Microsoft Windows XP Professional and Windows Server 2003 Chapter Nine Managing File System Access.

70-270, MCSE/MCSA Guide to Installing and Managing Microsoft Windows XP Professional and Windows Server 2003 Chapter Nine Managing File System Access.
Efficiently store fewer bits. File1 File2 After Dedup: Before Dedup:5TB Chunk Store Non-Optimized Files Optimized file stubs Savings = 4TB 1TB.

Efficiently store fewer bits. File1 File2 After Dedup: Before Dedup:5TB Chunk Store Non-Optimized Files Optimized file stubs Savings = 4TB 1TB.
5.1 © 2004 Pearson Education, Inc. Exam 70-290 Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 5: Working with File Systems.

5.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 5: Working with File Systems.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 11 Managing and Monitoring a Windows Server 2008 Network.

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 11 Managing and Monitoring a Windows Server 2008 Network.
Welcome Course 20410B Module 0: Introduction Audience

Welcome Course 20410B Module 0: Introduction Audience
Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE 14-10 Server with redundant NICs.

Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 7 Configuring File Services in Windows Server 2008.

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 7 Configuring File Services in Windows Server 2008.
1 Using Compressed Files and Folders Applications and operating systems read and write to compressed files. NTFS uncompresses the file before making it.

1 Using Compressed Files and Folders Applications and operating systems read and write to compressed files. NTFS uncompresses the file before making it.

Similar presentations

Ads by Google