To dedup or not to dedup ? Deduplication Deep Dive.

Slides:

Advertisements

Similar presentations

Server Virtualization Backups, Disaster Recovery, Business Continuity Steve Evans

Advertisements

®® Microsoft Windows 7 for Power Users Tutorial 6 Optimizing Your Hard Disk.

70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 9: Implementing and Using Group Policy.

Denny Cherry Senior Database Administrator / Architect Awareness Technologies MVP, MCSA, MCDBA, MCTS, MCITP.

Configuring Windows Vista Security Chapter 3. IE7 Pop-up Blocker Pop-up Blocker prevents annoying and sometimes unsafe pop-ups from web sites Can block.

Windows XP File System Management Group D. 3 Layers of Drivers Filter Drivers Filter Drivers –Virus protection, compression, encryption File System Drivers.

Denny Cherry Manager of Information Systems MVP, MCSA, MCDBA, MCTS, MCITP.

Chapter 7: Configuring Disks. 2/24 Objectives Learn about disk and file system configuration in Vista Learn how to manage storage Learn about the additional.

CN2140 Server II Kemtis Kunanuraksapong MSIS with Distinction MCT, MCITP, MCTS, MCDST, MCP, A+

Calvin Keaton Product Planner- Storage Solutions Microsoft Corporation Microsoft Confidential – NDA Use only.

Chapter 7: Configuring Disks. Configuring File Systems Fat32 –First used with Windows 95 OSR2 –Smaller cluster sizes, more efficient storage up to 32.

MIS 431 Chapter 71 Ch. 7: Advanced File Management System MIS 431 Created Spring 2006.

70-270, MCSE/MCSA Guide to Installing and Managing Microsoft Windows XP Professional and Windows Server 2003 Chapter Nine Managing File System Access.

Efficiently store fewer bits. File1 File2 After Dedup: Before Dedup:5TB Chunk Store Non-Optimized Files Optimized file stubs Savings = 4TB 1TB.

5.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 5: Working with File Systems.

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 11 Managing and Monitoring a Windows Server 2008 Network.

Welcome Course 20410B Module 0: Introduction Audience

Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 7 Configuring File Services in Windows Server 2008.

1 Using Compressed Files and Folders Applications and operating systems read and write to compressed files. NTFS uncompresses the file before making it.

Upgrading the Platform - How to Get There!

Agenda Master Expert Associat e Microsoft Certified Solutions Master (MCSM) Microsoft Certified Solutions Expert (MCSE) Microsoft Certified Solutions.

COMPUTER FUNDAMENTALS David Samuel Bhatti

SQL Server 2008 & Solid State Drives Jon Reade SQL Server Consultant SQL Server 2008 MCITP, MCTS Co-founder SQLServerClub.com, SSC

Hyper-V High-Availability & Mobility: Designing the Infrastructure for Your Private Cloud Symon Perriman Technical Evangelist Microsoft

Windows ® Powered NAS. Agenda Windows Powered NAS Windows Powered NAS Key Technologies in Windows Powered NAS Key Technologies in Windows Powered NAS.

Storage and NT File System INFO333 – Lecture Mariusz Nowostawski Noria Foukia.

Cluster Shared Volumes Reborn in Windows Server 2012: Deep Dive Amitabh Tamhane Vineeth Karinta Program Manager 2 Senior Engineer Microsoft Corporation.

WINDOWS XP PROFESSIONAL Bilal Munir Mughal Chapter-1 1.

Understanding the Benefits and Costs of Deduplication Mahmoud Abaza, and Joel Gibson School of Computing and Information Systems, Athabasca University.

Week 9 Objectives Securing Files and Folders Protecting Shared Files and Folders by Using Shadow Copies Configuring Network Printing.

Implementing File and Print Services

KEVIN RUPERT INSTRUCTOR 1 IT133 Software Applications.

Windows Server 2012 WELCOME!. About Us Brandon Nohr MCITP: Server Administrator MCITP: Enterprise Administrator MCITP: Database Administrator MCTS: Server.

CN1176 Computer Support Kemtis Kunanuraksapong MSIS with Distinction MCT, MCTS, MCDST, MCP, A+

CN2140 Server II Kemtis Kunanuraksapong MSIS with Distinction MCT, MCITP, MCTS, MCDST, MCP, A+

Information Architecture Linden Daniels. Steps of a Successful Information Architecture Discovery Education Design Migration Monitor.

Leaders Have Vision™ visionsolutions.com 1 Leading Edge Solutions, Proven Technologies Anne-Elisabeth Caillot Pre-Sales & Business Development

TMurgent Technologies Henry Schulman New Horizons of Boston Virtualization Project Engineer MCSE, MCT, MCTS, MCITP SCI: SoftGrid Certified Instructor Virtualization.

DATA DEDUPLICATION By: Lily Contreras April 15, 2010.

+ Administering Microsoft SQL Server 2012 Databases Implementing a Data Warehouse with Microsoft SQL Server = Querying Microsoft SQL.

4/23/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.

4.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 4: Organizing a Disk for Data.

Live Migration Failover Clustering with Cluster Shared Volumes (CSV) Support for new Processor features Improved Performance Lower Power Costs Enhanced.

WS2012 File and Storage Services Management Name Jeff Alexander Technical Evangelist – Windows Infrastructure Microsoft Australia

Module 4 Planning for Group Policy. Module Overview Planning Group Policy Application Planning Group Policy Processing Planning the Management of Group.

ADAPTING YOUR ETL SOLUTION TO USE SSIS 2012 Presentation by Devin Knight

Member of Erste Group 80 people (Croatian subsidiary) 250 people (Together with IT Dev part of ErsteBank) IT service provider for ErsteBank Group entities.

Page 1 File Systems and Disk Management Lecture 5 Hassan Shuja 10/19/2004.

Protecting SharePoint with System Center Data Protection Manager 2007 Chris Whitehead Premier Field Engineer Microsoft UK.

1 Introduction to Auditing Auditing allows you to track User activities. Microsoft Windows 2000 activities. Windows 2000 records events in the security.

Microsoft Windows XP Professional MCSE Exam

Managing Applications, Services, Folders, and Libraries Lesson 4.

CN1260 Client Operating System Kemtis Kunanuraksapong MSIS with Distinction MCT, MCITP, MCTS, MCDST, MCP, A+

MCSA Fall, ◦ NTFS  Disk Quotas  File System Encryption  Dynamic Volumes  Mounted Drives  Remote Storage  Self-healing NTFS  Security ◦ ReFS.

1 Introduction to Shared Folders Shared folders provide network users access to files. Users connect to the shared folder over the network. Users must.

GROUP POLICY. Group Policy is a hierarchical infrastructure which allows systems administrators to configure computer and user settings from a central.

What’s New in CA ARCserve® r16.5. Important Note: This presentation is designed as an addendum to the full CA ARCserve r16 Master Customer Presentation.

Windows Certification Paths OR MCSA Windows Server 2012 Installing and Configuring Windows Server 2012 Exam (20410) Administering Windows Server.

Microsoft Installing & Configuring Windows Server Exam Questions Answers Powered By:

Brian Lauge Pedersen Senior DataCenter Technology Specialist Microsoft Danmark.

Microsoft Virtual Academy Module 9 Configuring and Managing the VMM Library.

Deploying disk deduplication for Hyper-v 3.0 Žigmund Maťašovský.

PHD Virtual Technologies “Reader’s Choice” Preferred product.

Disaster Recovery Scenarios René Romo González DBA at Intel Second Meetup DBA100.

Data Storage Requirements

11/10/2018 Desktop Virtualization Corey Hynes Kyle Rosenthal President Technical Lead HynesITe Inc Spider Consulting @windowspcguy.

12/9/2018 Desktop Virtualization Corey Hynes Kyle Rosenthal President Technical Lead HynesITe Inc Spider Consulting @windowspcguy.

Quick Tips #1 – Wan accelerator seeding for backup jobs

Presentation transcript:

To dedup or not to dedup ? Deduplication Deep Dive

About Me Kamil Bączyk Core & BPOS Consultant \ Trainer MCT, MCSE, MCSA, MCITP, MCTS, MCP, ITIL, CEHv7, etc Facebook, LinkedIn, Goldenline, Xing …

Time to talk Facts Discuss Windows Server 2012 Disk Deduplication Demo

Facts Boiling Points: File Data Growth  Data demand rises  Increased stress – backup solutions Storage TCO  Disk cost  Data Management Consolidation Data decentralization  Offline and secure data  WAN / LAN Access IDC Worldwide File-Based Storage Forecast, doc #231910, 2011

Facts – what is it ? Goal : use less storage Method : Check and ensure that identical content in multiple files (big) is only stored once Block-based, post-process, transparent solution Dedup

Facts – what is it ? MODELS: Source : Prevent transferring data, if duplicate Inline : Perform dedup when data is written (NTFS Compression, Slow Post-Process : Works after, in the background, Used in Windows Server 2012 Dedup

Facts – what is it ? Other ways: SIS (Single-Instance-Storage): File based solution in W2K NTFS Compression : Inline, CPU based NTFS hard links : Not transparent, file-based Dedup

Facts – how it works ? Segment data into „chunks” Identify duplicate chunks Maintain a single copy of each „chunk” Compress Reference existing files with reparse points Default (5day policy) Free

Facts – how it works ? Manage by PowerShell, WMI, Server Manager, Transparent for data – Mini Filter Maintain a single copy of each „chunk” Compress Data Chunks Dedicated Service (DDPSVC) Default (5day policy) Audit - Event Viewer\Applications and Services Logs\Microsoft\Windows\Deduplication\ Chunks files KB CRC Checking – Hot Spots

Facts – how it works ? Only on Windows Server 2012 Filter Driver Windows Cache – Dedup Aware No GPO Doesn’t work on CSV but supports cluster data No support for Boot Drives or System Drives Works on NTFS, no ReFS support Excluded specified files by default or manually DDPSVC – checks 100Gb ~ 1 hour Default policy 5days Scheduled process Live SQL DBs or Exchange Live Production VMs / VDI

Discussion ? When to use it ? VHD backup library Folder redirection servers DB backup volumes Software deployment shares

Discussion ? How to check ? Dedup Eval tool PowerShell ?

Demo Deduplication Deep Dive

Q & A

Thank You Kamil Bączyk Core & BPOS Consultant \ Trainer MCT, MCSE, MCSA, MCITP, MCTS, MCP, ITIL, CEHv7, etc Facebook, LinkedIn, Goldenline, Xing …