Storage Trends & Technologies by Mark Leedy By Mark Leedy October, 2009

Storage Trends & Technologies Agenda Storage History Storage primer - HDD technology - RAID levels & descriptions - Storage topologies Emerging trends - Edge storage - Cloud services - Storage optimization Conclusion

Storage - Why Should You care Storage is at the core of what we do… Capture & transmit Information 2. Safely store it 3. Retrieve it upon demand

Trends that drive storage Camera count - up, UP UP Retention – 30, 60, 90 Days……… 1, 2, 3 Years! Frame rate – now 7.5 min……….15 – 30 common Megapixel cameras – 1.3 – 5 standard

MegaPixel Storage Demands Image Quality fps 1 day 7days 30 days SD (VGA or 4CIF) 15 12 GB 81GB 347GB 1.3 MP (720P) 42GB 294GB 1,258GB 2 MP (1080P) 61GB 425GB 1,822GB 5 MP 162GB 1,134GB 4,859GB

Storage Primer

Storage Primer HDD & Buss Technologies IDE/ATA SATA – Serial ATA SCSI- Small Computer System Interface Fiber channel SAS - Serial Attached SCSI SATA Connector SCSI Connector Fiber Channel Connector

Storage Primer RAID (Redundant Array of Independent Disks) RAID Levels - RAID 0 Striping, no parity - RAID 1 Mirroring or Duplexing -RAID 10 Mirrored striping -RAID 3 byte-level striping with dedicated parity disk -RAID 4 block-level striping with a dedicated parity disk - RAID 5 Block Striping w/parity - RAID 6 Block Striping w/ dual parity

Storage Primer RAID 0, Striping, no parity (Error detection) A E M I Q B F J N R C G K O S D H L P T

Storage Primer = = Mirrored Pair Mirrored Pair RAID 1 - Mirroring or Duplexing A B D C E A B C D E F G H I J F G H I J = = Mirrored Pair Mirrored Pair

Storage Primer = Striping Striping Mirroring RAID 10 (0+1) Mirrored striping A B D C E F G H I J A B C D E F G H I J = Striping Striping Mirroring

Storage Primer RAID 5, Block striping w/distributed parity P Server Generator Server A3 A2 A1 A0 P4 PARITY B4 B1 B0 C4 D4 D2 D3 E2 E3 E1 C3 C0 B3 C1 D0 E4 P3 PARITY A Blocks B Blocks C Blocks D Blocks E Blocks

Storage Primer RAID 6 – Block striping, dual parity P Q Striped set with dual distributed parity RAID 6 – Block striping, dual parity P Q XOR Parity Generator (P) ECC code Generator (Q) Server Q3 PARITY A2 A1 A0 P4 PARITY B4 B1 B0 C4 D4 D2 D3 E2 E3 E1 C3 C0 Q2 PARITY Q1 PARITY Q0 PARITY Q4 PARITY P3 PARITY P2 PARITY P1 PARITY A Blocks B Blocks C Blocks D Blocks E Blocks

Storage Primer RAID Controllers Software RAID - OS based disk controller Advantages Low cost – no hardware requires Cost effective alternative for small server environments Disadvantages Dependant upon OS for all storage functions Shares CPU processing cycles w/OS and other apps Proprietary to specific OS Not scalable to enterprise class data centers

Storage Primer RAID Controllers Hardware RAID - the Gold standard Advantages Purpose-built device off-loads major workload Requires no server/CPU resources Supports multiple HDD formats Can support many operating systems simultaneously Provides non-voliatle cache - protects against data loss during loss of power Disadvantages Usually higher cost than SW or FW RAID

Storage Primer Three primary storage types 1. Internal (to DVR/NVR) 2. External DAS NAS SAN 3. Edge (inside camera)

Storage Primer Internal Storage Shadow NVR Advantages Up to 16TB (raw) Fully integrated package Small foot print (2 rack unit) Supports RAID 5 & 6 HW RAID controller Disadvantages Fixed capacity

Storage Primer External Storage Topologies Direct Attached Storage (DAS) 1-1 ratio of server to array Usually SCSI attached Server RAID Devices LAN

Storage Primer External Storage Topologies Direct Attached Storage (DAS) Advantages Most simple and widely used external storage Very cost effective Uses reliable , time-tested SCSI buss Can use low cost COTS HW (dumb RAIDs) Disadvantages Cannot be switched Cannot share arrays between servers /NVRs No remote access Not highly scalable

Storage Primer External Storage Topologies Network Attached Storage (NAS) NAS is a network appliance which can allow file sharing and storage across the LAN or WAN NAS stores specific files not blocks of data NAS resources are identified by drive letter A NAS Device IS a file server Server NAS Device LAN

Storage Primer External Storage Topologies Network Attached Storage (NAS) Advantages Most cost effective external storage topology Uses existing LAN for connectivity Can use low cost COTS HW Disadvantages Dependant upon LAN for all storage file transfers. Must run OS based file protocol (NFS, Win…) Not usually enterprise class for availability Not highly scalable Possible CPU choke point Not usually good fit for mass data transfer – like DVS

Storage Primer External Storage Topologies Storage Area Network (SAN) Fiber Channel Server FC Switch LAN Storage Array Server Fiber or Copper

Storage Primer External Storage Topologies Fiber Channel SAN Advantages Very fast block level data transfer Requires no server/CPU resources OS agnostic Highly fault tolerant Highly scalable Disadvantages Higher cost than NAS or DAS Distance limitations Fiber Channel devices expensive and complex

Storage Primer Storage Area Network (SAN) Server GB Ethernet Switch LAN iSCSI over Ethernet Server Server Storage Array

Storage Primer External Storage Buss iSCSI SAN Advantages Requires no server/CPU resources Uses standard Ethernet componentry GB Ethernet & NIC devices Highly scalable More cost effective than FC in many applications Disadvantages Still subject to certain Ethernet overhead (70% rule) Not as high throughput or redundancy as FC Fabric

Network considerations Storage Optimization Network considerations LAN NVR NVR Ethernet Switch RAID

Network considerations Storage Optimization Network considerations NVR LAN NVR Ethernet Switch Ethernet Switch SAN RAID RAID

Nexsan Products SataBoy 14 drive SATA RAID system 14TB with 1TB drives Sustained RAID 5 reads 370 MB/s; writes 285 MB/s (with one controller) 2x2x2Gb FC host ports 2x2x1Gb iSCSI host ports Up to 4GB of cache Hardware RAID 6

Nexsan Products SataBeast - 84TB in 4RU Highest density in the industry!

Nexsan Products SataBeast 42 drive SATA RAID system 84TB with 42 2TB drives Anti-vibration design maximizes drive reliability Horizontal mid-plane maximizes airflow Very high performance RAID controllers: 800+ MB/s reads with dual controllers 2x2x4Gb FC host ports 2x2x1Gb iSCSI host ports Up to 4GB of cache Hardware RAID 6

Network considerations Storage Optimization Network considerations Hardware RAID always outperforms SW RAID LAN dependant storage will not scale well for digital video If SAN is required, separate switch must be specified Always specify GB switches for SAN use

Storage Primer External Storage Topologies - iSCSI SAN

Cloud Storage? ???

Storage Primer Cloud Storage Featured Web Seminar: The Cloud: A Look at Today and Tomorrow Tuesday, March13, 2012 @ 12pm ET Get an in-depth look at the cloud and how to maximize its potential. The buzz in the IT community is all about the cloud. Many organizations are either adopting cloud technologies or are looking into plans for implementation. Look at various Infrastructure (IaaS), Software (SaaS) and Platform (PaaS) offerings Get comprehensive discussions on Cloud capabilities, as well as inabilities Find out where the cloud will make operations more efficient and where caution needs to take place within the organization Get a deeper look into the future of cloud technologies, and it's role within IT Gain insight into how the cloud will become critical to an organization's mobile device strategy for assistance in consumerization and BYOD strategies Register today! Orin Thomas Orin Thomas, MCITP, MCT, MVP is an author, trainer and regular public speaker who has authored more than 20 books for Microsoft Press. He is the convener of the Melbourne Security and Infrastructure Group His most recent books are on Windows 7, Windows Server 2008 R2, and Exchange Server 2010. Orin is a contributing editor for Windows IT Pro and a Windows Security MVP. He writes the Hyperbole, Embellishment, and System Administration Blog

Cloud Storage? Terms Cloud Computing = internet - Somewhere else than here Cloud services Virtualization VSaaS – Video Surveillance as a service Hosted / managed services - Storage and/or VMS hosted off-site

VSaaS Discussion Advantages Disadvantages No capital investment in hardware No footprint or real estate No power or other infrastructure Disadvantages Monthly subscription fees – sometimes far more expensive than traditional surveillance systems. Bandwidth constraints limit VSaaS - drive up costs Usually only support low resolution images Incompatible with MP (720p HD typically requires 1 to 2 Mb/s)

Edge Storage (Internal to Camera) SD Card - Secure Digital Non-volatle memory card Capacity up to 64GB Driven by consumer elect. Now adapted to many security cameras

Typical DV storage requirements Edge Storage Typical DV storage requirements   2 GB 4 GB 8 GB 16 GB 32 GB Movies Fine mode 13Mbps/CBR 20 min. 40 min. 80 min. 160 min. 320 min. Normal mode 9Mbps/VBR 30 min. 60 min. 120 min. 240 min. 480 min. Economy mode 6Mbps/VBR 45 min. 180 min. 360 min. 720 min. Photos 10 Megapixels, 3648x2736, Fine mode 770 photos 1,540 photos 3,080 photos 6,160 photos 12,320 photos

Edge Storage (Internal to Camera) Advantages Disadvantages Requires no server/CPU resources Eliminates the need for recorder appliance on site Simple to physically add to the camera Can record for a few days Usually used as short-term buffer Disadvantages Limited Megapixel support Video could be stolen with camera Cost of SD chips still high (64GB = $140.00)

Video Storage Optimization

Storage Optimization Camera / signal strength & quality - Low S/N ratio = high storage & bandwidth Codec / compression technology Rules based recording - Analytics, motion, event, schedule etc. Dual streaming Data aging (pruning)

NVR w/ internal storage Storage Optimization Dual streaming model Dual streaming cameras LAN LAN Ethernet Switch NVR w/ external storage (180 days @ 1ips) NVR w/ internal storage (30 days @ 15ips) RAID

Video Aging What is it??? Advantages Cost (equip, power, real estate) Pruning Recompression Lifecycle management Advantages Cost (equip, power, real estate) Disadvantages Loss of quality (frame rate and/or resolution) Discarding Data

Thank you for your input! Conclusion Storage remains at the core of Video Surveillance Emerging technologies offer potential savings You will be required to learn new terms and Vicon has Enterprise Class storage solutions We’re working hard to keep up with Tech trends Thank you for your input!

Thank YOU!