1. Storage Trends & Technologies by Mark Leedy
By Mark Leedy October, 2009

2. Storage Trends & Technologies
Agenda
Storage History
Storage primer
- HDD technology
- RAID levels & descriptions
- Storage topologies
Emerging trends
- Edge storage
- Cloud services
- Storage optimization
Conclusion

3. Storage - Why Should You care
Storage is at the core of what we do…
Capture & transmit Information
2. Safely store it
3. Retrieve it upon demand

4. Trends that drive storage
Camera count - up, UP UP
Retention – 30, 60, 90 Days……… 1, 2, 3 Years!
Frame rate – now 7.5 min……….15 – 30 common
Megapixel cameras – 1.3 – 5 standard

5. MegaPixel Storage Demands
Image Quality
fps
1 day
7days
30 days SD
(VGA or 4CIF) 15
12 GB
81GB
347GB
1.3 MP
(720P)
42GB
294GB
1,258GB
2 MP
(1080P)
61GB
425GB
1,822GB
5 MP
162GB
1,134GB
4,859GB

6. Storage Primer

7. Storage Primer HDD & Buss Technologies
IDE/ATA
SATA – Serial ATA
SCSI- Small Computer
System Interface
Fiber channel
SAS - Serial Attached SCSI
SATA Connector
SCSI Connector
Fiber Channel
Connector

8. Storage Primer RAID (Redundant Array of Independent Disks)
RAID Levels
- RAID 0 Striping, no parity
- RAID 1 Mirroring or Duplexing
-RAID 10 Mirrored striping
-RAID 3 byte-level striping with
dedicated parity disk
-RAID 4 block-level striping with a dedicated parity disk
- RAID 5 Block Striping w/parity
- RAID 6 Block Striping w/ dual parity

9. Storage Primer RAID 0, Striping, no parity (Error detection) A E M I QB F J N R C G K O S D H L P T

10. Storage Primer = = Mirrored Pair Mirrored Pair
RAID Mirroring or Duplexing A B D C E A B C D E F G H I J F G H I J = =
Mirrored Pair
Mirrored Pair

11. Storage Primer = Striping Striping Mirroring
RAID 10 (0+1) Mirrored striping A B D C E F G H I J A B C D E F G H I J =
Striping
Striping
Mirroring

12. Storage Primer RAID 5, Block striping w/distributed parity P Server
Generator
Server A3 A2 A1 A0
P4 PARITY B4 B1 B0 C4 D4 D2 D3 E2 E3 E1 C3 C0 B3 C1 D0 E4
P3 PARITY
A Blocks
B Blocks
C Blocks
D Blocks
E Blocks

13. Storage Primer RAID 6 – Block striping, dual parity P Q
Striped set with dual distributed parity
RAID 6 – Block striping, dual parity P Q
XOR Parity
Generator
(P)
ECC code
Generator
(Q)
Server
Q3 PARITY A2 A1 A0
P4 PARITY B4 B1 B0 C4 D4 D2 D3 E2 E3 E1 C3 C0
Q2 PARITY
Q1 PARITY
Q0 PARITY
Q4 PARITY
P3 PARITY
P2 PARITY
P1 PARITY
A Blocks
B Blocks
C Blocks
D Blocks
E Blocks

14. Storage Primer RAID Controllers
Software RAID - OS based disk controller
Advantages
Low cost – no hardware requires
Cost effective alternative for small server environments
Disadvantages
Dependant upon OS for all storage functions
Shares CPU processing cycles w/OS and other apps
Proprietary to specific OS
Not scalable to enterprise class data centers

15. Storage Primer RAID Controllers
Hardware RAID - the Gold standard
Advantages
Purpose-built device off-loads major workload
Requires no server/CPU resources
Supports multiple HDD formats
Can support many operating systems simultaneously
Provides non-voliatle cache - protects against data loss during loss of power
Disadvantages
Usually higher cost than SW or FW RAID

16. Storage Primer Three primary storage types 1. Internal (to DVR/NVR)
2. External
DAS
NAS
SAN
3. Edge (inside camera)

17. Storage Primer Internal Storage
Shadow NVR
Advantages
Up to 16TB (raw)
Fully integrated package
Small foot print (2 rack unit)
Supports RAID 5 & 6
HW RAID controller
Disadvantages
Fixed capacity

18. Storage Primer External Storage Topologies
Direct Attached Storage (DAS)
1-1 ratio of server to array
Usually SCSI attached
Server
RAID Devices
LAN

19. Storage Primer External Storage Topologies
Direct Attached Storage (DAS)
Advantages
Most simple and widely used external storage
Very cost effective
Uses reliable , time-tested SCSI buss
Can use low cost COTS HW (dumb RAIDs)
Disadvantages
Cannot be switched
Cannot share arrays between servers /NVRs
No remote access
Not highly scalable

20. Storage Primer External Storage Topologies
Network Attached Storage (NAS)
NAS is a network appliance which can allow file sharing and storage across the LAN or WAN
NAS stores specific files not blocks of data
NAS resources are identified by drive letter
A NAS Device IS a file server
Server
NAS Device
LAN

21. Storage Primer External Storage Topologies
Network Attached Storage (NAS)
Advantages
Most cost effective external storage topology
Uses existing LAN for connectivity
Can use low cost COTS HW
Disadvantages
Dependant upon LAN for all storage file transfers.
Must run OS based file protocol (NFS, Win…)
Not usually enterprise class for availability
Not highly scalable
Possible CPU choke point
Not usually good fit for mass data transfer – like DVS

22. Storage Primer External Storage Topologies
Storage Area Network (SAN) Fiber Channel
Server
FC Switch
LAN
Storage Array
Server
Fiber or Copper

23. Storage Primer External Storage Topologies
Fiber Channel SAN
Advantages
Very fast block level data transfer
Requires no server/CPU resources
OS agnostic
Highly fault tolerant
Highly scalable
Disadvantages
Higher cost than NAS or DAS
Distance limitations
Fiber Channel devices expensive and complex

24. Storage Primer Storage Area Network (SAN)
Server
GB Ethernet
Switch
LAN
iSCSI over Ethernet
Server
Server
Storage Array

25. Storage Primer External Storage Buss
iSCSI SAN
Advantages
Requires no server/CPU resources
Uses standard Ethernet componentry
GB Ethernet & NIC devices
Highly scalable
More cost effective than FC in many applications
Disadvantages
Still subject to certain Ethernet overhead (70% rule)
Not as high throughput or redundancy as FC Fabric

26. Network considerations
Storage Optimization
Network considerations
LAN
NVR
NVR
Ethernet Switch
RAID

27. Network considerations
Storage Optimization
Network considerations
NVR
LAN
NVR
Ethernet Switch
Ethernet Switch
SAN
RAID
RAID

28. Nexsan Products SataBoy 14 drive SATA RAID system 14TB with 1TB drives
Sustained RAID 5 reads 370 MB/s; writes 285 MB/s (with one controller)
2x2x2Gb FC host ports
2x2x1Gb iSCSI host ports
Up to 4GB of cache
Hardware RAID 6

29. Nexsan Products SataBeast - 84TB in 4RU
Highest density in the industry!

30. Nexsan Products SataBeast 42 drive SATA RAID system
84TB with 42 2TB drives
Anti-vibration design maximizes drive reliability
Horizontal mid-plane maximizes airflow
Very high performance RAID controllers: 800+ MB/s reads with dual controllers
2x2x4Gb FC host ports
2x2x1Gb iSCSI host ports
Up to 4GB of cache
Hardware RAID 6

31. Network considerations
Storage Optimization
Network considerations
Hardware RAID always outperforms SW RAID
LAN dependant storage will not scale well for digital video
If SAN is required, separate switch must be specified
Always specify GB switches for SAN use

32. Storage Primer External Storage Topologies - iSCSI SAN

33. Cloud Storage?
???

34. Storage Primer Cloud Storage
Featured Web Seminar: The Cloud: A Look at Today and Tomorrow Tuesday, March13, 12pm ET
Get an in-depth look at the cloud and how to maximize its potential.
The buzz in the IT community is all about the cloud. Many organizations are either adopting cloud technologies or are looking into plans for implementation.
Look at various Infrastructure (IaaS), Software (SaaS) and Platform (PaaS) offerings
Get comprehensive discussions on Cloud capabilities, as well as inabilities
Find out where the cloud will make operations more efficient and where caution needs to take place within the organization
Get a deeper look into the future of cloud technologies, and it's role within IT
Gain insight into how the cloud will become critical to an organization's mobile device strategy for assistance in consumerization and BYOD strategies
Register today!
Orin Thomas
Orin Thomas, MCITP, MCT, MVP is an author, trainer and regular public speaker who has authored more than 20 books for Microsoft Press. He is the convener of the Melbourne Security and Infrastructure Group His most recent books are on Windows 7, Windows Server 2008 R2, and Exchange Server Orin is a contributing editor for Windows IT Pro and a Windows Security MVP. He writes the Hyperbole, Embellishment, and System Administration Blog

35. Cloud Storage? Terms Cloud Computing = internet
- Somewhere else than here
Cloud services
Virtualization
VSaaS – Video Surveillance as a service
Hosted / managed services
- Storage and/or VMS hosted off-site

36. VSaaS Discussion Advantages Disadvantages
No capital investment in hardware
No footprint or real estate
No power or other infrastructure
Disadvantages
Monthly subscription fees – sometimes far more expensive than
traditional surveillance systems.
Bandwidth constraints limit VSaaS - drive up costs
Usually only support low resolution images
Incompatible with MP (720p HD typically requires 1 to 2 Mb/s)

37. Edge Storage (Internal to Camera)
SD Card - Secure Digital
Non-volatle memory card
Capacity up to 64GB
Driven by consumer elect.
Now adapted to many
security cameras

38. Typical DV storage requirements
Edge Storage
Typical DV storage requirements
2 GB
4 GB
8 GB
16 GB
32 GB
Movies
Fine mode 13Mbps/CBR
20 min.
40 min.
80 min.
160 min.
320 min.
Normal mode 9Mbps/VBR
30 min.
60 min.
120 min.
240 min.
480 min.
Economy mode 6Mbps/VBR
45 min.
180 min.
360 min.
720 min.
Photos
10 Megapixels, x2736, Fine mode
770 photos
1,540 photos
3,080 photos
6,160 photos
12,320 photos

39. Edge Storage (Internal to Camera) Advantages Disadvantages
Requires no server/CPU resources
Eliminates the need for recorder appliance on site
Simple to physically add to the camera
Can record for a few days
Usually used as short-term buffer
Disadvantages
Limited Megapixel support
Video could be stolen with camera
Cost of SD chips still high (64GB = $140.00)

40. Video Storage Optimization

41. Storage Optimization Camera / signal strength & quality
- Low S/N ratio = high storage & bandwidth
Codec / compression technology
Rules based recording
- Analytics, motion, event, schedule etc.
Dual streaming
Data aging (pruning)

42. NVR w/ internal storage
Storage Optimization
Dual streaming model
Dual streaming
cameras
LAN
LAN
Ethernet Switch
NVR w/ external storage
(180 1ips)
NVR w/ internal storage
(30 15ips)
RAID

43. Video Aging What is it??? Advantages Cost (equip, power, real estate)
Pruning
Recompression
Lifecycle management
Advantages
Cost (equip, power, real estate)
Disadvantages
Loss of quality (frame rate and/or resolution)
Discarding Data

44. Thank you for your input!
Conclusion
Storage remains at the core of Video Surveillance
Emerging technologies offer potential savings
You will be required to learn new terms and
Vicon has Enterprise Class storage solutions
We’re working hard to keep up with Tech trends
Thank you for your input!

45. Thank YOU!