1. Using Media and Streaming

2. Understanding the Streaming Process
Streaming Media Means?

3. Streaming Media Means
Streaming media are files that are sent in pieces by a service and played back by a client as the delivery continues.

4. live or on-demand ?
Streamed material can be live or on-demand.

5. live or on-demand
Live streaming is called progressive streaming or progressive download,
while on-demand streaming is from material that is already stored to disk.

6. Live streaming

7. On-demand streaming

8. Potential Bottleneck ?

9. In order to stream content successfully, the system requires that the network bandwidth be adequate to support the transfer of enough material to support user playback.
For cloud computing where the media files are large and the connection is a low latency WAN connection, this is a major consideration and potential bottleneck.

10. How to Decide Which Protocol ?
Protocol in use
How to Decide Which Protocol ?

11. Protocol Deciding
A digital audio or video file is partitioned into many small pieces and played back at high speed.
Depending upon the nature of the material, playing streamed material can suffer a certain amount of loss of transmitted packets, which is displayed as dropped frames or missing notes without the viewer noticing.
This difference between streamed media and transferred media is fundamental in deciding which transfer protocol to use.

12. TCP or UDP ?
For transferred media, the entire file must be transmitted with fidelity, thus TCP (Transmission Control Protocol) is the transmission protocol.
In a streamed media scenario, fidelity isn't a prerequisite, thus UDP (User Datagram Protocol) is the transmission protocol.

13. TCP or UDP ?
A number of network control protocols have been developed to stream media like Real Time Transport Control Protocol (RTCP) , Real Time Streaming Protocol (RTSP) and Real Time Transfer Protocol (RTP).
RTP and RTCP works exclusively with UDP while RTSP can be used for several different protocols.
These three are all Application layer protocol while UDP/TCP is transport layer protocol.
All streaming protocol take raw ifile and compress them and if required files also encrypted prior transmission.

14. Cloud computing in media Streaming

15. Cloud computing advantages(1)
Access to large scale storage, which enable the storage of large media files and on-demand media libraries.
Example:-
Amazon S3, Microsoft Windows Azure Blob Storage, Nirvanix, EMC Atmos Online, Mezo, Google Storage for Developers. Rackspace CloudFiles, and Eucalyptus are examples of some of the large cloud storage systems available to content providers.

16. Cloud computing advantages(2)
Access to scalable compute engines and network storage that can serve as the streaming server to large audiences. .

17. Cloud computing advantages(3)
• Access to a scalable compute engines that can be useful when you want to perform encoding/decoding or transcoding on media files. Example:- The company Encoding.com is an example of a transcoding service where you can use an Adobe AIR application to drag and drop files that are encoded right to your desktop. Ex. AVI to WMV encoding

18. Cloud computing advantages(4)
• Access to content delivery networks or edge systems that can push content out to users based on geographical location.

19. Audio streaming
Audio streaming makes much lower demands on network bandwidth than video streaming does. An audio file is roughly 500 times smaller than a correspondingly long video file.
Therefore, the first streaming services that appeared even before broadband became widely available were audio streaming services.
An early entrant into this area was Real Networks' Real Player technology and its associated protocol suite. There was a time when many content providers required you to use RealAudio technology and the RealPlayer media player.
Two other competing formats appeared that have gotten general acceptance: Windows Media Player and Apple QuickTime. These players play video formats as well as audio formats, and all are available as stand-alone players or as browser plug-ins. But trend has been shifted from proprietary formats to standard formats. Today MP3 is King.

20. Audio streaming

21. RTP RTP (Real-time Transport Protocol)
The aim of RTP is to provide a uniform means of transmitting data subject to real time constraints over IP (audio, video, etc.).
More generally, RTP makes it possible to:
identify the type of information carried,
add temporary markers and sequence numbers to the information carried,
monitor the packets' arrival at the destination.
In addition, RTP may be conveyed by multicast packets in order to route conversations to multiple recipients.

22. RTCP & RTSP RTCP (Real-time Transport Control Protocol)
RTCP protocol is based on periodic transmissions of control packets by all participants in the session.
It is a control protocol for RTP flow, making it possible to convey basic information on the participants of a session and the quality of service.
The Real Time Streaming Protocol (RTSP) is a network control protocol designed for use in entertainment and communications systems to control streaming media servers. The protocol is used for establishing and controlling media sessions between end points.

23. Working with VOIP applications
Voice over IP or VoIP is a set of communication protocols for delivering voice over the Internet.
Some of these services have been migrated to the cloud, particularly those services that require the involvement of large number of servers.
VoIP uses additional protocols and standards other than audio streaming; these are the most commonly used VoIP standards: • H.323 • IP Multimedia Subsystem (IMS) • Media Gateway Control Protocol (MGCP) • Session Initiation Protocol (SIP) • Real-time Transport Protocol (RTP) • Session Description Protocol (SDP)
Examples:-
Skype
Google voice and Google talk

25. Skype Skype protocol is proprietary (Closed-Source) and peer to peer
Depending upon the client Skype Supports
Instant Messaging
Voice Telephony
File Transfers
Group Chats
Video Conferencing

26. Google Talk
VoIP combined with Instant Messaging

27. Google Voice

28. Video Streaming
Video streaming over the Internet has become one of the major broadcast transmission media in a rather short time.
Many trends have come together to help make this transition a reality, including broadband networks, high-capacity commodity disk drives, low-cost computing power, and now cloud computing.
Video streaming is one of these technologies that benefits greatly from deployment in the cloud.
Example:- YouTube, blip.TV, DailyMotion, Flickr, Yahoo Video

29. Television in cloud Television is a very important industry.
The average American watches five hours of TV a day. The number of TV watchers dwarfs the 1 billion PC users, and even the 2 billion cell phone users. Worldwide, there are 4 billion TV watchers.
As video streaming becomes even cheaper in the cloud, many TV stations have begun to put their series episodes and Movies on internet sites such as ABC.com, CBS.com, Syfy.com, Hulu.com

33. Shows that run on Hulu are interrupted every 15 minutes for a 30-second commercial.
The revenue from the advertising stream is split according to the New York Times so that percent goes to the content provider and the remainder goes to YouTube.
Hulu is also starting a new service called Hulu Plus, which (for a subscription fee of $9.99/month) offers more premium content and content served for the iPhone and iPad, your TV, and in HD format.

34. Streaming video formats
• Earlier video formats supported by Real Media to media that is embedded directly into Web pages in the form of Apple QuickTime or Windows Media. The predominant format at the moment is the platform based on Adobe Flash.
As the industry is moving more and more to the cloud, there has been a push to develop open-source video standards such as the new HTML 5 video format.
To view streaming content in HTML5 video players, you need a compatible browser and a site like YouTube that supports H.264 and WebM (VP8 codec) formats

35. Streaming video formats
Following browsers are HTML5 compatible by Youtube
• Firefox 4 (WebM) • Chrome (h.264 supported now, WebM enabled version available via Early Release Channel) • Opera (WebM) • Apple Safari (h.264, version 4+) • Microsoft Internet Explorer 9 (h.264, Platform Preview 3) • Microsoft Internet Explorer 6, 7, or 8 with Google Chrome Frame installed

36. You also can view HTML 5 content in the following media players:
• Media Player Classic ( net/) • Moovida Core ( moovida.com/) • VLC ( • Winamp ( • XBMC (
Video formats are only half of the story when it comes to video file formats. The second half of the story is the format for the streaming protocol that encodes the video file. Several of these container formats are in use. The most widely used streaming video file container format is H.264/MPEG-4 Part 10. MPEG-4 Part 10 is also known as MPEG-4 AVC, which stands for Advanced Video Coding.

37. Youtube
YouTube is the iconic flash video-sharing service now owned by Google.
Although the majority of online video is in Flash format (about 75 percent according the BBC), YouTube launched a new site in January 2010 that presents H.264 or WebM format video that can be viewed inside an HTML5 browser (and doesn't require Flash).

38. Working with Cloud-based Storage

39. Introduction The world is creating massive amounts of data.
A large percentage of that data either is already stored in the cloud, will be stored in the cloud, or will pass through the cloud during the data's lifecycle.
Cloud storage systems are among the most successful cloud computing applications in use today.
This chapter surveys the area of cloud storage systems, categorizes the different cloud storage system types, discusses file-sharing and backup software and systems

40. Lecture Outline Measuring the digital universe
Provisioning cloud storage
Creating cloud storage systems
Cloud backup solutions
Cloud storage interoperability

41. Measuring the Digital Universe
Facts of hunger for storage
An with a 1GB attachment to 3 people can generate an estimated 5 GB of stored managed data.
Only 25% of the data stored is unique, while 75% of the data stored is duplicated.
70% of the data stored in the world is user initiated., remainder is enterprise generated content.

42. Measuring the Digital Universe
Facts of hunger for storage
More than 50% of the data created everyday is the data that is automatically generated, (called shadow data/digital shadow ) especially from video cameras and surveillance photos, financial transaction event logs, performance data and so on.
However lots of shadow data does get retained having never been touched by human bieng
Much of the data produced is temporal, stored briefly and get deleted.

43. Measuring the Digital Universe
The storage giant EMC has an interest in knowing just how much data is being stored worldwide.
EMC has funded some studies over the past decade to assess the size of what it calls “The Digital Universe.”
The latest study done by IDC in predicted that by 2011 the world will store 1800 exabytes (EB) or 1.8 zettabytes (ZB) of data. By the year 2020,stored data will reach an astonishing 35ZB

44. EMC’s Digital Universe Homepage

45. Cloud Storage Data Usage in 2020
By International Data Corporation, Digital Universe, May 2010

46. Cloud Storage Definition
IaaS model
Storage accessed by Web service API
Cloudy characteristics
Network access most often through browser
On-demand provisioning
User control
SaaS model
Software package on top of cloud storage for backup, synchronization, archiving, etc.

47. Storage Devices Block storage device File storage device
Raw storage that can be partitioned to create volumes
Data is transferred in blocks
Example, hard disk, flash drives
Faster data transfers/ additional overhead on clients
File storage device
Expose its storage to client in a form of files
Example, file server, most often in the form of Network Attached Storage (NAS) devise
Slower transfers/ less overhead from clients

48. Provisioning Cloud Storage
Cloud storage may be broadly categorized into two major classes of storage:
Unmanaged Storage
Managed Storage

49. Cloud Storage Types Unmanaged storage
Unmanaged storage is presented to a user as if it is a ready-to-use disk drive. The user has little control over the nature of how the disk is used.
Preconfigured storage (limited level of mgt)
Cannot (1) format as your like, (2) install your own file system (FAT, NTFS), and (3) change drive properties (compression, encryption)
Reliable, relatively cheap, easy to work with
Ex-Application using this storage are SaaS web services

50. Cloud Storage Types Managed storage Provided as a raw disk
Managed storage involves the provisioning of raw virtualized disk and the use of that disk to support applications that use cloud-based storage
Provided as a raw disk
Can (1) format and partition the disk, (2) attach or mount the disk, and (3) make storage assets available to applications and other users
Support applications built using Web services
Ex-Application using this storage are IaaS web services

51. Unmanaged Cloud Storage
With the development of high capacity disks in mid to late 1990 a new class of Storage provider known as Storage Service Provider (SSP) appeared with intent of doing online storage
IDrive, FreeDrive, MyVirtualDrive, OmniDrive, Xdrive offered file hosting services in unmanaged storage form.
Volumes were accessible using FTP then Utility then within browsers. DropBox example of file transfer utility.
In unmanaged cloud, disk space provided to user as a sized partition.

52. Dropbox – File Transfer Utility

53. Managed Cloud Storage
User provisions storage on demand and pays using pay-as-you-go model
System appears to user as a raw disk that user must partition and format
Amazon Simple Storage Service (S3)
Rackspace Cloud
Google Storage for Developers

54. Amazon S3 and Rackspace Cloud

55. Creating Cloud Storage Systems
Concepts
Multiple copies of data are stored on multiple servers and in multiple locations
Storage virtualization software
Failover - > changing the pointers to the stored object’s location
Example
Amazon Web Service (EC2, S3) supports “failover” / load balancing ->but you must purchase these features

56. ByCast’s StorageGRID
Fig: ByCast’s StorageGRID allows you to create fault tolerant cloud storage Systems
by creating a virtualization layer between storage assets and application server

57. Evaluating Cloud Storage
Important considerations
Client self-service
Strong management capabilities
Scale up – more disks
Scale out – additional storage systems
Performance characteristics such as throughput
Block-based or file-based protocol support
Seamless maintenance and upgrades

58. Cloud Backup Solutions
Last line of defense in a strong backup routine
Backup types
Full system or image backups
Point-in-time (PIT) backups or snapshots
Incremental backups
3-2-1 Backup rule
3 copies (1 primary and 2 backups)
2 different media
1 copy should be stored offside

59. Backup Types Full System/ Image Backups
Creates a complete copy of volume including all system files, the boot record and any other data contained in the disks.
For create image backup of active system we need to stop all applications.

60. Backup Types Point in Time (PIT) or Snapshots
Referred to as incremental backup, created so often.
Lets you restore your data to a point in time and save multiple copies of any files that have been changed.

61. Cloud Backup Solutions
Last line of defense in a strong backup routine
Backup types
Full system or image backups
Point-in-time (PIT) backups or snapshots
Incremental backups
3-2-1 Backup rule
3 copies (1 primary and 2 backups)
2 different media
1 copy should be stored offside

62. Cloud Backup Features Logon authentication
High encryption of data transfers
Automated and scheduled backup
Fast backup (snapshots) after full online backup, with historical versions of a file retained
Ability to retrieve historical versions of file

63. Cloud Backup Features (2)
Multiplatform support (Win/ Mac / Linux)
Web-based management console with ease to use features such as drag and drop.
24x7 technical support
Logging and reporting of operations
Multisite storage or replication, enabling data failover

64. Cloud Attached Backup

65. CTERA sells a server referred to as Cloud Attached Storage, which is meant for the Small and Medium Business (SMB) market, branch offices, and the Small Office Home Office (SOHO) market.
The CTERA Cloud Attached Storage backup server has the attributes of a NAS (Network Attached Storage), with the added feature that after you set up which systems you want to back up, create user accounts, and set the backup options through a browser interface, the system runs automated backup copying and synchronizing of your data with cloud storage. Backed up data may be shared between users

66. Cloud Storage Interoperability
Open standards (operating-system neutral and file-system neutral)
Workgroups
Cloud Data Management Interface (CDMI) from Storage Networking Industry Association (SNIA)
Open Cloud Computing Interface (OCCI) from SNIA and Open Grid Forum (OGF)

67. References
Chapter 15 of Course Book: Cloud Computing Bible, 2011, Wiley Publishing Inc.