Continuous Media 1 Differs significantly from textual and numeric data because of two fundamental characteristics: –Real-time storage and retrieval –High.

Slides:



Advertisements
Similar presentations
CS 414 – Multimedia Systems Design Lecture 26 – Media Server (Part 2)
Advertisements

Using Hard Disks in Real-Time Systems Mark Stanovich.
I/O Management and Disk Scheduling Chapter 11. I/O Driver OS module which controls an I/O device hides the device specifics from the above layers in the.
Hierarchical Caching and Prefetching for Continuous Media Servers with Smart Disks By:Amandeep Singh Parth Kushwaha.
I/O Management and Disk Scheduling
Class-constrained Packing Problems with Application to Storage Management in Multimedia Systems Tami Tamir Department of Computer Science The Technion.
Operating Systems ECE344 Ashvin Goel ECE University of Toronto Disks and RAID.
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 28 – Media Server (Part 3) Klara Nahrstedt Spring 2009.
Multimedia Systems As Presented by: Craig Tomastik.
Chapter 20: Multimedia Systems Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 20: Multimedia Systems What is Multimedia.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition Chapter 20: Multimedia Systems.
CSE506: Operating Systems Disk Scheduling. CSE506: Operating Systems Key to Disk Performance Don’t access the disk – Whenever possible Cache contents.
CS Spring 2011 CS 414 – Multimedia Systems Design Lecture 27 – Media Server (Part 3) Klara Nahrstedt Spring 2011.
Input/Output Management and Disk Scheduling
CS-3013 & CS-502, Summer 2006 Multimedia topics (continued)1 Multimedia Topics (continued) CS-3013 & CS-502 Operating Systems.
1 Storage (cont’d) Disk scheduling Reducing seek time (cont’d) Reducing rotational latency RAIDs.
Lecture 17 I/O Optimization. Disk Organization Tracks: concentric rings around disk surface Sectors: arc of track, minimum unit of transfer Cylinder:
1 Storage and Retrieval of Multimedia Data n Disks u Track: Each disk platter consists of a number of concentric tracks u Cylinder: The set of all track.
CS 104 Introduction to Computer Science and Graphics Problems Operating Systems (4) File Management & Input/Out Systems 10/14/2008 Yang Song (Prepared.
A Novel Video Layout Strategy for Near-Video-on- Demand Servers Shenze Chen & Manu Thapar Hewlett-Packard Labs 1501 Page Mill Rd. Palo Alto, CA
A Row-Permutated Data Reorganization Algorithm for Growing Server-less VoD Systems Presented by Ho Tsz Kin.
A Server-less Architecture for Building Scalable, Reliable, and Cost-Effective Video-on-demand Systems Presented by: Raymond Leung Wai Tak Supervisor:
Secondary Storage CSCI 444/544 Operating Systems Fall 2008.
Bandwidth Allocation in a Self-Managing Multimedia File Server Vijay Sundaram and Prashant Shenoy Department of Computer Science University of Massachusetts.
Multimedia Systems (Part 2)
Multimedia Information Systems Shahram Ghandeharizadeh Computer Science Department University of Southern California.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 34 – Media Server (Part 3) Klara Nahrstedt Spring 2012.
A Server-less Architecture for Building Scalable, Reliable, and Cost-Effective Video-on-demand Systems Raymond Leung and Jack Y.B. Lee Department of Information.
MM File Management Karrie Karahlaios and Brian P. Bailey Spring 2007.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 32 – Media Server (Part 2) Klara Nahrstedt Spring 2012.
B. Prabhakaran1 Multimedia Storage & Retrieval Large sizes as well as real-time requirements of multimedia objects influence their storage and retrieval.
E0262 MIS - Multimedia Playback Systems Anandi Giridharan Electrical Communication Engineering, Indian Institute of Science, Bangalore – , India.
Topic: Disks – file system devices. Rotational Media Sector Track Cylinder Head Platter Arm Access time = seek time + rotational delay + transfer time.
MODERN OPERATING SYSTEMS Third Edition ANDREW S
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 19/20: Real-time and Multimedia Systems Inclusions from Tanenbaum,
Page 15/25/2016 CSE 40373/60373: Multimedia Systems QoS Classes  Guaranteed Service Class  QoS guarantees are provided based on deterministic and statistical.
Disk Structure Disk drives are addressed as large one- dimensional arrays of logical blocks, where the logical block is the smallest unit of transfer.
1 Multimedia Storage Issues. NUS.SOC.CS5248 OOI WEI TSANG 2 Media vs. Documents large file size write once, read many deadlines!
XE33OSA Chapter 20: Multimedia Systems. 20.2XE33OSA Silberschatz, Galvin and Gagne ©2005 Chapter 20: Multimedia Systems What is Multimedia Compression.
Multimedia Operating Systems ●File System Paradigms ●File Replacement ●Caching ●Disk.
Dr. M. Munlin Real-Time and Multimedia Systems 1 NETE0516 Operating Systems Instructor: ผ. ศ. ดร. หมัดอามีน หมัน หลิน Faculty of Information Science and.
Quality of Service Karrie Karahalios Spring 2007.
CE Operating Systems Lecture 20 Disk I/O. Overview of lecture In this lecture we will look at: Disk Structure Disk Scheduling Disk Management Swap-Space.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Multimedia Systems.
Cello A Disk Scheduling Framework for Next Generation Operating Systems – Prashant J. Shenoy and Harrick M. Vin Presented by Evan Clark September 8, 2003.
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 30 – Media Server (Part 5) Klara Nahrstedt Spring 2009.
“A cost-based admission control algorithm for digital library multimedia systems storing heterogeneous objects” – I.R. Chen & N. Verma – The Computer Journal.
Storing and Serving Multimedia. What is a Media Server? A scalable storage manager Allocates multimedia data optimally among disk resources Performs memory.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 31 – Media Server (Part 1) Klara Nahrstedt Spring 2012.
Operating System concerns for Multimedia Multimedia File Systems -Jaydeep Punde.
CS333 Intro to Operating Systems Jonathan Walpole.
NUS.SOC.CS5248 Ooi Wei Tsang 1 Course Matters. NUS.SOC.CS5248 Ooi Wei Tsang 2 Make-Up Lecture This Saturday, 23 October TR7, 1-3pm Topic: “CPU scheduling”
Multimedia Retrieval Architecture Electrical Communication Engineering, Indian Institute of Science, Bangalore – , India Multimedia Retrieval Architecture.
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 27 – Media Server (Part 2) Klara Nahrstedt Spring 2009.
Lecture 3 Secondary Storage and System Software I
Chapter 20: Multimedia Systems
Multimedia Systems Operating System Presentation On
CS 414 – Multimedia Systems Design Lecture 31 – Media Server (Part 5)
Chapter 20: Multimedia Systems
EEE Embedded Systems Design Process in Operating Systems 서강대학교 전자공학과
Disks and RAID.
A Server-less Architecture for Building Scalable, Reliable, and Cost-Effective Video-on-demand Systems Raymond Leung and Jack Y.B. Lee Department of Information.
Lecture 24: Process Scheduling Examples and for Real-time Systems
Chapter 20: Multimedia Systems
Data Orgnization Frequently accessed data on the same storage device?
Persistence: hard disk drive
Chapter 20: Multimedia Systems
Chapter 20: Multimedia Systems
Chapter 20: Multimedia Systems
Presentation transcript:

Continuous Media 1 Differs significantly from textual and numeric data because of two fundamental characteristics: –Real-time storage and retrieval –High data transfer rate and large storage space

Continuous Media 2 Recording -- server continuously stores data produced by an input device to prevent buffer overruns at the device Playback -- server retrieves data from the disk at a rate that prevents an output device from starving

Single Stream Playback A sequence of periodic tasks with deadlines Tasks correspond to retrievals of media blocks from disk Deadlines correspond to the scheduled playback times Though just-in-time playback is conceivable, retrieval will be bursty Media blocks need to be buffered when retrieval gets ahead of playback

Challenge To supply stream buffers with enough data to ensure that the playback processes do not starve –buffer entire stream before initiating playback requires a large buffer and introduces lengthy latency –serve the stream periodically minimizing buffer space requirement and the initial latency

Multistream Retrieval Disk data transfer rates are significantly higher than a single stream’s playback rate Retrieval requests from several streams simultaneously Many of these streams may be accessing the same file, but different parts of the file at the same time Continuous playback requirements of ALL streams must be met Scheduling disk requests such that no individual stream starves and limiting the number of streams scheduled at a given time

Disk Scheduling Traditional algorithms -- First come, first served; Shortest seek time first; SCAN –to reduce seek time and rotational latencies, to achieve high throughput, to provide fair access Real-time scheduling of tasks with deadlines -- EDF –schedules the media block with the earliest deadline excessive seek time and rotational latency and poor server resource utilization

Disk Scheduling for CM Data SCAN-EDF -- serves the requests with earliest deadline first, but when several requests have the same deadline, their respective blocks are accessed with the SCAN algorithm To improve the effectiveness of SCAN-EDF, increase the number of requests with the same deadline, for example one can enforce that all requests have deadlines that are multiples of a period

Round Scheduling for CM Data Process requests in rounds to exploit the nature of CM playback Each round still requires a disk scheduling algorithm Round-robin -- request order within a round is fixed and maximum latency between successive retrieval times is bounded by a round’s duration SCAN -- request order depends on data placement and maximum latency between successive retrieval times is bounded by twice the round’s duration

Round Length and Latency Trade-offs Round-robin -- initial latency shorter but round lengths are longer SCAN -- initial latency longer but round lengths are shorter Grouped Sweeping Scheme (GSS) –partitions each round into groups –groups are served in fixed order –SCAN is used within each group

Production versus Consumption During a round, the amount of data retrieved for a stream is at least equal to the amount consumed by the stream’s playback Data production never lags behind consumption (buffer conserving property) Buffer conservation as a sufficient condition for preventing starvation Maximum duration of a round, maximum consumption rate, same number of media blocks or proportional number of media blocks

Admission Control In admitting new streams, a multimedia server employs admission control tests to determine whether a new stream can be served without affecting the playback requirements of the streams that are already in service Deterministic -- worst case scenarios and all deadlines are guaranteed to be met Statistical -- Deadlines are guaranteed to be met with a certain probability Background (or Best-effort) -- No guarantees are given and are served only if there is excess available capacity

Data Placement Retrieval Blocks Contiguous Placement –a single seek is enough (but fragmentation is problem) Scattered Placement –many intrafile seeks (can be alleviated using large block sizes and to read one block in each round) Constrained Placement –intrafile seeks may be unavoidable if multiple blocks are needed in each round –reduce the seeks to a reasonable bound by bounding the separation of successive blocks

Data Striping and Data Interleaving RAID Scheme -- data is striped across each disk –achieves intrafile and interfile parallelism Disk arrays are a good solution to the high bandwidth requirements of multimedia services Data interleaving allows blocks of a media file to be stored on different disks as successive file blocks

Multimedia File Systems File system oriented –multimedia object as a large file and typical file system operations such as open, close, read are supported Stream oriented –multimedia data continuously “streamed” to the client with operations such as play, pause, resume supported File retrieval structures -- linked lists, FAT, indexes