Introduction

Operating

system is the layer between hardware and the applications Operating system provide the environment for executing programs and various services regarding
CPU Main Memory File system Input and output devices Networking deviceIntroduction

Multimedia applications demand the human perception of the media in a error free way An audio application will involve
I/O devices: microphone, speakerphone CPU: processing the data Memory: temporarily store the data Network: real-time transmission of the data
The

key to the Multimedia OS is the realtime processing of the continuous data

Department of Computer Engineering University of California at Santa Cruz

Multimedia OS
CPU

management: appropriate scheduling is necessary Memory management: guaranteed timing delay and buffer management File system: guarantee continuous retrieval of multimedia data To guarantee real-time processing of the media data, one concept used is resource reservation. The resource is reserved prior to the execution of the application. This has to be performed for all components along the data path of a multimedia application
Department of Computer Engineering University of California at Santa Cruz

Real-Time Multimedia OS
A

real-time process is a process which delivers the results

of the processing in a given time-span. The system continuously

Receiving information from the environment Processing Deliver to the environment
The

correctness of a real-time system 1: Chemical plant

The correctness in the results The correctness in timing

Example

Receive measurement from the furnace (temperature, oxygen %) Compute the adjustment Send the adjustment to execution
Department of Computer Engineering University of California at Santa Cruz

Real-Time Multimedia OS
Example

2: Video Playback

Read data from DVD Decoding and formatting Send it to frame buffer Timing is everything
Timing

constraints can be

External restrictions Chemical plant example, min time-span to response Internal restrictions Video or audio playback, constant framerate

 Deadline

The latest acceptable time for the presentation of the processing results Soft deadline: if violated does not result in unacceptable results Hard deadline: should never be violated

Department of Computer Engineering University of California at Santa Cruz

Characteristics of Real-time Systems

Predictably

fast response to time-critical

events and accurate timing information. Example: nuclear reactor control, the response to a malfunction must occur within a well defined period to avoid disaster High degree of schedulability the degree of resource utilization at which the deadline of each timecritical task can be taken into account Stability under transient overload

 Some

traditional real-time applications

include manufacturing and monitoring systems. New applications include multimedia system, surveillance, etc.

Department of Computer Engineering University of California at Santa Cruz

Characteristics of Multimedia OS
fault-tolerant compare to the realtime system for nuclear power plant control, the system in a video playback product will cause less damage if some errors occur Deadlines tend to be soft for example, small errors in video playback timing is not noticeable Schedulability consideration is much easier because the the media streams tend to be periodic (results of sampling) and consistent
More

 Bandwidth

requirement is not always stringent more compression or lower resolution can always be used to achieve lower bitrates
Department of Computer Engineering University of California at Santa Cruz

Resource management
Multimedia

systems with integrate audio and

video at the limit of their capacity Active resources and passive resource
Active resources: CPU or network adapter that provide service Passive resources: memory, bandwidth, file systems, system capability required by active resources
Resources

can be used exclusively by one

process or shared
Active resources: often exclusive Passive resources: often shared
Each

resource has a capacity

CPU speed, amount of space, access time, sustained transmission

Rate

Department of Computer Engineering University of California at Santa Cruz

Resource Requirements
Processing

and transmission requirement of

a multimedia (local or distributed) system can be specified according to the following characteristics
The throughput determined by the needed data rate, depending on the size of the data unit Local and global delay - Local delay the delay at the resource is the maximum time span for the completion of the task - The end-to-end delay is the time span for a data unit to be transmitted from the source to the destination The jitter determines the maximum allowed variance in the arrival data at the destination The reliability error detection and correction mechanisms used for the transmission and processing of the multimedia data

Department of Computer Engineering University of California at Santa Cruz

Components and Phases

Components

grouped for video data

transmission A negotiation process is involved in the system

Frame grabber & Encoder Compression Communication & Network Layer Data Link & Network Adapter Network Display Frame Buffer Decompression Communication & Network Layer Data Link & Network Adapter Server Client

Department of Computer Engineering University of California at Santa Cruz

Phases
Different

phases of resource management

Schedulability test check with the given QoS parameter

(throughput and reliability parameters) to determine if there is enough remaining resource available Quality of Service Calculation calculate the best possible performance (e.g. delay) the resource can guarantee Resource reservation allocate the required capacity to meet the QoS Resource scheduling scheduling algorithms for each resource
Department of Computer Engineering University of California at Santa Cruz

Allocation scheme
Reservation

of resources can be made either

in a pessimistic or optimistic way

Pessimistic approach making reservation for the worst case. E.g. longest processing time, highest bandwidth. The system is not highly utilized Optimistic approach - making reservation according to an average workload. System is highly utilized