Software Integration for Applications with Audio Stream Intelligent Information Hiding and Multimedia Signal Processing, International Conference on Aug. 2008,pp Advisor : Lian-Jou Tsai Student : Bing-Fen Huang PPT Production : 100% Data : 2011/12/21

Outline Abstract Introduction Software integration through wrapper Wrapper for stream-based multimedia applications An example Conclusion 2

Abstract We have successfully intercepting/redirecting the data : Files Characters Audio data are a huge number of multimedia applications today. Try to build a wrapper module that redirects the audio data. 3

Introduction(1/2) Commercial Off-The-Shelf (COTS) For integrating MS-Windows COTS applications into software systems : I/O interception/redirection techniques A programmable interfaces Message queue and clipboard space techniques. MS-Windows application GUIs 4

The approach can handle only input/output data in forms of files and character strings. The video/audio streams are not able to be dealt with. In order to successfully integrate stream-based applications, some issues must be considered : Input and output data Data stream synchronization Introduction(2/2) 5

Software integration through wrapper(1/2) The Windows applications are firstly encapsulated by a wrapper program. Hides the operation details A programmable interface(COTS) Responsible to convert the requests Gets the output results Windows applications can exchange data simply through the Windows Clipboard mechanism. 6

Interception and redirection through a Wrapper Software integration through wrapper(2/2) 7

multimedia applications (1/6) ALSA (Advanced Linux Sound Architecture) is a popular sound driver/subsystem in Linux 2.6. In ALSA modules, the playback and capture functions are already included in its PCM (Pulse Code Modulation) component. Wrapper for stream-based 8

multimedia applications (2/6) Wrapper for stream-based The system structure of ALSA for Linux 9

multimedia applications (3/6) Wrapper for stream-based Working of ALSA sound driver in Linux(Output) 10

multimedia applications (4/6) Wrapper for stream-based Working of ALSA sound driver in Linux(Input) 11

multimedia applications (5/6) Wrapper for stream-based Integration between two audio applications through Wrapper 12

multimedia applications (6/6) Spinlock scheme ALSA sound modules use the function: interrupt_handle() spinlock_irq() spinunlock_irq() Wrapper for stream-based 13

An example(1/4) Voice Flight Status Information System (VFSIS) Integration Skype and ShinxIII It is composed of a database server and multiple clients distributed on the Internet. 14

An example(2/4) The system structure of VFSIS 15

An example(3/4) The command word analysis and information inquiry MySQL database Airlines Flight Code Scheduled Arrival Time Actual Arrival Time Assigned Gate Delay Status VFSIS GUI 16

An example(4/4) The server side VFSIS GUI 17

Conclusion(1/2) The gluing of stream based software applications is a critical technique in the software integration of multimedia software applications. We have successfully achieved the goal of intercepting / redirecting the audio stream data by adopting the wrapper technique. VFSIS is used to demonstrate the feasibility of our proposed approach. 18

Future works In addition to the issue of video data stream interception The synchronization issue between image and voice of the video data stream is also a critical issue. Conclusion(2/2) 19

Thank for your attention !