Signal processing techniques in multimedia systems: concept and principle of multimedia systems; speech analysis and recognition; audio/image/video compression; scene video analysis & understanding; multimedia applications such as human computer interaction, multimedia communication and multimedia security. Pre: 2704 (C-) or better. (3H, 3C).
There is no doubt that multimedia has become an essential element in all aspects of society. The amount of multimedia that has been generated and stored, and which continues to do so at an exponential rate, has already become unfathomable. Much research has focused on the problem of how to efficiently store, transmit, search and retrieve digital multimedia contents including audio, image and video. Signal processing is a key technology to enable compressing, representing and indexing multimedia contents. This course covers the theory and techniques of signal processing and their application to multimedia systems. The topics include multimedia systems, speech analysis and recognition, audio/image/video compression, video communication and multimedia security. The primary goal of this course is to help students gain experience in the design and implementation of signal processing techniques for multimedia applications.
Percentage of Course
|1. Introduction to Multimedia Systems & Multimedia Signal Processing||10%|
|2. Speech Processing & Recognition Speech analysis, synthesis, recognition and speech-enabled human-computer interface||20%|
|3. Audio Compression Techniques: Linear predictive coding (LPC), code-excited linear prediction (CELP), multiband excitation linear prediction (MELP)||10%|
|4. Image Processing & Digital Photography Color coordinates, visual perception, image enhancement and filtering, and digital photography||10%|
|5. Image Compression Techniques: Predictive coding, discrete cosine transform, and subband coding||10%|
|6. Software design using functions, classes, and application Video capturing, motion estimation/compensation, content-based indexing and database, and scene change detection||20%|
|7. Video Compression Techniques: Video compression standards: MPEG-1/2, H261/H263, and MPEG-4/7||10%|
|8. Multimedia applications: Human-computer interaction Multimedia Retrieval Multimedia security||10%|