The BRADLEY DEPARTMENT of ELECTRICAL and COMPUTER ENGINEERING

ECE 4454 Multimedia Signal Processing | ECE | Virginia Tech

Undergraduate PROGRAMS

Course Information

Description

Signal processing techniques in multimedia systems: concept and principle of multimedia systems; speech analysis and recognition; audio/image/video compression; scene video analysis & understanding; multimedia applications such as human computer interaction, multimedia communication and multimedia security. Pre: 2704 (C-) or better. (3H, 3C).

Why take this course?

There is no doubt that multimedia has become an essential element in all aspects of society. The amount of multimedia that has been generated and stored, and which continues to do so at an exponential rate, has already become unfathomable. Much research has focused on the problem of how to efficiently store, transmit, search and retrieve digital multimedia contents including audio, image and video. Signal processing is a key technology to enable compressing, representing and indexing multimedia contents. This course covers the theory and techniques of signal processing and their application to multimedia systems. The topics include multimedia systems, speech analysis and recognition, audio/image/video compression, video communication and multimedia security. The primary goal of this course is to help students gain experience in the design and implementation of signal processing techniques for multimedia applications.

Learning Objectives

  • 1. Describe and apply the principles and techniques of signal processing in multimedia systems.
  • 2. Analyze speech and audio signals using multichannel filtering techniques and cepstral analysis; compress audio signals using LPC, CELP and MELP techniques.
  • 3. Describe basic image compression techniques; compress images with linear prediction, DCT and subband coding techniques.
  • 4. Analyze video signals with motion estimation techniques; describe video compression standards (MPEG and H263/264).

Course Topics

Topic

Percentage of Course

1. Introduction to Multimedia Systems & Multimedia Signal Processing 10%
2. Speech Processing & Recognition Speech analysis, synthesis, recognition and speech-enabled human-computer interface 20%
3. Audio Compression Techniques: Linear predictive coding (LPC), code-excited linear prediction (CELP), multiband excitation linear prediction (MELP) 10%
4. Image Processing & Digital Photography Color coordinates, visual perception, image enhancement and filtering, and digital photography 10%
5. Image Compression Techniques: Predictive coding, discrete cosine transform, and subband coding 10%
6. Software design using functions, classes, and application Video capturing, motion estimation/compensation, content-based indexing and database, and scene change detection 20%
7. Video Compression Techniques: Video compression standards: MPEG-1/2, H261/H263, and MPEG-4/7 10%
8. Multimedia applications: Human-computer interaction Multimedia Retrieval Multimedia security 10%