Virginia Tech®home

ECE 4454 - Multimedia Signal Processing (3C)

Course Description

Signal processing techniques in multimedia systems: concept and principle of multimedia systems; speech analysis and recognition; audio/image/video compression; scene video analysis & understanding; multimedia applications such as human computer interaction, multimedia communication and multimedia security.

Why take this course?

There is no doubt that multimedia has become an essential element in all aspects of society. The amount of multimedia that has been generated and stored, and which continues to do so at an exponential rate, has already become unfathomable. Much research has focused on the problem of how to efficiently store, transmit, search and retrieve digital multimedia contents including audio, image and video. Signal processing is a key technology to enable compressing, representing and indexing multimedia contents. This course covers the theory and techniques of signal processing and their application to multimedia systems. The topics include multimedia systems, speech analysis and recognition, audio/image/video compression, video communication and multimedia security. The primary goal of this course is to help students gain experience in the design and implementation of signal processing techniques for multimedia applications.

Learning Objectives

  • Describe and apply the principles and techniques of signal processing in multimedia systems.
  • Analyze speech and audio signals using multichannel filtering techniques and cepstral analysis; compress audio signals using LPC, CELP and MELP techniques.
  • Describe basic image compression techniques; compress images with linear prediction, DCT and subband coding techniques.
  • Analyze video signals with motion estimation techniques; describe video compression standards (MPEG and H263/264).
  • Explain basic concepts of multimedia applications such as human computer interaction, multimedia retrieval and multimedia security.