Main menu >> Electrical and Computer Engineering >> Signal and Image Processing

Electrical and Computer Engineering

Signal and Image Processing

^ Human-Computer Interaction
T. S. Huang,* I. Cohen, A. Garg, Y. Chen, N. Petrovic, S. Chu, P. Hong, Y. Wu, J. Y. Lin, Z. Wen, Q. Liu
National Science Foundation IIS 00-85980, EIA 99-75019, and CDA 96-24396; Army Research Laboratory DAAL01-96-2-0003; National Science Foundation Alliance Program (through the National Center for Supercomputing Research)

The term "human-computer" interaction is used here in a very broad sense to include communication between persons and computers as well as communication between persons via computer. Researchers are investigating a variety of issues related to the use of computer vision and image processing in HCI, as well as the integration of vision with audio speech. Examples include human (body, arm/hand, face) motion tracking and analysis, combining speech and visual hand tracking in display control, and audio-visual speech recognition in noisy environments.

^ Image and Video Databases
T. S. Huang, X. Zhou, Q. Tian, Z. Xiong, A. Velivelli, R. Wang, Q. Cheng, M. Nakazato
Army Research Laboratory DAAL01-96-2-0003; Yamaha Motor Corporation

A number of challenging issues in image and video indexing and retrieval are being studied. Of particular interest are similarity- and example-based retrieval, the use of relevance feedback from users to improve retrieval performance, and the recognition of semantic concepts in video based on multimodal cues.

^ A Comprehensive Retargetable Embedded Systems Software Development Environment
D. L. Jones,* S. Appadwedula, D. Sachs
University of Virginia, National Science Foundation subcontract

New compiler technology and a high-performance software development environment specialized for digital signal processors are being developed. Challenging signal processing applications in wireless video communication will be used as a testbed for evaluating the performance of the new optimizing compiler technology. The new compilation and software tools will be introduced into an instructional Digital Signal Processing Laboratory course for leading-edge undergraduate education and additional evaluation.

^ Adaptive and Optimal Time-Frequency Methods for Nonstationary Signals
D. L. Jones,* M. L. Kramer, A. Rao
U.S. Office of Naval Research, N00014-95-1-0674

New adaptive and statistically optimal time-frequency analysis methods are being developed for improved processing of nonstationary signals. Included is the class of problems for which time-frequency-based detection is being characterized, and optimal kernels for detection are being derived. New adaptive time-frequency representations for high-resolution visual characterization of signals are also under development. These methods are being applied to problems in condition assessment for machinery monitoring and fault detection, mine classification, and transient detection and analysis.

^ Joint Source-Channel Matching for Wireless Multimedia Communication
D. L. Jones,* N. Shanbhag
Motorola, Inc.

Techniques for minimizing the loss in quality of broadcast video for multiple users receiving different data rates are being developed by jointly adjusting the source and channel coding for each level of service to achieve the same relative loss in performance for all levels. Methods for joint source and channel coding of image and video data to maximize the end-to-end quality of the received image over a wireless network (packet-based) communications link are also studied.

^ Unified Algorithms and Architectures for Low-Power Wireless Video
D. L. Jones,* K. Ramchandran, N. Shanbhag, L. Qian, S. Appadwedula, M. Goel, D. Sachs
National Science Foundation, MIP-9707742

Methods for joint source and channel coding of image and video data to maximize the end-to-end quality of the received image over a wireless communications link are being developed. Additional new methods minimize the total power consumption of the wireless mobile unit (including the energy used to encode/decode the data as well as the radio transmitter power) for a specified end-to-end image quality, or maximize the image quality for a specified total power consumption.


Summary of Engineering Research