View Chapter

Chapter 35 — Multisensor Data Fusion

Hugh Durrant-Whyte and Thomas C. Henderson

Multisensor data fusion is the process of combining observations from a number of different sensors to provide a robust and complete description of an environment or process of interest. Data fusion finds wide application in many areas of robotics such as object recognition, environment mapping, and localization.

This chapter has three parts: methods, architectures, and applications. Most current data fusion methods employ probabilistic descriptions of observations and processes and use Bayes’ rule to combine this information. This chapter surveys the main probabilistic modeling and fusion techniques including grid-based models, Kalman filtering, and sequential Monte Carlo techniques. This chapter also briefly reviews a number of nonprobabilistic data fusion methods. Data fusion systems are often complex combinations of sensor devices, processing, and fusion algorithms. This chapter provides an overview of key principles in data fusion architectures from both a hardware and algorithmic viewpoint. The applications of data fusion are pervasive in robotics and underly the core problem of sensing, estimation, and perception. We highlight two example applications that bring out these features. The first describes a navigation or self-tracking application for an autonomous vehicle. The second describes an application in mapping and environment modeling.

The essential algorithmic tools of data fusion are reasonably well established. However, the development and use of these tools in realistic robotics applications is still developing.

AnnieWay

Author  Thomas C. Henderson

Video ID : 132

This is a video showing the multisensor autonomous vehicle merging into traffic.

Application of visual odometry for sewer-inspection robots

Author  José Saenz, Christoph Walter, Erik Schulenburg, Norbert Elkmann, Heiko Althoff

Video ID : 638

Exploits a multisensor robot (multiple cameras and range finder) to inspect pipelines.

Multisensor remote surface inspection

Author  S. Hayati, H. Seraji, B. Balaram, R. Volpe, B. Ivlev, G. Tharp, T. Ohm, D. Lim

Video ID : 639

Jet Propulson Lab, Pasadena, applies telerobotic inspection techniques to space platforms.