Mobile manipulation requires the integration of methodologies from all aspects of robotics. Instead of tackling each aspect in isolation,mobilemanipulation research exploits their interdependence to solve challenging problems. As a result, novel views of long-standing problems emerge. In this chapter, we present these emerging views in the areas of grasping, control, motion generation, learning, and perception. All of these areas must address the shared challenges of high-dimensionality, uncertainty, and task variability. The section on grasping and manipulation describes a trend towards actively leveraging contact and physical and dynamic interactions between hand, object, and environment. Research in control addresses the challenges of appropriately coupling mobility and manipulation. The field of motion generation increasingly blurs the boundaries between control and planning, leading to task-consistent motion in high-dimensional configuration spaces, even in dynamic and partially unknown environments. A key challenge of learning formobilemanipulation consists of identifying the appropriate priors, and we survey recent learning approaches to perception, grasping, motion, and manipulation. Finally, a discussion of promising methods in perception shows how concepts and methods from navigation and active perception are applied.
DART: Dense articulated real-time tracking
Author Tanner Schmidt, Richard Newcombe, Dieter Fox
Video ID : 673
This project aims to provide a unified framework for tracking arbitrary articulated models, given their geometric and kinematic structure. Our approach uses dense input data (computing an error term on every pixel) which we are able to process in real-time by leveraging the power of GPGPU programming and very efficient representation of model geometry with signed-distance functions. This approach has proven successful on a wide variety of models including human hands, human bodies, robot arms, and articulated objects.