View Chapter

Chapter 40 — Mobility and Manipulation

Oliver Brock, Jaeheung Park and Marc Toussaint

Mobile manipulation requires the integration of methodologies from all aspects of robotics. Instead of tackling each aspect in isolation,mobilemanipulation research exploits their interdependence to solve challenging problems. As a result, novel views of long-standing problems emerge. In this chapter, we present these emerging views in the areas of grasping, control, motion generation, learning, and perception. All of these areas must address the shared challenges of high-dimensionality, uncertainty, and task variability. The section on grasping and manipulation describes a trend towards actively leveraging contact and physical and dynamic interactions between hand, object, and environment. Research in control addresses the challenges of appropriately coupling mobility and manipulation. The field of motion generation increasingly blurs the boundaries between control and planning, leading to task-consistent motion in high-dimensional configuration spaces, even in dynamic and partially unknown environments. A key challenge of learning formobilemanipulation consists of identifying the appropriate priors, and we survey recent learning approaches to perception, grasping, motion, and manipulation. Finally, a discussion of promising methods in perception shows how concepts and methods from navigation and active perception are applied.

Task-consistent, obstacle avoidance for mobile manipulation

Author  Oliver Brock, Oussama Khatib, Sriram Viji

Video ID : 784

This robot can avoid moving obstacles with real-time path modification by using an elastic-strip framework. However, the real-time path modification can interfere with task execution. The proposed task-consistent, elastic planning method can ensure the task execution while achieving obstacle avoidance.

Chapter 80 — Roboethics: Social and Ethical Implications

Gianmarco Veruggio, Fiorella Operto and George Bekey

This chapter outlines the main developments of roboethics 9 years after a worldwide debate on the subject – that is, the applied ethics about ethical, legal, and societal aspects of robotics – opened up. Today, roboethics not only counts several thousands of voices on the Web, but is the issue of important literature relating to almost all robotics applications, and of hundreds of rich projects, workshops, and conferences. This increasing interest and sometimes even fierce debate expresses the perception and need of scientists, manufacturers, and users of professional guidelines and ethical indications about robotics in society.

Some of the issues presented in the chapter are well known to engineers, and less known or unknown to scholars of humanities, and vice versa. However, because the subject is transversal to many disciplines, complex, articulated, and often misrepresented, some of the fundamental concepts relating to ethics in science and technology are recalled and clarified.

A detailed taxonomy of sensitive areas is presented. It is based on a study of several years and referred to by scientists and scholars, the result of which is the Euron Roboethics Roadmap. This taxonomy identifies themost evident/urgent/sensitive ethical problems in the main applicative fields of robotics, leaving more in-depth research to further studies.

Roboethics: Prosthesis

Author  Fiorella Operto

Video ID : 774

Ethical, legal and societal issues in medical robotics. Bionic implants and prosthetics can be used to restore human capabilities and functions. Applications range from human prostheses for locomotion, manipulation, vision, sensing, and other functions: Artificial limbs (legs and arms; artificial internal organs (heart, kidney); artificial senses (eyes, ears...); human augmentation (exoskeletons). This field has an important connection with neuroscience to develop neural interfaces and sensory-motor coordination systems for the integration of these bionic devices with the human body/brain. The very distinction between restoring and enhancing is problematic in some cases insofar as interventions on the human body may have a variety of possibly unpredictable side-effects. Social and economic discrimination towards human beings may arise as a consequence of the enhanced physical and mental properties of super-human cyborgs.

Chapter 34 — Visual Servoing

François Chaumette, Seth Hutchinson and Peter Corke

This chapter introduces visual servo control, using computer vision data in the servo loop to control the motion of a robot. We first describe the basic techniques that are by now well established in the field. We give a general overview of the formulation of the visual servo control problem, and describe the two archetypal visual servo control schemes: image-based and pose-based visual servo control. We then discuss performance and stability issues that pertain to these two schemes, motivating advanced techniques. Of the many advanced techniques that have been developed, we discuss 2.5-D, hybrid, partitioned, and switched approaches. Having covered a variety of control schemes, we deal with target tracking and controlling motion directly in the joint space and extensions to under-actuated ground and aerial robots. We conclude by describing applications of visual servoing in robotics.

IBVS on a 6-DOF robot arm (2)

Author  Francois Chaumette, Seth Hutchinson, Peter Corke

Video ID : 60

This video shows an IBVS on a 6-DOF robot arm with Cartesian coordinates of image points as visual features and a current interaction matrix in the control scheme. It corresponds to the results depicted in Figure 34.3.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

A control strategy for human-friendly robots

Author   Jochen Heinzmann, Jon Kieffer, Alexander Zelinsky

Video ID : 611

The video shows the basic behavior of the system: A zero-gravity simulation with a Barrett Whole Arm Manipulator (WAM), a lightweight, 7-DOF robot driven by cable drives. The zero-G module applies the appropriate motor torques to counteract the gravity effects. The psychological impression is that the robot is completely passive although considerable forces are required for the gravity compensation. The robot is slowed down by friction only. In the second part of the video, the gravity constant is increased by 60%. This causes the robot to float up into a vertical configuration, as if the robot would be mounted upside down. (Video Proceedings of the Int. Conf. Robot. Autom. (ICRA), 1999)

Chapter 51 — Modeling and Control of Underwater Robots

Gianluca Antonelli, Thor I. Fossen and Dana R. Yoerger

This chapter deals with modeling and control of underwater robots. First, a brief introduction showing the constantly expanding role of marine robotics in oceanic engineering is given; this section also contains some historical backgrounds. Most of the following sections strongly overlap with the corresponding chapters presented in this handbook; hence, to avoid useless repetitions, only those aspects peculiar to the underwater environment are discussed, assuming that the reader is already familiar with concepts such as fault detection systems when discussing the corresponding underwater implementation. Themodeling section is presented by focusing on a coefficient-based approach capturing the most relevant underwater dynamic effects. Two sections dealing with the description of the sensor and the actuating systems are then given. Autonomous underwater vehicles require the implementation of mission control system as well as guidance and control algorithms. Underwater localization is also discussed. Underwater manipulation is then briefly approached. Fault detection and fault tolerance, together with the coordination control of multiple underwater vehicles, conclude the theoretical part of the chapter. Two final sections, reporting some successful applications and discussing future perspectives, conclude the chapter. The reader is referred to Chap. 25 for the design issues.

Adaptive L1 depth control of a ROV

Author  Divine Maalouf, Vincent Creuze, Ahmed Chemori

Video ID : 267

This video illustrates the ability of the L1 adaptive controller to deal with parameter changes (buoyancy) and to reject disturbances (impacts, tether movements, etc.). This controller is implemented on a modified version of the AC-ROV underwater vehicle to perform depth regulation. This work was conducted at LIRMM (University Montpellier 2 / CNRS) in collaboration with Tecnalia France.

Chapter 26 — Flying Robots

Stefan Leutenegger, Christoph Hürzeler, Amanda K. Stowers, Kostas Alexis, Markus W. Achtelik, David Lentink, Paul Y. Oh and Roland Siegwart

Unmanned aircraft systems (UASs) have drawn increasing attention recently, owing to advancements in related research, technology, and applications. While having been deployed successfully in military scenarios for decades, civil use cases have lately been tackled by the robotics research community.

This chapter overviews the core elements of this highly interdisciplinary field; the reader is guided through the design process of aerial robots for various applications starting with a qualitative characterization of different types of UAS. Design and modeling are closely related, forming a typically iterative process of drafting and analyzing the related properties. Therefore, we overview aerodynamics and dynamics, as well as their application to fixed-wing, rotary-wing, and flapping-wing UAS, including related analytical tools and practical guidelines. Respecting use-case-specific requirements and core autonomous robot demands, we finally provide guidelines to related system integration challenges.

Robots that fly ... and cooperate

Author  Vijay Kumar

Video ID : 695

In his lab at Penn, Vijay Kumar and his team build flying quadrotors, small, agile robots that swarm, sense each other and form ad hoc teams -- for construction, surveying disasters and far more.

The astounding athletic power of quadcopters

Author  Raffaello D'Andrea

Video ID : 694

In a robot lab at TEDGlobal, Raffaello D'Andrea demonstrates his flying quadcopters: Robots that think like athletes, solving physical problems with algorithms that help them learn. In a series of nifty demos, D'Andrea works with drones that play catch, balance and make decisions together -- and watch out for an I-want-this-now demo of Kinect-controlled quads.

Chapter 43 — Telerobotics

Günter Niemeyer, Carsten Preusche, Stefano Stramigioli and Dongjun Lee

In this chapter we present an overview of the field of telerobotics with a focus on control aspects. To acknowledge some of the earliest contributions and motivations the field has provided to robotics in general, we begin with a brief historical perspective and discuss some of the challenging applications. Then, after introducing and classifying the various system architectures and control strategies, we emphasize bilateral control and force feedback. This particular area has seen intense research work in the pursuit of telepresence. We also examine some of the emerging efforts, extending telerobotic concepts to unconventional systems and applications. Finally,we suggest some further reading for a closer engagement with the field.

Bilateral teleoperation of multiple quadrotors with time-varying topology

Author  Antonio Franchi, Paolo Robuffo Giordano

Video ID : 73

This video shows the bilateral teleoperation of a group of four quadrotors UAVs navigating in a cluttered environment. The human operator provides velocity-level, motion commands and receives force-feedback information on the UAV interaction with the environment (e.g., presence of obstacles, external disturbances). The coordination within the group is achieved via a fully decentralized control scheme.

Chapter 72 — Social Robotics

Cynthia Breazeal, Kerstin Dautenhahn and Takayuki Kanda

This chapter surveys some of the principal research trends in Social Robotics and its application to human–robot interaction (HRI). Social (or Sociable) robots are designed to interact with people in a natural, interpersonal manner – often to achieve positive outcomes in diverse applications such as education, health, quality of life, entertainment, communication, and tasks requiring collaborative teamwork. The long-term goal of creating social robots that are competent and capable partners for people is quite a challenging task. They will need to be able to communicate naturally with people using both verbal and nonverbal signals. They will need to engage us not only on a cognitive level, but on an emotional level as well in order to provide effective social and task-related support to people. They will need a wide range of socialcognitive skills and a theory of other minds to understand human behavior, and to be intuitively understood by people. A deep understanding of human intelligence and behavior across multiple dimensions (i. e., cognitive, affective, physical, social, etc.) is necessary in order to design robots that can successfully play a beneficial role in the daily lives of people. This requires a multidisciplinary approach where the design of social robot technologies and methodologies are informed by robotics, artificial intelligence, psychology, neuroscience, human factors, design, anthropology, and more.

Visual communicative nonverbal behaviors of the Sunflower robot

Author  Kerstin Dautenhahn

Video ID : 219

The video illustrates the experiments as described in Koay et. al (2013). The Sunflower robot, developed by Kheng Lee Koay at the University of Hertfordshire, is a non-humanoid robot, using communicative signals inspired by dog-human interaction. The biological behaviors had been abstracted and translated to the specific robot embodiment. The results show that the robot is able to communicate its intention to a person and encourages the participant to attend to events and locations in a home environment. The work has been part of the of the European project LIREC (

Chapter 9 — Force Control

Luigi Villani and Joris De Schutter

A fundamental requirement for the success of a manipulation task is the capability to handle the physical contact between a robot and the environment. Pure motion control turns out to be inadequate because the unavoidable modeling errors and uncertainties may cause a rise of the contact force, ultimately leading to an unstable behavior during the interaction, especially in the presence of rigid environments. Force feedback and force control becomes mandatory to achieve a robust and versatile behavior of a robotic system in poorly structured environments as well as safe and dependable operation in the presence of humans. This chapter starts from the analysis of indirect force control strategies, conceived to keep the contact forces limited by ensuring a suitable compliant behavior to the end effector, without requiring an accurate model of the environment. Then the problem of interaction tasks modeling is analyzed, considering both the case of a rigid environment and the case of a compliant environment. For the specification of an interaction task, natural constraints set by the task geometry and artificial constraints set by the control strategy are established, with respect to suitable task frames. This formulation is the essential premise to the synthesis of hybrid force/motion control schemes.

Experiments of spatial impedance control

Author  Fabrizio Caccavale, Ciro Natale, Bruno Siciliano, Luigi Villani

Video ID : 686

The videod results of an experimental study of impedance control schemes for a robot manipulator in contact with the environment are presented. Six-DOF interaction tasks are considered that require the implementation of a spatial impedance described in terms of both its translational and its rotational parts. Two representations of end-effector orientation are adopted, namely, Euler angles and quaternions, and the implications for the choice of different orientation displacements are discussed. The controllers are tested on an industrial robot with open-control architecture in a number of case studies. This work was published in A. Casals, A.T. de Almeida (Eds.): Experimental Robotics V, Lect. Note. Control Inform. Sci. 232 (Springer, Berlin, Heidelberg 1998)