View Chapter

Chapter 72 — Social Robotics

Cynthia Breazeal, Kerstin Dautenhahn and Takayuki Kanda

This chapter surveys some of the principal research trends in Social Robotics and its application to human–robot interaction (HRI). Social (or Sociable) robots are designed to interact with people in a natural, interpersonal manner – often to achieve positive outcomes in diverse applications such as education, health, quality of life, entertainment, communication, and tasks requiring collaborative teamwork. The long-term goal of creating social robots that are competent and capable partners for people is quite a challenging task. They will need to be able to communicate naturally with people using both verbal and nonverbal signals. They will need to engage us not only on a cognitive level, but on an emotional level as well in order to provide effective social and task-related support to people. They will need a wide range of socialcognitive skills and a theory of other minds to understand human behavior, and to be intuitively understood by people. A deep understanding of human intelligence and behavior across multiple dimensions (i. e., cognitive, affective, physical, social, etc.) is necessary in order to design robots that can successfully play a beneficial role in the daily lives of people. This requires a multidisciplinary approach where the design of social robot technologies and methodologies are informed by robotics, artificial intelligence, psychology, neuroscience, human factors, design, anthropology, and more.

A robot that approaches pedestrians

Author  Takayuki Kanda

Video ID : 258

This video illustrates an example of a study in which the social robot's capability for nonverbal interaction was developed. In the study, an anticipation technique was developed, where the robot observes pedestrians' motions and anticipates each pedestrian's future motions thanks to the accumulation of a large amount of data on pedestrian trajectories. Then, it plans its motion to approach a pedestrian from a frontal direction and initiates a conversation with the pedestrian.

Chapter 35 — Multisensor Data Fusion

Hugh Durrant-Whyte and Thomas C. Henderson

Multisensor data fusion is the process of combining observations from a number of different sensors to provide a robust and complete description of an environment or process of interest. Data fusion finds wide application in many areas of robotics such as object recognition, environment mapping, and localization.

This chapter has three parts: methods, architectures, and applications. Most current data fusion methods employ probabilistic descriptions of observations and processes and use Bayes’ rule to combine this information. This chapter surveys the main probabilistic modeling and fusion techniques including grid-based models, Kalman filtering, and sequential Monte Carlo techniques. This chapter also briefly reviews a number of nonprobabilistic data fusion methods. Data fusion systems are often complex combinations of sensor devices, processing, and fusion algorithms. This chapter provides an overview of key principles in data fusion architectures from both a hardware and algorithmic viewpoint. The applications of data fusion are pervasive in robotics and underly the core problem of sensing, estimation, and perception. We highlight two example applications that bring out these features. The first describes a navigation or self-tracking application for an autonomous vehicle. The second describes an application in mapping and environment modeling.

The essential algorithmic tools of data fusion are reasonably well established. However, the development and use of these tools in realistic robotics applications is still developing.

Multisensor remote surface inspection

Author  S. Hayati, H. Seraji, B. Balaram, R. Volpe, B. Ivlev, G. Tharp, T. Ohm, D. Lim

Video ID : 639

Jet Propulson Lab, Pasadena, applies telerobotic inspection techniques to space platforms.

Chapter 58 — Robotics in Hazardous Applications

James Trevelyan, William R. Hamel and Sung-Chul Kang

Robotics researchers have worked hard to realize a long-awaited vision: machines that can eliminate the need for people to work in hazardous environments. Chapter 60 is framed by the vision of disaster response: search and rescue robots carrying people from burning buildings or tunneling through collapsed rock falls to reach trapped miners. In this chapter we review tangible progress towards robots that perform routine work in places too dangerous for humans. Researchers still have many challenges ahead of them but there has been remarkable progress in some areas. Hazardous environments present special challenges for the accomplishment of desired tasks depending on the nature and magnitude of the hazards. Hazards may be present in the form of radiation, toxic contamination, falling objects or potential explosions. Technology that specialized engineering companies can develop and sell without active help from researchers marks the frontier of commercial feasibility. Just inside this border lie teleoperated robots for explosive ordnance disposal (EOD) and for underwater engineering work. Even with the typical tenfold disadvantage in manipulation performance imposed by the limits of today’s telepresence and teleoperation technology, in terms of human dexterity and speed, robots often can offer a more cost-effective solution. However, most routine applications in hazardous environments still lie far beyond the feasibility frontier. Fire fighting, remediating nuclear contamination, reactor decommissioning, tunneling, underwater engineering, underground mining and clearance of landmines and unexploded ordnance still present many unsolved problems.

IED hunters

Author  James P. Trevelyan

Video ID : 572

The video shows the work of route-clearance teams in Afghanistan.   This video has been included because researchers can see plenty of examples of realistic field conditions under which explosive-ordnance clearance is being done in Afghanistan. It is essential for researchers to have an accurate appreciation of the real field conditions before considering expensive research projects. It is also essential that researchers understand how easily insurgent forces can adapt and defeat technological solutions that have cost tens of millions of dollars to develop. Read the caption below carefully and then watch the video with this in mind. Better-quality blast-protected vehicles provide the teams with more confidence to handle challenging tasks. You will also see that improvised explosive devices (IEDs) used by insurgents are typically made from the unexploded ordnance (UXO) which the demining teams are trying to remove. Between 15% (typical failure rate for high quality US-made ammunition) and 70% (old Russian-designed ammunition) fail to explode when used.   These UXOs lie in the ground in a, at best, semi-stable state, so some easily exploded accidentally at times. Insurgents collect and attempt to disarm them, then set them up with remotely operated or vehicle-triggered detonation fuses. That is why the demining teams came to be seen as legitimate targets by insurgents, because they were removing the explosive devices the insurgency needed to fight people who they regarded as legitimate enemies. Although not explicitly acknowledged in the commentary, this video also demonstrates one of the many methods used by insurgents to adapt their techniques to defeat the highly advanced technologies available to the ISAF teams. By laying multiple devices in different locations, using different triggering devices and different deployment methods, the insurgents soon learned what the ISAF teams could and could not detect.   Every blast indicated a device that was not detected in advance by the ISAF team. Every device removed by the team indicated a device that was detected. In this way, the insurgents rapidly learned how to deploy undetectable devices that maximized their destructive power.

Chapter 18 — Parallel Mechanisms

Jean-Pierre Merlet, Clément Gosselin and Tian Huang

This chapter presents an introduction to the kinematics and dynamics of parallel mechanisms, also referred to as parallel robots. As opposed to classical serial manipulators, the kinematic architecture of parallel robots includes closed-loop kinematic chains. As a consequence, their analysis differs considerably from that of their serial counterparts. This chapter aims at presenting the fundamental formulations and techniques used in their analysis.

Parallel 5R robot

Author  Ilian Bonev

Video ID : 46

This video demonstrates a planar parallel 5R robot that is designed to fully exploit its workspace.

Chapter 11 — Robots with Flexible Elements

Alessandro De Luca and Wayne J. Book

Design issues, dynamic modeling, trajectory planning, and feedback control problems are presented for robot manipulators having components with mechanical flexibility, either concentrated at the joints or distributed along the links. The chapter is divided accordingly into two main parts. Similarities or differences between the two types of flexibility are pointed out wherever appropriate.

For robots with flexible joints, the dynamic model is derived in detail by following a Lagrangian approach and possible simplified versions are discussed. The problem of computing the nominal torques that produce a desired robot motion is then solved. Regulation and trajectory tracking tasks are addressed by means of linear and nonlinear feedback control designs.

For robots with flexible links, relevant factors that lead to the consideration of distributed flexibility are analyzed. Dynamic models are presented, based on the treatment of flexibility through lumped elements, transfer matrices, or assumed modes. Several specific issues are then highlighted, including the selection of sensors, the model order used for control design, and the generation of effective commands that reduce or eliminate residual vibrations in rest-to-rest maneuvers. Feedback control alternatives are finally discussed.

In each of the two parts of this chapter, a section is devoted to the illustration of the original references and to further readings on the subject.

State feedback response to impulse in presence of link flexibility

Author  Wayne Book

Video ID : 781

A laboratory gantry robot with a final flexible link is excited by an external impulse disturbance. The video shows the effective damping obtained using full state feedback control with an accurately tuned estimator. The reduction in settling time compared to PID joint control is dramatic. This is one of two coordinated videos, the other showing the same experiment under PID control. Reference: B. Post: Robust State Estimation for the Control of Flexible Robotic Manipulators, Dissertation, School of Mechanical Engineering, Georgia Institute of Technology, Atlanta (2013)

Chapter 56 — Robotics in Agriculture and Forestry

Marcel Bergerman, John Billingsley, John Reid and Eldert van Henten

Robotics for agriculture and forestry (A&F) represents the ultimate application of one of our society’s latest and most advanced innovations to its most ancient and important industries. Over the course of history, mechanization and automation increased crop output several orders of magnitude, enabling a geometric growth in population and an increase in quality of life across the globe. Rapid population growth and rising incomes in developing countries, however, require ever larger amounts of A&F output. This chapter addresses robotics for A&F in the form of case studies where robotics is being successfully applied to solve well-identified problems. With respect to plant crops, the focus is on the in-field or in-farm tasks necessary to guarantee a quality crop and, generally speaking, end at harvest time. In the livestock domain, the focus is on breeding and nurturing, exploiting, harvesting, and slaughtering and processing. The chapter is organized in four main sections. The first one explains the scope, in particular, what aspects of robotics for A&F are dealt with in the chapter. The second one discusses the challenges and opportunities associated with the application of robotics to A&F. The third section is the core of the chapter, presenting twenty case studies that showcase (mostly) mature applications of robotics in various agricultural and forestry domains. The case studies are not meant to be comprehensive but instead to give the reader a general overview of how robotics has been applied to A&F in the last 10 years. The fourth section concludes the chapter with a discussion on specific improvements to current technology and paths to commercialization.

The Intelligent Autonomous Weeder

Author  Tijmen Bakker, Kees Van Asselt, Jan Bontsema, Joachim Müller, Gerrit van Straten

Video ID : 310

The Intelligent Autonomous Weeder is a four-wheel, steered, four-wheel-drive, autonomous platform which can be used for autonomous weeding operations in arable farming. An RTK DGPS system is used for navigation. The control architecture is based on a hybrid deliberative and behavior-based reactive approach.

Chapter 11 — Robots with Flexible Elements

Alessandro De Luca and Wayne J. Book

Design issues, dynamic modeling, trajectory planning, and feedback control problems are presented for robot manipulators having components with mechanical flexibility, either concentrated at the joints or distributed along the links. The chapter is divided accordingly into two main parts. Similarities or differences between the two types of flexibility are pointed out wherever appropriate.

For robots with flexible joints, the dynamic model is derived in detail by following a Lagrangian approach and possible simplified versions are discussed. The problem of computing the nominal torques that produce a desired robot motion is then solved. Regulation and trajectory tracking tasks are addressed by means of linear and nonlinear feedback control designs.

For robots with flexible links, relevant factors that lead to the consideration of distributed flexibility are analyzed. Dynamic models are presented, based on the treatment of flexibility through lumped elements, transfer matrices, or assumed modes. Several specific issues are then highlighted, including the selection of sensors, the model order used for control design, and the generation of effective commands that reduce or eliminate residual vibrations in rest-to-rest maneuvers. Feedback control alternatives are finally discussed.

In each of the two parts of this chapter, a section is devoted to the illustration of the original references and to further readings on the subject.

Trajectory generation and control for a KUKA IR 161/60 robot

Author  Joris De Schutter

Video ID : 770

This ICRA 1992 video shows the performance obtained with two simple modifications of a standard robot controller for a KUKA IR 161/60 industrial robot, namely improved trajectory generation and control of the first joint bases on a flexible joint model. At very high velocities and accelerations, there is a significant difference between the flexible controller and a classical PID controller. A nonlinear flexible controller implemented for links 2 and 3 improves the static and dynamic accuracy of the robot. Reference: J. Swevers, D. Torfs, M. Adams, J. De Schutter, H. Van Brussel: Comparison of control algorithms for flexible joint robots implemented on a Kuka IR 161/60 industrial robot, 5th Int. Conf. Adv. Robot., Pisa (1991), pp. 120-125; doi: 10.1109/ICAR.1991.240465

Chapter 58 — Robotics in Hazardous Applications

James Trevelyan, William R. Hamel and Sung-Chul Kang

Robotics researchers have worked hard to realize a long-awaited vision: machines that can eliminate the need for people to work in hazardous environments. Chapter 60 is framed by the vision of disaster response: search and rescue robots carrying people from burning buildings or tunneling through collapsed rock falls to reach trapped miners. In this chapter we review tangible progress towards robots that perform routine work in places too dangerous for humans. Researchers still have many challenges ahead of them but there has been remarkable progress in some areas. Hazardous environments present special challenges for the accomplishment of desired tasks depending on the nature and magnitude of the hazards. Hazards may be present in the form of radiation, toxic contamination, falling objects or potential explosions. Technology that specialized engineering companies can develop and sell without active help from researchers marks the frontier of commercial feasibility. Just inside this border lie teleoperated robots for explosive ordnance disposal (EOD) and for underwater engineering work. Even with the typical tenfold disadvantage in manipulation performance imposed by the limits of today’s telepresence and teleoperation technology, in terms of human dexterity and speed, robots often can offer a more cost-effective solution. However, most routine applications in hazardous environments still lie far beyond the feasibility frontier. Fire fighting, remediating nuclear contamination, reactor decommissioning, tunneling, underwater engineering, underground mining and clearance of landmines and unexploded ordnance still present many unsolved problems.

Bozena 5 remotely-operated robot vehicle

Author  James P. Trevelyan

Video ID : 574

This is an example of several videos available on YouTube showing this Slovak-designed and -constructed machine. It shows the vehicle being used in different test areas with brief glimpses of other mine-resistant vehicles. BOZENA 5 was designed to support mine-clearance teams operating in Croatia, Serbia and Bosnia Herzegovina, removing mines left over from the civil war in the 1990s. In the areas affected by mines, one of the biggest challenges is the rapid growth of vegetation during the summer months. Bare ground can be submerged in vegetation over 1 m high after just two or three weeks. Military defensive positions were often set up on uneven ground with steep slopes which were then mined to deter attacks from other parties in the conflict. Mines were also removed from these defensive minefields and re-laid along routes used for smuggling goods and people. The smugglers would be able to charge higher prices because only they knew how to safely move along the routes. The smuggling routes (and their parent organizations) persisted long after the end of the formal conflict, complicating mine-clearance operations. That is why small, remote control vehicles like this proved to be so effective. They were highly manoeuvrable, easily transported, adaptable with different tools and equipment, and could be safely operated. The machine comes with an armored operator cabin and the whole system can be packed and deployed from a 40-foot shipping container weighing 16 tons. The greatest threat to the de-miners was from bounding fragmentation mines which typically had a lethal radius of several hundred meters. These vehicles provided a means to operate safely in areas affected by these mines. One of the major disadvantages of these machines is the destruction of surface vegetation that can lead to rapid erosion, if there is heavy rain in the weeks following mine clearance operations. Sudden heavy downpours are common in summer months. Therefore, they had to be used with considerable discretion and local knowledge.

Chapter 44 — Networked Robots

Dezhen Song, Ken Goldberg and Nak-Young Chong

As of 2013, almost all robots have access to computer networks that offer extensive computing, memory, and other resources that can dramatically improve performance. The underlying enabling framework is the focus of this chapter: networked robots. Networked robots trace their origin to telerobots or remotely controlled robots. Telerobots are widely used to explore undersea terrains and outer space, to defuse bombs and to clean up hazardous waste. Until 1994, telerobots were accessible only to trained and trusted experts through dedicated communication channels. This chapter will describe relevant network technology, the history of networked robots as it evolves from teleoperation to cloud robotics, properties of networked robots, how to build a networked robot, example systems. Later in the chapter, we focus on the recent progress on cloud robotics, and topics for future research.

A multi-operator, multi-robot teleoperation system

Author  Nak Young Chong

Video ID : 84

A multi-operator, multi-robot teleoperation system for collaborative maintenance operations: Video Proc. of ICRA 2001. Over the past decades, problems and notable results have been reported mainly in the single-operator single-robot (SOSR) teleoperation system. Recently, the need for cooperation has rapidly emerged in many possible applications such as plant maintenance, construction, and surgery, and considerable efforts have therefore been made toward the coordinated control of multi-operator, multi-robot (MOMR) teleoperation. We have developed coordinated control technologies for multi-telerobot cooperation in a common environment remotely controlled from multiple operators physically distant from each other. To overcome the operators' delayed visual perception arising from network throughput limitations, we have suggested several coordinated control aids at the local operator site. Operators control their master to get their telerobot to cooperate with the counterpart telerobot using the predictive simulator, as well as video image feedback. This video explains the details of the testbed and investigates the use of an online predictive simulator to assist the operator in coping with time delay.

Chapter 8 — Motion Control

Wan Kyun Chung, Li-Chen Fu and Torsten Kröger

This chapter will focus on the motion control of robotic rigid manipulators. In other words, this chapter does not treat themotion control ofmobile robots, flexible manipulators, and manipulators with elastic joints. The main challenge in the motion control problem of rigid manipulators is the complexity of their dynamics and uncertainties. The former results from nonlinearity and coupling in the robot manipulators. The latter is twofold: structured and unstructured. Structured uncertainty means imprecise knowledge of the dynamic parameters and will be touched upon in this chapter, whereas unstructured uncertainty results from joint and link flexibility, actuator dynamics, friction, sensor noise, and unknown environment dynamics, and will be treated in other chapters. In this chapter, we begin with an introduction to motion control of robot manipulators from a fundamental viewpoint, followed by a survey and brief review of the relevant advanced materials. Specifically, the dynamic model and useful properties of robot manipulators are recalled in Sect. 8.1. The joint and operational space control approaches, two different viewpoints on control of robot manipulators, are compared in Sect. 8.2. Independent joint control and proportional– integral–derivative (PID) control, widely adopted in the field of industrial robots, are presented in Sects. 8.3 and 8.4, respectively. Tracking control, based on feedback linearization, is introduced in Sect. 8.5. The computed-torque control and its variants are described in Sect. 8.6. Adaptive control is introduced in Sect. 8.7 to solve the problem of structural uncertainty, whereas the optimality and robustness issues are covered in Sect. 8.8. To compute suitable set point signals as input values for these motion controllers, Sect. 8.9 introduces reference trajectory planning concepts. Since most controllers of robotmanipulators are implemented by using microprocessors, the issues of digital implementation are discussed in Sect. 8.10. Finally, learning control, one popular approach to intelligent control, is illustrated in Sect. 8.11.

JediBot - Experiments in human-robot sword-fighting

Author  Torsten Kröger, Ken Oslund, Tim Jenkins, Dan Torczynski, Nicholas Hippenmeyer, Radu Bogdan Rusu, Oussama Khatib

Video ID : 759

Real-world sword-fighting between human opponents requires extreme agility, fast reaction time and dynamic perception capabilities. This video shows experimental results achieved with a 3-D vision system and a highly reactive control architecture which allowfs a robot to sword fight against human opponents. An online trajectory generator is used as an intermediate layer between low-level trajectory-following controllers and high-level visual perception. This architecture enables robots to react nearly instantaneously to the unpredictable human motions perceived by the vision system as well as to sudden sword contacts detected by force and torque sensors. Results show how smooth and highly dynamic motions are generated on-the-fly while using the vision and force/torque sensor signals in the feedback loops of the robot-motion controller. Reference: T. Kröger, K. Oslund, T. Jenkins, D. Torczynski, N. Hippenmeyer, R. B. Rusu, O. Khatib: JediBot - Experiments in human-robot sword-fighting, Proc. Int. Symp. Exp. Robot., Québec City (2012)