View Chapter

Chapter 74 — Learning from Humans

Aude G. Billard, Sylvain Calinon and Rüdiger Dillmann

This chapter surveys the main approaches developed to date to endow robots with the ability to learn from human guidance. The field is best known as robot programming by demonstration, robot learning from/by demonstration, apprenticeship learning and imitation learning. We start with a brief historical overview of the field. We then summarize the various approaches taken to solve four main questions: when, what, who and when to imitate. We emphasize the importance of choosing well the interface and the channels used to convey the demonstrations, with an eye on interfaces providing force control and force feedback. We then review algorithmic approaches to model skills individually and as a compound and algorithms that combine learning from human guidance with reinforcement learning. We close with a look on the use of language to guide teaching and a list of open issues.

Demonstration by kinesthetic teaching

Author  Baris Akgun, Maya Cakmak, Karl Jiang, Andrea Thomaz

Video ID : 100

Demonstration by kinesthetic teaching with the Simon humanoid robot. Reference: B. Akgun, M. Cakmak, K. Jiang, A.L. Thomaz: Keyframe-based learning from demonstration, Int. J. Social Robot. 4(4), 343–355 (2012); URL: https://www.youtube.com/user/SimonTheSocialRobot .

Chapter 6 — Model Identification

John Hollerbach, Wisama Khalil and Maxime Gautier

This chapter discusses how to determine the kinematic parameters and the inertial parameters of robot manipulators. Both instances of model identification are cast into a common framework of least-squares parameter estimation, and are shown to have common numerical issues relating to the identifiability of parameters, adequacy of the measurement sets, and numerical robustness. These discussions are generic to any parameter estimation problem, and can be applied in other contexts.

For kinematic calibration, the main aim is to identify the geometric Denavit–Hartenberg (DH) parameters, although joint-based parameters relating to the sensing and transmission elements can also be identified. Endpoint sensing or endpoint constraints can provide equivalent calibration equations. By casting all calibration methods as closed-loop calibration, the calibration index categorizes methods in terms of how many equations per pose are generated.

Inertial parameters may be estimated through the execution of a trajectory while sensing one or more components of force/torque at a joint. Load estimation of a handheld object is simplest because of full mobility and full wrist force-torque sensing. For link inertial parameter estimation, restricted mobility of links nearer the base as well as sensing only the joint torque means that not all inertial parameters can be identified. Those that can be identified are those that affect joint torque, although they may appear in complicated linear combinations.

Calibration and accuracy validation of a FANUC LR Mate 200iC industrial robot

Author  Ilian Bonev

Video ID : 430

This video shows excerpts from the process of calibrating a FANUC LR Mate 200iC industrial robot using two different methods. In the first method, the position of one of three points on the robot end-effector is measured using a FARO laser tracker in 50 specially selected robot configurations (not shown in the video). Then, the robot parameters are identified. Next, the position of one of the three points on the robot's end-effector is measured using the laser tracker in 10,000 completely arbitrary robot configurations. The mean positioning error after calibration was found to be 0.156 mm, the standard deviation (std) 0.067 mm, the mean+3*std 0.356 mm, and the maximum 0.490 mm. In the second method, the complete pose (position and orientation) of the robot end-effector is measured in about 60 robot configurations using an innovative method based on Renishaw's telescoping ballbar. Then, the robot parameters are identified. Next, the position of one of the three points on the robot's end-effector is measured using the laser tracker in 10,000 completely arbitrary robot configurations. The mean position error after calibration was found to be 0.479 mm, the standard deviation (std) 0.214 mm, and the maximum 1.039 mm. However, if we limit the zone for validations, the accuracy of the robot is much better. The second calibration method is less efficient but relies on a piece of equipment that costs only $12,000 (only one tenth the cost of a laser tracker).

Chapter 74 — Learning from Humans

Aude G. Billard, Sylvain Calinon and Rüdiger Dillmann

This chapter surveys the main approaches developed to date to endow robots with the ability to learn from human guidance. The field is best known as robot programming by demonstration, robot learning from/by demonstration, apprenticeship learning and imitation learning. We start with a brief historical overview of the field. We then summarize the various approaches taken to solve four main questions: when, what, who and when to imitate. We emphasize the importance of choosing well the interface and the channels used to convey the demonstrations, with an eye on interfaces providing force control and force feedback. We then review algorithmic approaches to model skills individually and as a compound and algorithms that combine learning from human guidance with reinforcement learning. We close with a look on the use of language to guide teaching and a list of open issues.

Learning from failure I

Author  Aude Billard

Video ID : 476

This video illustrates how learning from demonstration can be bootstrapped using failed demonstrations only (in place of traditional approaches that use successful demonstrations). The algorithm is described in detail in two publications: 1)D.-H. Grollman, A. Billard: Donut as I do: Learning from failed demonstrations, Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Shanghai (2011) Best Paper Award (Cognitive Robotics); 2) D.-H. Grollman, A. Billard: Robot learning from failed demonstrations, Int. J. Social Robot. 4(4), 331-342 (2012).

Chapter 53 — Multiple Mobile Robot Systems

Lynne E. Parker, Daniela Rus and Gaurav S. Sukhatme

Within the context of multiple mobile, and networked robot systems, this chapter explores the current state of the art. After a brief introduction, we first examine architectures for multirobot cooperation, exploring the alternative approaches that have been developed. Next, we explore communications issues and their impact on multirobot teams in Sect. 53.3, followed by a discussion of networked mobile robots in Sect. 53.4. Following this we discuss swarm robot systems in Sect. 53.5 and modular robot systems in Sect. 53.6. While swarm and modular systems typically assume large numbers of homogeneous robots, other types of multirobot systems include heterogeneous robots. We therefore next discuss heterogeneity in cooperative robot teams in Sect. 53.7. Once robot teams allow for individual heterogeneity, issues of task allocation become important; Sect. 53.8 therefore discusses common approaches to task allocation. Section 53.9 discusses the challenges of multirobot learning, and some representative approaches. We outline some of the typical application domains which serve as test beds for multirobot systems research in Sect. 53.10. Finally, we conclude in Sect. 53.11 with some summary remarks and suggestions for further reading.

Robots in games and competition

Author  Jong-Hwan Kim, Byung-Kook Kim, Kui-Hong Park, Heung-Soo Kim, Sung-Ho Kim, Jong-Suk Choi

Video ID : 202

The robots play soccer without using encoders or other internal sensors. Only visual information is used as feedback. The robots have an RF communication module.

Chapter 23 — Biomimetic Robots

Kyu-Jin Cho and Robert Wood

Biomimetic robot designs attempt to translate biological principles into engineered systems, replacing more classical engineering solutions in order to achieve a function observed in the natural system. This chapter will focus on mechanism design for bio-inspired robots that replicate key principles from nature with novel engineering solutions. The challenges of biomimetic design include developing a deep understanding of the relevant natural system and translating this understanding into engineering design rules. This often entails the development of novel fabrication and actuation to realize the biomimetic design.

This chapter consists of four sections. In Sect. 23.1, we will define what biomimetic design entails, and contrast biomimetic robots with bio-inspired robots. In Sect. 23.2, we will discuss the fundamental components for developing a biomimetic robot. In Sect. 23.3, we will review detailed biomimetic designs that have been developed for canonical robot locomotion behaviors including flapping-wing flight, jumping, crawling, wall climbing, and swimming. In Sect. 23.4, we will discuss the enabling technologies for these biomimetic designs including material and fabrication.

Torque-control strategies for snake robots

Author  David Rollinson, Kalyan Vasudev Alwala, Nico Zevallos, Howie Choset

Video ID : 392

This video provides an overview of some initial torque-based motions for the series elastic snake robot (SEA Snake). Because the SEA Snake has the unique ability to accurately sense and control the torque of each of its joints, it can execute life-like compliant and adaptive motions, without a complex controller or tactile sensing.

Chapter 76 — Evolutionary Robotics

Stefano Nolfi, Josh Bongard, Phil Husbands and Dario Floreano

Evolutionary Robotics is a method for automatically generating artificial brains and morphologies of autonomous robots. This approach is useful both for investigating the design space of robotic applications and for testing scientific hypotheses of biological mechanisms and processes. In this chapter we provide an overview of methods and results of Evolutionary Robotics with robots of different shapes, dimensions, and operation features. We consider both simulated and physical robots with special consideration to the transfer between the two worlds.

Evolved group coordination

Author  Phil Husbands

Video ID : 376

Identical evolved robots are required to coordinate by coming together and moving off in the same direction. No roles are pre-assigned. The robots must evolve to coordinate such that one robot takes on the role of leader and the others follow. Only minimal sensing is available (proximity IR sensing) and no dedicated communication channels. The robot neural-network controllers are evolved using a minimal simualtion and, as can be seen, these successfully transfer to reality. Work by Matt Quinn, Giles Mayley, Linc Smith and Phil Husbands at Sussex University.

Chapter 74 — Learning from Humans

Aude G. Billard, Sylvain Calinon and Rüdiger Dillmann

This chapter surveys the main approaches developed to date to endow robots with the ability to learn from human guidance. The field is best known as robot programming by demonstration, robot learning from/by demonstration, apprenticeship learning and imitation learning. We start with a brief historical overview of the field. We then summarize the various approaches taken to solve four main questions: when, what, who and when to imitate. We emphasize the importance of choosing well the interface and the channels used to convey the demonstrations, with an eye on interfaces providing force control and force feedback. We then review algorithmic approaches to model skills individually and as a compound and algorithms that combine learning from human guidance with reinforcement learning. We close with a look on the use of language to guide teaching and a list of open issues.

Demonstration by teleoperation of humanoid HRP-2

Author  Sylvain Calinon, Paul Evrard, Elena Gribovskaya, Aude Billard, Abderrahmane Kheddar

Video ID : 101

Demonstration by teleoperation of the HRP-2 humanoid robot. Reference: S. Calinon, P. Evrard, E. Gribovskaya, A.G. Billard, A. Kheddar: Learning collaborative manipulation tasks by demonstration using a haptic interface, Proc. Intl Conf. Adv. Robot. (ICAR), (2009), pp. 1–6; URL: http://programming-by-demonstration.org/showVideo.php?video=10 .

Chapter 40 — Mobility and Manipulation

Oliver Brock, Jaeheung Park and Marc Toussaint

Mobile manipulation requires the integration of methodologies from all aspects of robotics. Instead of tackling each aspect in isolation,mobilemanipulation research exploits their interdependence to solve challenging problems. As a result, novel views of long-standing problems emerge. In this chapter, we present these emerging views in the areas of grasping, control, motion generation, learning, and perception. All of these areas must address the shared challenges of high-dimensionality, uncertainty, and task variability. The section on grasping and manipulation describes a trend towards actively leveraging contact and physical and dynamic interactions between hand, object, and environment. Research in control addresses the challenges of appropriately coupling mobility and manipulation. The field of motion generation increasingly blurs the boundaries between control and planning, leading to task-consistent motion in high-dimensional configuration spaces, even in dynamic and partially unknown environments. A key challenge of learning formobilemanipulation consists of identifying the appropriate priors, and we survey recent learning approaches to perception, grasping, motion, and manipulation. Finally, a discussion of promising methods in perception shows how concepts and methods from navigation and active perception are applied.

Task-consistent, obstacle avoidance for mobile manipulation

Author  Oliver Brock, Oussama Khatib, Sriram Viji

Video ID : 784

This robot can avoid moving obstacles with real-time path modification by using an elastic-strip framework. However, the real-time path modification can interfere with task execution. The proposed task-consistent, elastic planning method can ensure the task execution while achieving obstacle avoidance.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

Mobile robot helper - Mr. Helper

Author   Kazuhiro Kosuge, Manabu Sato, Norihide Kazamura

Video ID : 606

In this video, a mobile robot helper referred to as Mr. Helper is proposed. Mr. Helper consists of two 7-DOF manipulators and an omni-directional mobile base. The omnidirectional mobile base is the VUTON mechanism. In this system, a human and Mr. Helper communicate with each other by intentional force. That is, a human manipulates an object by applying intentional force/torque to the object. We design an impedance controller for each manipulator, so that the object manipulated by both arms has a specified impedance around a specified compliance center. Refrence: ICRA 2000 Video Abstracts.

Chapter 56 — Robotics in Agriculture and Forestry

Marcel Bergerman, John Billingsley, John Reid and Eldert van Henten

Robotics for agriculture and forestry (A&F) represents the ultimate application of one of our society’s latest and most advanced innovations to its most ancient and important industries. Over the course of history, mechanization and automation increased crop output several orders of magnitude, enabling a geometric growth in population and an increase in quality of life across the globe. Rapid population growth and rising incomes in developing countries, however, require ever larger amounts of A&F output. This chapter addresses robotics for A&F in the form of case studies where robotics is being successfully applied to solve well-identified problems. With respect to plant crops, the focus is on the in-field or in-farm tasks necessary to guarantee a quality crop and, generally speaking, end at harvest time. In the livestock domain, the focus is on breeding and nurturing, exploiting, harvesting, and slaughtering and processing. The chapter is organized in four main sections. The first one explains the scope, in particular, what aspects of robotics for A&F are dealt with in the chapter. The second one discusses the challenges and opportunities associated with the application of robotics to A&F. The third section is the core of the chapter, presenting twenty case studies that showcase (mostly) mature applications of robotics in various agricultural and forestry domains. The case studies are not meant to be comprehensive but instead to give the reader a general overview of how robotics has been applied to A&F in the last 10 years. The fourth section concludes the chapter with a discussion on specific improvements to current technology and paths to commercialization.

Ladybird: An intelligent farm robot for the vegetable industry

Author  James Underwood, Calvin Hung, Suchet Bargoti, Mark Calleija, Robert Fitch, Juan Nieto, Salah Sukkarieh

Video ID : 305

This video showcases the Ladybird, an intelligent robot for the vegetable industry. Ladybird provides a flexible platform for sensing and automating commercial vegetable farms. The solar-electric powered vehicle has a flexible drive system that allows precise motion in potentially tight environments, and the platform geometry can be configured to suit different crop configurations. The vehicle autonomously traverses the farm, gathering data from a variety of sensors, including stereo vision, hyperspectral, thermal, and LIDAR. The data is processed to provide useful information for the management and optimization of the crop, including yield mapping, phenotyping, and disease and stress detection. Ladybird is equipped with a manipulator arm for a variety of mechanical tasks, including thinning, weeding (especially of herbicide-resistant weeds), spot spraying, foreign body removal and to support research towards automated harvesting.