View Chapter

Chapter 74 — Learning from Humans

Aude G. Billard, Sylvain Calinon and Rüdiger Dillmann

This chapter surveys the main approaches developed to date to endow robots with the ability to learn from human guidance. The field is best known as robot programming by demonstration, robot learning from/by demonstration, apprenticeship learning and imitation learning. We start with a brief historical overview of the field. We then summarize the various approaches taken to solve four main questions: when, what, who and when to imitate. We emphasize the importance of choosing well the interface and the channels used to convey the demonstrations, with an eye on interfaces providing force control and force feedback. We then review algorithmic approaches to model skills individually and as a compound and algorithms that combine learning from human guidance with reinforcement learning. We close with a look on the use of language to guide teaching and a list of open issues.

Policy refinement after demonstration

Author  Sylvain Calinon, Petar Kormushev, Darwin Caldwell

Video ID : 105

Use of stochastic optimization in the policy-parameters space to refine a skill initially learned from demonstration. Reference: S. Calinon, P. Kormushev, D.G. Caldwell: Compliant skills acquisition and multi-optima policy search with EM-based reinforcement learning, Robot. Auton. Syst. 61(4), 369–379 (2013); URL: http://vimeo.com/13387420

Chapter 9 — Force Control

Luigi Villani and Joris De Schutter

A fundamental requirement for the success of a manipulation task is the capability to handle the physical contact between a robot and the environment. Pure motion control turns out to be inadequate because the unavoidable modeling errors and uncertainties may cause a rise of the contact force, ultimately leading to an unstable behavior during the interaction, especially in the presence of rigid environments. Force feedback and force control becomes mandatory to achieve a robust and versatile behavior of a robotic system in poorly structured environments as well as safe and dependable operation in the presence of humans. This chapter starts from the analysis of indirect force control strategies, conceived to keep the contact forces limited by ensuring a suitable compliant behavior to the end effector, without requiring an accurate model of the environment. Then the problem of interaction tasks modeling is analyzed, considering both the case of a rigid environment and the case of a compliant environment. For the specification of an interaction task, natural constraints set by the task geometry and artificial constraints set by the control strategy are established, with respect to suitable task frames. This formulation is the essential premise to the synthesis of hybrid force/motion control schemes.

Recent research in impedance ontrol

Author  Unknown, Case Western Reserve University, Cleveland

Video ID : 684

Experimentacl research on impedance control done in 1991 at Case Western Reserve University in Cleveland, Ohio. The demonstrations involve three scenarios: stiffness control without force sensing; impedance control based on a wrist force sensor; and impedance control based on joint torque sensing. This work was published in the ICRA 1991 video proceedings.

Chapter 72 — Social Robotics

Cynthia Breazeal, Kerstin Dautenhahn and Takayuki Kanda

This chapter surveys some of the principal research trends in Social Robotics and its application to human–robot interaction (HRI). Social (or Sociable) robots are designed to interact with people in a natural, interpersonal manner – often to achieve positive outcomes in diverse applications such as education, health, quality of life, entertainment, communication, and tasks requiring collaborative teamwork. The long-term goal of creating social robots that are competent and capable partners for people is quite a challenging task. They will need to be able to communicate naturally with people using both verbal and nonverbal signals. They will need to engage us not only on a cognitive level, but on an emotional level as well in order to provide effective social and task-related support to people. They will need a wide range of socialcognitive skills and a theory of other minds to understand human behavior, and to be intuitively understood by people. A deep understanding of human intelligence and behavior across multiple dimensions (i. e., cognitive, affective, physical, social, etc.) is necessary in order to design robots that can successfully play a beneficial role in the daily lives of people. This requires a multidisciplinary approach where the design of social robot technologies and methodologies are informed by robotics, artificial intelligence, psychology, neuroscience, human factors, design, anthropology, and more.

Learning how to be a learning companion for children

Author  Cynthia Breazeal

Video ID : 560

This video demonstration describes a project whereby we train a policy via learning-by-demonstration for a social robot to serve as a learning companion for young children during free-form educational play. Training data was captured during a Wizard-of-Oz paradigm where the robot played the color-mixing game app with 183 children. Once the model was trained on this data, we did a human-participant study with 85 children to compare the behavior and efficacy of the autonomous robot versus a Wizard-of-Oz-controlled robot. We also compared the children's behavior to just playing the game app without a robot learning companion. We found that the presence of the robot learning companion resulted in deeper exploration of the subject matter of the app (color mixing) and more behaviors targeted to this activity (e.g., there was more random tapping of the app when the robot was not present). The autonomous robot's behavior was not statistically different from the Wizard-of-Oz-controlled robot.

Chapter 61 — Robot Surveillance and Security

Wendell H. Chun and Nikolaos Papanikolopoulos

This chapter introduces the foundation for surveillance and security robots for multiple military and civilian applications. The key environmental domains are mobile robots for ground, aerial, surface water, and underwater applications. Surveillance literallymeans to watch fromabove,while surveillance robots are used to monitor the behavior, activities, and other changing information that are gathered for the general purpose of managing, directing, or protecting one’s assets or position. In a practical sense, the term surveillance is taken to mean the act of observation from a distance, and security robots are commonly used to protect and safeguard a location, some valuable assets, or personal against danger, damage, loss, and crime. Surveillance is a proactive operation,while security robots are a defensive operation. The construction of each type of robot is similar in nature with amobility component, sensor payload, communication system, and an operator control station.

After introducing the major robot components, this chapter focuses on the various applications. More specifically, Sect. 61.3 discusses the enabling technologies of mobile robot navigation, various payload sensors used for surveillance or security applications, target detection and tracking algorithms, and the operator’s robot control console for human–machine interface (HMI). Section 61.4 presents selected research activities relevant to surveillance and security, including automatic data processing of the payload sensors, automaticmonitoring of human activities, facial recognition, and collaborative automatic target recognition (ATR). Finally, Sect. 61.5 discusses future directions in robot surveillance and security, giving some conclusions and followed by references.

Scout robot for outdoor surveillance

Author  Nikos Papanikolopoulos

Video ID : 681

The Scout robot has been developed at the University of Minnesota in partnership with MTS, Honeywell, and ATC. The Scouts are specialized robots that carry out low-level, usually parallel tasks to meet the mission objectives. Scouts can include simple sensory units or units with locomotion, tools, or other specializations. All Scouts have a similar form factor to enable delivery of the ranger by a uniform mechanism. The Scout has a body roughly 11 cm long and 4 cm in diameter (the special foam wheels can expand to 5 cm in diameter). This body fits snugly inside a protective covering called a Sabot which absorbs much of the impact during the launch and enables the Scout to break through a glass window, land safely, and be ready to begin its mission.

Chapter 76 — Evolutionary Robotics

Stefano Nolfi, Josh Bongard, Phil Husbands and Dario Floreano

Evolutionary Robotics is a method for automatically generating artificial brains and morphologies of autonomous robots. This approach is useful both for investigating the design space of robotic applications and for testing scientific hypotheses of biological mechanisms and processes. In this chapter we provide an overview of methods and results of Evolutionary Robotics with robots of different shapes, dimensions, and operation features. We consider both simulated and physical robots with special consideration to the transfer between the two worlds.

A swarm-bot of eight robots displaying coordinated motion

Author  Stefano Nolfi, Gianluca Baldassarre, Vito Trianni, Francesco Mondada, Marco Dorigo

Video ID : 115

Each robot is provided with an independent neural controller which determines the desired speed of the two wheels on the basis of the traction force caused by the movements of the other robots. The evolved robots are able to display coordinated-motion capability, independent from the way in which they are assembled, as well as to coordinate in carrying heavy objects.

Evolved homing walk on rough ground

Author  Phil Husbands

Video ID : 373

Evolved, simulated hexapod walks over rough terrain while homing on a beacon. This behavior was incrementally evolved with the controlling neural-network architecture which was expanding at each stage. Work done at Sussex University by Eric Vaughan.

Chapter 18 — Parallel Mechanisms

Jean-Pierre Merlet, Clément Gosselin and Tian Huang

This chapter presents an introduction to the kinematics and dynamics of parallel mechanisms, also referred to as parallel robots. As opposed to classical serial manipulators, the kinematic architecture of parallel robots includes closed-loop kinematic chains. As a consequence, their analysis differs considerably from that of their serial counterparts. This chapter aims at presenting the fundamental formulations and techniques used in their analysis.

IPAnema

Author  Andreas Pott

Video ID : 50

This video demonstrates a fully constrained cable-driven parallel robot with eight cables. Reference: A. Pott, H. Mütherich, W. Kraus, V. Schmidt, P. Miermeister, A. Verl: IPAnema: A family of cable-driven parallel robots for industrial applications, Mech. Mach. Sci. 12, 119-134 (2013)

Chapter 21 — Actuators for Soft Robotics

Alin Albu-Schäffer and Antonio Bicchi

Although we do not know as yet how robots of the future will look like exactly, most of us are sure that they will not resemble the heavy, bulky, rigid machines dangerously moving around in old fashioned industrial automation. There is a growing consensus, in the research community as well as in expectations from the public, that robots of the next generation will be physically compliant and adaptable machines, closely interacting with humans and moving safely, smoothly and efficiently - in other terms, robots will be soft.

This chapter discusses the design, modeling and control of actuators for the new generation of soft robots, which can replace conventional actuators in applications where rigidity is not the first and foremost concern in performance. The chapter focuses on the technology, modeling, and control of lumped parameters of soft robotics, that is, systems of discrete, interconnected, and compliant elements. Distributed parameters, snakelike and continuum soft robotics, are presented in Chap. 20, while Chap. 23 discusses in detail the biomimetic motivations that are often behind soft robotics.

Variable impedance actuators: Moving the robots of tomorrow

Author  B. Vanderborght, A. Albu-Schäffer, A. Bicchi, E. Burdet, D. Caldwell, R. Carloni, M. Catalano, Ganesh, Garabini, Grebenstein, Grioli, Haddadin, Jafari, Laffranchi, Lefeber, Petit, Stramigioli, Tsagarakis, Van Damme, Van Ham, Visser, Wolf

Video ID : 456

Most of today's robots have rigid structures and actuators requiring complex software control algorithms and sophisticated sensor systems in order to behave in a compliant and safe way adapted to contact with unknown environments and humans. By studying and constructing variable impedance actuators and their control, we contribute to the development of actuation units that can match the intrinsic safety, motion performance and energy efficiency of biological systems and, in particular, of the humans. As such, this may lead to a new generation of robots that can co-exist and co-operate with people and get closer to the human manipulation and locomotion performance than is possible with current robots.

Throwing a ball with the DLR VS-Joint

Author  Sebastian Wolf, Gerd Hirzinger

Video ID : 549

The video shows the difference between a stiff and a flexible actuator in a 1-DOF throwing demonstration. The variable stiffness actuator (VS-joint) can store potential energy in a strike out movement and release it by accelerating the lever and ball. Additional energy is transferred to the lever by stiffening up during the forward motion.

Chapter 30 — Sonar Sensing

Lindsay Kleeman and Roman Kuc

Sonar or ultrasonic sensing uses the propagation of acoustic energy at higher frequencies than normal hearing to extract information from the environment. This chapter presents the fundamentals and physics of sonar sensing for object localization, landmark measurement and classification in robotics applications. The source of sonar artifacts is explained and how they can be dealt with. Different ultrasonic transducer technologies are outlined with their main characteristics highlighted.

Sonar systems are described that range in sophistication from low-cost threshold-based ranging modules to multitransducer multipulse configurations with associated signal processing requirements capable of accurate range and bearing measurement, interference rejection, motion compensation, and target classification. Continuous-transmission frequency-modulated (CTFM) systems are introduced and their ability to improve target sensitivity in the presence of noise is discussed. Various sonar ring designs that provide rapid surrounding environmental coverage are described in conjunction with mapping results. Finally the chapter ends with a discussion of biomimetic sonar, which draws inspiration from animals such as bats and dolphins.

Sonar-guided chair at Yale

Author  Roman Kuc

Video ID : 295

Four strategically-placed Polaroid vergence sonar pairs on an electric scooter are controlled by a PIC16877 microcontroller interfaced to the joystick and the wheelchair controller. The sonar vergence pair below the foot stand determines if the obstacle is to the left or right. A sonar vergence pair on each side of the chair (at knee level) determines if the chair can pass by an obstacle without collision. A right-side-looking vergence pair maintains the distance and a parallel path to the wall. When sonar detects obstacles, the user joystick commands are overridden to avoid collision with those obstacles. The blindfolded user navigates a cluttered hallway by holding the joystick in a constant forward position.