View Chapter

Chapter 63 — Medical Robotics and Computer-Integrated Surgery

Russell H. Taylor, Arianna Menciassi, Gabor Fichtinger, Paolo Fiorini and Paolo Dario

The growth of medical robotics since the mid- 1980s has been striking. From a few initial efforts in stereotactic brain surgery, orthopaedics, endoscopic surgery, microsurgery, and other areas, the field has expanded to include commercially marketed, clinically deployed systems, and a robust and exponentially expanding research community. This chapter will discuss some major themes and illustrate them with examples from current and past research. Further reading providing a more comprehensive review of this rapidly expanding field is suggested in Sect. 63.4.

Medical robotsmay be classified in many ways: by manipulator design (e.g., kinematics, actuation); by level of autonomy (e.g., preprogrammed versus teleoperation versus constrained cooperative control), by targeted anatomy or technique (e.g., cardiac, intravascular, percutaneous, laparoscopic, microsurgical); or intended operating environment (e.g., in-scanner, conventional operating room). In this chapter, we have chosen to focus on the role of medical robots within the context of larger computer-integrated systems including presurgical planning, intraoperative execution, and postoperative assessment and follow-up.

First, we introduce basic concepts of computerintegrated surgery, discuss critical factors affecting the eventual deployment and acceptance of medical robots, and introduce the basic system paradigms of surgical computer-assisted planning, execution, monitoring, and assessment (surgical CAD/CAM) and surgical assistance. In subsequent sections, we provide an overview of the technology ofmedical robot systems and discuss examples of our basic system paradigms, with brief additional discussion topics of remote telesurgery and robotic surgical simulators. We conclude with some thoughts on future research directions and provide suggested further reading.

Variable stiffness manipulator based on layer jamming

Author  MIT/Samsung

Video ID : 832

A tubular, variable-stiffness structure designed for establishing a guide channel for single-port surgery. The thin-layered materials enables jamming stiffness more effectively in a very limited space.

Chapter 9 — Force Control

Luigi Villani and Joris De Schutter

A fundamental requirement for the success of a manipulation task is the capability to handle the physical contact between a robot and the environment. Pure motion control turns out to be inadequate because the unavoidable modeling errors and uncertainties may cause a rise of the contact force, ultimately leading to an unstable behavior during the interaction, especially in the presence of rigid environments. Force feedback and force control becomes mandatory to achieve a robust and versatile behavior of a robotic system in poorly structured environments as well as safe and dependable operation in the presence of humans. This chapter starts from the analysis of indirect force control strategies, conceived to keep the contact forces limited by ensuring a suitable compliant behavior to the end effector, without requiring an accurate model of the environment. Then the problem of interaction tasks modeling is analyzed, considering both the case of a rigid environment and the case of a compliant environment. For the specification of an interaction task, natural constraints set by the task geometry and artificial constraints set by the control strategy are established, with respect to suitable task frames. This formulation is the essential premise to the synthesis of hybrid force/motion control schemes.

COMRADE: Compliant motion research and development environment

Author  Joris De Schutter, Herman Bruyninckx, Hendrik Van Brussel et al.

Video ID : 691

The video collects works on force control developed in the 1970s-1980s and 1990s at the Department of Mechanical Engineering of the Katholieke Universiteit Leuven, Belgium. The tasks were programmed and simulated using the task-frame-based software package COMRADE (compliant motion research and development environment). The video was recorded in the mid-1990s. The main references for the video are: 1. H. Van Brussel, J. Simons: The adaptable compliance concept and its use for automatic assembly by active force feedback accommodations, Proc. 9th Int. Symposium Indust. Robot., Washington (1979), pp.167-181 2. J. Simons, H. Van Brussel, J. De Schutter, J. Verhaert: A self-learning automaton with variable resolution for high precision assembly by industrial robots, IEEE Trans. Autom. Control 27(5), 1109-1113 (1982) 3. J. De Schutter, H. Van Brussel: Compliant robot motion II. A control approach based on external control loops, Int. J. Robot. Res. 7(4), 18-33 (1988) 3.J. De Schutter, H. Van Brussel: Compliant robot motion I. A formalism for specifying compliant motion tasks, Int. J. Robot. Res. 7(4), 3-17 (1988) 4. W. Witvrouw, P. Van de Poel, H. Bruyninckx, J. De Schutter: ROSI: A task specification and simulation tool for force-sensor-based robot control, Proc. 24th Int. Symp. Indust. Robot., Tokyo (1993), pp. 385-392 5. W. Witvrouw, P. Van de Poel, J. De Schutter: COMRADE: Compliant motion research and development environment, Proc. 3rd IFAC/IFIP Workshop on Algorithms and Architecture for Real-Time Control. Ostend (1995), pp. 81-87 6. H. Bruyninckx, S. Dutre, J. De Schutter: Peg-on-hole, a model-based solution to peg and hole alignment, Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Nagoya (1995), pp. 1919-1924 7. M. Nuttin, H. Van Brussel: Learning the peg-into-hole assembly operation with a connectionist reinforcement technique, Comput. Ind. 33(1), 101-109 (1997)

Chapter 66 — Robotics Competitions and Challenges

Daniele Nardi, Jonathan Roberts, Manuela Veloso and Luke Fletcher

This chapter explores the use of competitions to accelerate robotics research and promote science, technology, engineering, and mathematics (STEM) education. We argue that the field of robotics is particularly well suited to innovation through competitions. Two broad categories of robot competition are used to frame the discussion: human-inspired competitions and task-based challenges. Human-inspired robot competitions, of which the majority are sports contests, quickly move through platform development to focus on problemsolving and test through game play. Taskbased challenges attempt to attract participants by presenting a high aim for a robotic system. The contest can then be tuned, as required, to maintain motivation and ensure that the progress is made. Three case studies of robot competitions are presented, namely robot soccer, the UAV challenge, and the DARPA (Defense Advanced Research Projects Agency) grand challenges. The case studies serve to explore from the point of view of organizers and participants, the benefits and limitations of competitions, and what makes a good robot competition.

This chapter ends with some concluding remarks on the natural convergence of humaninspired competitions and task-based challenges in the promotion of STEM education, research, and vocations.

Multirobot teamwork in the CMDragons RoboCup SSL team

Author  Manuela Veloso

Video ID : 387

In this video, we can see the coordination and passing strategy as an example of the play of the RoboCup small-size league (SSL), in this case, the CMDragons team from Veloso and her students, at Carnegie Mellon University. The RoboCup SSL has an overhead camera connected to an offboard computer which plans and commands the robots: The perception, planning, and actuation cycle is fully autonomous.

Chapter 47 — Motion Planning and Obstacle Avoidance

Javier Minguez, Florant Lamiraux and Jean-Paul Laumond

This chapter describes motion planning and obstacle avoidance for mobile robots. We will see how the two areas do not share the same modeling background. From the very beginning of motion planning, research has been dominated by computer sciences. Researchers aim at devising well-grounded algorithms with well-understood completeness and exactness properties.

The challenge of this chapter is to present both nonholonomic motion planning (Sects. 47.1–47.6) and obstacle avoidance (Sects. 47.7–47.10) issues. Section 47.11 reviews recent successful approaches that tend to embrace the whole problemofmotion planning and motion control. These approaches benefit from both nonholonomic motion planning and obstacle avoidance methods.

Autonomous robotic smart-wheelchair navigation in an urban environment

Author  VADERlab

Video ID : 707

This video demonstrates the reliable navigation of a smart wheelchair system (SWS) in an urban environment. Urban environments present unique challenges for service robots. They require localization accuracy at the sidewalk level, but compromise estimated GPS positions through significant multipath effects. However, they are also rich in landmarks that can be leveraged by feature-based localization approaches. To this end, the SWS employed a map-based approach. A map of South Bethlehem was acquired using a server vehicle, synthesized a priori, and made accessible to the SWS client. The map embedded not only the locations of landmarks, but also semantic data delineating seven different landmark classes to facilitate robust data association. Landmark segmentation and tracking by the SWS was then accomplished using both 2-D and 3-D LIDAR systems. The resulting localization algorithm has demonstrated decimeter-level positioning accuracy in a global coordinate frame. The localization package was integrated into a ROS framework with a sample-based planner and control loop running at 5 Hz. For validation, the SWS repeatedly navigated autonomously between Lehigh University's Packard Laboratory and the University bookstore, a distance of approximately 1.0 km roundtrip.

Chapter 34 — Visual Servoing

François Chaumette, Seth Hutchinson and Peter Corke

This chapter introduces visual servo control, using computer vision data in the servo loop to control the motion of a robot. We first describe the basic techniques that are by now well established in the field. We give a general overview of the formulation of the visual servo control problem, and describe the two archetypal visual servo control schemes: image-based and pose-based visual servo control. We then discuss performance and stability issues that pertain to these two schemes, motivating advanced techniques. Of the many advanced techniques that have been developed, we discuss 2.5-D, hybrid, partitioned, and switched approaches. Having covered a variety of control schemes, we deal with target tracking and controlling motion directly in the joint space and extensions to under-actuated ground and aerial robots. We conclude by describing applications of visual servoing in robotics.

IBVS on a 6- DOF robot arm (3)

Author  Francois Chaumette, Seth Hutchinson, Peter Corke

Video ID : 61

This video shows an IBVS on a 6-DOF robot arm with Cartesian coordinates of image points as visual features and mean interaction matrix in the control scheme. It corresponds to the results depicted in Figure 34.4.

Chapter 50 — Modeling and Control of Robots on Rough Terrain

Keiji Nagatani, Genya Ishigami and Yoshito Okada

In this chapter, we introduce modeling and control for wheeled mobile robots and tracked vehicles. The target environment is rough terrains, which includes both deformable soil and heaps of rubble. Therefore, the topics are roughly divided into two categories, wheeled robots on deformable soil and tracked vehicles on heaps of rubble.

After providing an overview of this area in Sect. 50.1, a modeling method of wheeled robots on a deformable terrain is introduced in Sect. 50.2. It is based on terramechanics, which is the study focusing on the mechanical properties of natural rough terrain and its response to off-road vehicle, specifically the interaction between wheel/track and soil. In Sect. 50.3, the control of wheeled robots is introduced. A wheeled robot often experiences wheel slippage as well as its sideslip while traversing rough terrain. Therefore, the basic approach in this section is to compensate the slip via steering and driving maneuvers. In the case of navigation on heaps of rubble, tracked vehicles have much advantage. To improve traversability in such challenging environments, some tracked vehicles are equipped with subtracks, and one kinematical modeling method of tracked vehicle on rough terrain is introduced in Sect. 50.4. In addition, stability analysis of such vehicles is introduced in Sect. 50.5. Based on such kinematical model and stability analysis, a sensor-based control of tracked vehicle on rough terrain is introduced in Sect. 50.6. Sect. 50.7 summarizes this chapter.

Terradynamics of legged locomotion for traversal in granular media

Author  Chen Li, Tingnan Zhang, Daniel Goldman

Video ID : 186

The experiments in this video evaluate the effect of leg shape on the robot's dynamic behavior on soft sand. Several types of leg shapes have been tested, e.g., from linear shapes to arcs, with varying curvatures.

Chapter 75 — Biologically Inspired Robotics

Fumiya Iida and Auke Jan Ijspeert

Throughout the history of robotics research, nature has been providing numerous ideas and inspirations to robotics engineers. Small insect-like robots, for example, usually make use of reflexive behaviors to avoid obstacles during locomotion, whereas large bipedal robots are designed to control complex human-like leg for climbing up and down stairs. While providing an overview of bio-inspired robotics, this chapter particularly focus on research which aims to employ robotics systems and technologies for our deeper understanding of biological systems. Unlike most of the other robotics research where researchers attempt to develop robotic applications, these types of bio-inspired robots are generally developed to test unsolved hypotheses in biological sciences. Through close collaborations between biologists and roboticists, bio-inspired robotics research contributes not only to elucidating challenging questions in nature but also to developing novel technologies for robotics applications. In this chapter, we first provide a brief historical background of this research area and then an overview of ongoing research methodologies. A few representative case studies will detail the successful instances in which robotics technologies help identifying biological hypotheses. And finally we discuss challenges and perspectives in the field.

Biologically inspired robotics (or bio-inspired robotics in short) is a very broad research area because almost all robotic systems are, in one way or the other, inspired from biological systems. Therefore, there is no clear distinction between bio-inspired robots and the others, and there is no commonly agreed definition [75.1]. For example, legged robots that walk, hop, and run are usually regarded as bio-inspired robots because many biological systems rely on legged locomotion for their survival. On the other hand, many robotics researchers implement biologicalmodels ofmotion control and navigation onto wheeled platforms, which could also be regarded as bio-inspired robots [75.2].

Dynamic-rolling locomotion of GoQBot

Author  Fumiya Iida, Auke Ijspeert

Video ID : 109

This video presents dynamic-rolling locomotion of a worm-like robot GoQBot. Unlike the other conventional soft robots that are capable of only slow motions, this platform exhibits fast locomotion by exploiting the flexible deformation of the body as inspired from nature.

Chapter 58 — Robotics in Hazardous Applications

James Trevelyan, William R. Hamel and Sung-Chul Kang

Robotics researchers have worked hard to realize a long-awaited vision: machines that can eliminate the need for people to work in hazardous environments. Chapter 60 is framed by the vision of disaster response: search and rescue robots carrying people from burning buildings or tunneling through collapsed rock falls to reach trapped miners. In this chapter we review tangible progress towards robots that perform routine work in places too dangerous for humans. Researchers still have many challenges ahead of them but there has been remarkable progress in some areas. Hazardous environments present special challenges for the accomplishment of desired tasks depending on the nature and magnitude of the hazards. Hazards may be present in the form of radiation, toxic contamination, falling objects or potential explosions. Technology that specialized engineering companies can develop and sell without active help from researchers marks the frontier of commercial feasibility. Just inside this border lie teleoperated robots for explosive ordnance disposal (EOD) and for underwater engineering work. Even with the typical tenfold disadvantage in manipulation performance imposed by the limits of today’s telepresence and teleoperation technology, in terms of human dexterity and speed, robots often can offer a more cost-effective solution. However, most routine applications in hazardous environments still lie far beyond the feasibility frontier. Fire fighting, remediating nuclear contamination, reactor decommissioning, tunneling, underwater engineering, underground mining and clearance of landmines and unexploded ordnance still present many unsolved problems.

DIGGER DTR Demining destroying anti-tank mines

Author  James P. Trevelyan

Video ID : 577

This is a Swiss-designed and built, remotely-controlled machine similar to Bozena, shown clearing vegetation. From the video, it seems to lack some of the versatility of Bozena. However, it is clearly able to continue working without being affected by powerful anti-tank mine explosions, even ones with shaped charges like the TMRP-1. Specifications include remote control, 8-ton weight, and deployment from a 20-ft standard shipping container.   The personnel protection shield provides only minimal protection. The more recent DIGGER D-3 ground-milling machine (https://www.youtube.com/watch?v=P154EDpRFew) avoids many of the weaknesses of the flail machine used in the earlier model and incorporates a more robust design, and it also has dust and shrapnel protection.

Robot being used to carry a vacuum-cleaner head at Fukishima powerplant

Author  James P. Trevelyan

Video ID : 581

A video apparently provided by IEEE Spectrum showing views of a robot performing simple vacuum-cleaning tasks.

Chapter 46 — Simultaneous Localization and Mapping

Cyrill Stachniss, John J. Leonard and Sebastian Thrun

This chapter provides a comprehensive introduction in to the simultaneous localization and mapping problem, better known in its abbreviated form as SLAM. SLAM addresses the main perception problem of a robot navigating an unknown environment. While navigating the environment, the robot seeks to acquire a map thereof, and at the same time it wishes to localize itself using its map. The use of SLAM problems can be motivated in two different ways: one might be interested in detailed environment models, or one might seek to maintain an accurate sense of a mobile robot’s location. SLAM serves both of these purposes.

We review the three major paradigms from which many published methods for SLAM are derived: (1) the extended Kalman filter (EKF); (2) particle filtering; and (3) graph optimization. We also review recent work in three-dimensional (3-D) SLAM using visual and red green blue distance-sensors (RGB-D), and close with a discussion of open research problems in robotic mapping.

Large-scale SLAM using the Atlas framework

Author  Michael Bosse

Video ID : 440

This video shows the operation of the Atlas framework for real-time, large-scale mapping using the MIT Killian Court data set. Atlas employed graphs of coordinate frames. Each vertex in the graph represents a local coordinate frame, and each edge represents the transformation between adjacent local coordinate frames. In each local coordinate frame, extended Kalman filter SLAM (Chap. 46.3.1, Springer Handbook of Robotics, 2nd edn 2016) is performed to make a map of the local environment and to estimate the current robot pose, along with the uncertainties of each. Each map's uncertainties were modelled with respect to its own local frame. Probabilities of entities in relation to arbitrary map-frames were generated by following a path formed by the edges between adjacent map-frames, using Dijkstra's shortest path algorithm. Loop-closing was achieved via an efficient map matching algorithm. Reference: M. Bosse, P. M. Newman, J. Leonard, S. Teller: Simultaneous localization and map building in large-scale cyclic environments using the Atlas framework, Int. J. Robot. Res. 23(12), 1113-1139 (2004).