View Chapter

Chapter 63 — Medical Robotics and Computer-Integrated Surgery

Russell H. Taylor, Arianna Menciassi, Gabor Fichtinger, Paolo Fiorini and Paolo Dario

The growth of medical robotics since the mid- 1980s has been striking. From a few initial efforts in stereotactic brain surgery, orthopaedics, endoscopic surgery, microsurgery, and other areas, the field has expanded to include commercially marketed, clinically deployed systems, and a robust and exponentially expanding research community. This chapter will discuss some major themes and illustrate them with examples from current and past research. Further reading providing a more comprehensive review of this rapidly expanding field is suggested in Sect. 63.4.

Medical robotsmay be classified in many ways: by manipulator design (e.g., kinematics, actuation); by level of autonomy (e.g., preprogrammed versus teleoperation versus constrained cooperative control), by targeted anatomy or technique (e.g., cardiac, intravascular, percutaneous, laparoscopic, microsurgical); or intended operating environment (e.g., in-scanner, conventional operating room). In this chapter, we have chosen to focus on the role of medical robots within the context of larger computer-integrated systems including presurgical planning, intraoperative execution, and postoperative assessment and follow-up.

First, we introduce basic concepts of computerintegrated surgery, discuss critical factors affecting the eventual deployment and acceptance of medical robots, and introduce the basic system paradigms of surgical computer-assisted planning, execution, monitoring, and assessment (surgical CAD/CAM) and surgical assistance. In subsequent sections, we provide an overview of the technology ofmedical robot systems and discuss examples of our basic system paradigms, with brief additional discussion topics of remote telesurgery and robotic surgical simulators. We conclude with some thoughts on future research directions and provide suggested further reading.

IREP robot - Insertable robotic effectors in single-port surgery

Author  Columbia University

Video ID : 831

This movie shows the single-port-access surgical robot IREP. This multimedia extension accompanies the IEEE ICRA 2010 paper describing design considerations for suturing. The work was carried out by Jienan Ding, Kai Xu, Roger Goldman, and Nabil Simaan at ARMA lab in collaboration with Peter Allen and Dennis Fowler from Columbia University.

Chapter 61 — Robot Surveillance and Security

Wendell H. Chun and Nikolaos Papanikolopoulos

This chapter introduces the foundation for surveillance and security robots for multiple military and civilian applications. The key environmental domains are mobile robots for ground, aerial, surface water, and underwater applications. Surveillance literallymeans to watch fromabove,while surveillance robots are used to monitor the behavior, activities, and other changing information that are gathered for the general purpose of managing, directing, or protecting one’s assets or position. In a practical sense, the term surveillance is taken to mean the act of observation from a distance, and security robots are commonly used to protect and safeguard a location, some valuable assets, or personal against danger, damage, loss, and crime. Surveillance is a proactive operation,while security robots are a defensive operation. The construction of each type of robot is similar in nature with amobility component, sensor payload, communication system, and an operator control station.

After introducing the major robot components, this chapter focuses on the various applications. More specifically, Sect. 61.3 discusses the enabling technologies of mobile robot navigation, various payload sensors used for surveillance or security applications, target detection and tracking algorithms, and the operator’s robot control console for human–machine interface (HMI). Section 61.4 presents selected research activities relevant to surveillance and security, including automatic data processing of the payload sensors, automaticmonitoring of human activities, facial recognition, and collaborative automatic target recognition (ATR). Finally, Sect. 61.5 discusses future directions in robot surveillance and security, giving some conclusions and followed by references.

Surveillance by a drone

Author  Bernd Lutz

Video ID : 554

The MULTIROTOR by service-drone.com is an innovative measuring instrument that can be used for surveillance. Besides delivering very stable pictures, the MULTIROTOR is also able to fly fully-automated measurement flights with a high precision of 1 mm ground resolution and equally impressive flight stability at wind strengths up to 10-15 m/s.

Chapter 76 — Evolutionary Robotics

Stefano Nolfi, Josh Bongard, Phil Husbands and Dario Floreano

Evolutionary Robotics is a method for automatically generating artificial brains and morphologies of autonomous robots. This approach is useful both for investigating the design space of robotic applications and for testing scientific hypotheses of biological mechanisms and processes. In this chapter we provide an overview of methods and results of Evolutionary Robotics with robots of different shapes, dimensions, and operation features. We consider both simulated and physical robots with special consideration to the transfer between the two worlds.

Evolved bipedal walking

Author  Phil Husbands

Video ID : 374

The video shows stages of evolution of bipedal walking in a simulated, bipedal robot using realistic physics (from the work by Torsten Reil and originating at Sussex University). This was the first example of successfully- evolved bipedal gaits produced in a physics-engine-based simulation. The problem is inherently dynamically unstable, thus making it an interesting challenge.

Chapter 34 — Visual Servoing

François Chaumette, Seth Hutchinson and Peter Corke

This chapter introduces visual servo control, using computer vision data in the servo loop to control the motion of a robot. We first describe the basic techniques that are by now well established in the field. We give a general overview of the formulation of the visual servo control problem, and describe the two archetypal visual servo control schemes: image-based and pose-based visual servo control. We then discuss performance and stability issues that pertain to these two schemes, motivating advanced techniques. Of the many advanced techniques that have been developed, we discuss 2.5-D, hybrid, partitioned, and switched approaches. Having covered a variety of control schemes, we deal with target tracking and controlling motion directly in the joint space and extensions to under-actuated ground and aerial robots. We conclude by describing applications of visual servoing in robotics.

PBVS on a 6-DOF robot arm (1)

Author  Francois Chaumette, Seth Hutchinson, Peter Corke

Video ID : 62

This video shows a PBVS on a 6-DOF robot arm with (c^t_o, theta u) as visual features. It corresponds to the results depicted in Figure 34.9.

Chapter 71 — Cognitive Human-Robot Interaction

Bilge Mutlu, Nicholas Roy and Selma Šabanović

A key research challenge in robotics is to design robotic systems with the cognitive capabilities necessary to support human–robot interaction. These systems will need to have appropriate representations of the world; the task at hand; the capabilities, expectations, and actions of their human counterparts; and how their own actions might affect the world, their task, and their human partners. Cognitive human–robot interaction is a research area that considers human(s), robot(s), and their joint actions as a cognitive system and seeks to create models, algorithms, and design guidelines to enable the design of such systems. Core research activities in this area include the development of representations and actions that allow robots to participate in joint activities with people; a deeper understanding of human expectations and cognitive responses to robot actions; and, models of joint activity for human–robot interaction. This chapter surveys these research activities by drawing on research questions and advances from a wide range of fields including computer science, cognitive science, linguistics, and robotics.

Gaze and gesture cues for robots

Author  Bilge Mutlu

Video ID : 128

In human-robot communication, nonverbal cues like gaze and gesture can be a source of important information for starting and maintaining interaction. Gaze, for example, can tell a person about what the robot is attending to, its mental state, and its role in a conversation. Researchers are studying and developing models of nonverbal cues in human-robot interaction to enable more successful collaboration between robots and humans in a variety of domains, including education.

Chapter 55 — Space Robotics

Kazuya Yoshida, Brian Wilcox, Gerd Hirzinger and Roberto Lampariello

In the space community, any unmanned spacecraft can be called a robotic spacecraft. However, Space Robots are considered to be more capable devices that can facilitate manipulation, assembling, or servicing functions in orbit as assistants to astronauts, or to extend the areas and abilities of exploration on remote planets as surrogates for human explorers.

In this chapter, a concise digest of the historical overview and technical advances of two distinct types of space robotic systems, orbital robots and surface robots, is provided. In particular, Sect. 55.1 describes orbital robots, and Sect. 55.2 describes surface robots. In Sect. 55.3, the mathematical modeling of the dynamics and control using reference equations are discussed. Finally, advanced topics for future space exploration missions are addressed in Sect. 55.4.

DLR ROKVISS disassembly

Author  Gerd Hirzinger, Klaus Landzettel

Video ID : 336

This video shows the disassembly of the ROKVISS robot from the ISS by Russian cosmonauts who brought the manipulator back to the DLR at the end of its mission in 2011. It was indeed very valuable to be able to analyze the robot on the ground, after it had spent seven years in space.

Chapter 20 — Snake-Like and Continuum Robots

Ian D. Walker, Howie Choset and Gregory S. Chirikjian

This chapter provides an overview of the state of the art of snake-like (backbones comprised of many small links) and continuum (continuous backbone) robots. The history of each of these classes of robot is reviewed, focusing on key hardware developments. A review of the existing theory and algorithms for kinematics for both types of robot is presented, followed by a summary ofmodeling of locomotion for snake-like and continuum mechanisms.

Stenting deployment system

Author  Nabil Simaan

Video ID : 248

A 3-DOF continuum robot for intraocular dexterity and stent placement. The video shows a stent being deployed in a choroallantoic chick membrane which represents the vasculature of the retina [1, 2]. Note that [1] reports an algorithm for assisted telemanipulation and force sensing at the tip of a guide wire using a rapid interpolation map by elliptic integrals. References: [1] W. Wei, N. Simaan: Modeling, force sensing, and control of flexible cannulas for microstent delivery, J. Dyn. Syst. Meas. Control 134(4), 041004 (2012); [2] W. Wei, C. Popplewell, H. Fine, S. Chang, N. Simaan: Enabling technology for micro-vascular stenting in ophthalmic surgery, ASME J. Med. Dev. 4(2), 014503-01 - 014503-06 (2010)

Chapter 67 — Humanoids

Paul Fitzpatrick, Kensuke Harada, Charles C. Kemp, Yoshio Matsumoto, Kazuhito Yokoi and Eiichi Yoshida

Humanoid robots selectively immitate aspects of human form and behavior. Humanoids come in a variety of shapes and sizes, from complete human-size legged robots to isolated robotic heads with human-like sensing and expression. This chapter highlights significant humanoid platforms and achievements, and discusses some of the underlying goals behind this area of robotics. Humanoids tend to require the integration ofmany of the methods covered in detail within other chapters of this handbook, so this chapter focuses on distinctive aspects of humanoid robotics with liberal cross-referencing.

This chapter examines what motivates researchers to pursue humanoid robotics, and provides a taste of the evolution of this field over time. It summarizes work on legged humanoid locomotion, whole-body activities, and approaches to human–robot communication. It concludes with a brief discussion of factors that may influence the future of humanoid robots.

Whole-body "pivoting" manipulation

Author  Eiichi Yoshida

Video ID : 595

The humanoid robot performs "pivoting" manipulation to carry a bulky object without lifting. A coarse path of the object towards its goal position is first planned to compute the trajectory of the hands which perform the manipulation. Then foot positions are determined along the object path, from which the COM trajectory is derived using the dynamic walking-pattern generator. Those tasks are provided to the inverse kinematics to generate the coordinated arm and leg motion for this complex manipulation. The second video shows the motion planning combining pivoting manipulation and free walking motion in a more complex environment.

Chapter 20 — Snake-Like and Continuum Robots

Ian D. Walker, Howie Choset and Gregory S. Chirikjian

This chapter provides an overview of the state of the art of snake-like (backbones comprised of many small links) and continuum (continuous backbone) robots. The history of each of these classes of robot is reviewed, focusing on key hardware developments. A review of the existing theory and algorithms for kinematics for both types of robot is presented, followed by a summary ofmodeling of locomotion for snake-like and continuum mechanisms.

RDP experimental results

Author  Nabil Simaan

Video ID : 247

Demonstrates a prototype system for transurethral bladder cancer resection. This robot has a 5 mm snake with two segments and three working channels including a custom-made fiberscope, laser ablation and a gripper [1-3]. References: [1] A. Bajo, R. B. Pickens, S. D. Herrell, N. Simaan: A pilot ex-vivo evaluation of a telerobotic system for transurethral intervention and surveillance, The 5th Hamlyn Symp. Medical Robotics (2012), pp. 3-4; [2] A. Bajo, R. B. Pickens, S. D. Herrell, N. Simaan: Constrained motion control of multisegment continuum robots for transurethral bladder resection and surveillance, Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Karlsruhe (2013), pp. 5817-5822; [3] R. E. Goldman, A. Bajo, L. S. MacLachlan, R. Pickens, S. D. Herrell, N. Simaan: Design and performance evaluation of a minimally invasive telerobotic platform for transurethral surveillance and intervention, IEEE Trans. Biomed. Eng. 60(4), 918-925 (2013)

Chapter 56 — Robotics in Agriculture and Forestry

Marcel Bergerman, John Billingsley, John Reid and Eldert van Henten

Robotics for agriculture and forestry (A&F) represents the ultimate application of one of our society’s latest and most advanced innovations to its most ancient and important industries. Over the course of history, mechanization and automation increased crop output several orders of magnitude, enabling a geometric growth in population and an increase in quality of life across the globe. Rapid population growth and rising incomes in developing countries, however, require ever larger amounts of A&F output. This chapter addresses robotics for A&F in the form of case studies where robotics is being successfully applied to solve well-identified problems. With respect to plant crops, the focus is on the in-field or in-farm tasks necessary to guarantee a quality crop and, generally speaking, end at harvest time. In the livestock domain, the focus is on breeding and nurturing, exploiting, harvesting, and slaughtering and processing. The chapter is organized in four main sections. The first one explains the scope, in particular, what aspects of robotics for A&F are dealt with in the chapter. The second one discusses the challenges and opportunities associated with the application of robotics to A&F. The third section is the core of the chapter, presenting twenty case studies that showcase (mostly) mature applications of robotics in various agricultural and forestry domains. The case studies are not meant to be comprehensive but instead to give the reader a general overview of how robotics has been applied to A&F in the last 10 years. The fourth section concludes the chapter with a discussion on specific improvements to current technology and paths to commercialization.

A mini, unmanned, aerial system for remote sensing in agriculture

Author  Joao Valente, Julian Colorado, Claudio Rossi, Alex Martinez, Jaime Del Cerro, Antonio Barrientos

Video ID : 307

This video shows a mini-aerial robot employed for aerial sampling in precision agriculture (PA). Issues such as field partitioning, path planning, and robust flight control are addressed, together with experimental results collected during outdoor testing.