Horizon CDT Research Highlights

Research Highlights

Improving Robotic Teleoperation through Human-Robot Interaction and Robotic Autonomy

  Gift Odoh (2022 cohort)   www.giftodoh.com

Teleoperation's overall goal is to give the operator situational awareness (i.e., a sense of being there) of the remote environment and the ability to interact conveniently [1]. Operators of telemanipulators in nuclear plants perform inspections and maintenance tasks, including complex manipulations. Several studies reveal that the unstructured nature of the environment, task complexity, and the conservative nature of the nuclear industry cause teleoperators to prefer to be in control and fully aware of the multiple systems' current and future behaviours at all times [2], limiting the deployment autonomous teleoperation or robotics. As a result, the operators of these mechanical systems interact with several mediums, such as various displays, robotic telemanipulation systems, information systems, and including other colleagues at once. These interactions impose overwhelming levels of information processing on the operator, leading to a high cognitive workload, which impacts performance and safety in teleoperation [3].

This PhD aims to explore the opportunities to improve teleoperation using adaptive robotic assistance and improved information interfaces by considering mental workload (MWL) demands. It will include studies on robotic assistance levels and interfaces that dynamically respond to the operator's MWL for teleoperation. The following objectives will be met to achieve this aim:

  1. To identify the objective performance and mental workload metrics for teleoperation.
  2. To determine the sources of physical and mental workload using task analysis.
  3. To develop methods for assessment considering performance and mental and physical workloads during real-time operation and information systems.
  4. To design adaptive low-level autonomy based on physical and mental demands to guide operators through teleoperation task completions.

Several pieces of literature have demonstrated how haptic guidance based on the sense of touch can be deployed for robotic assistance. For example, haptic shared control and haptic traded control, which the operators and the system share and take turns in the control task, respectively. This work will explore how these assistance schemes could potentially be used with low-level autonomy degrees alongside improved information interfaces that respond to an operator's physical and cognitive demands within structured environments for repetitive and predictable tasks. It will combine some physiological, subjective and performance measures to give an improved assessment and evaluation of the operator's mental workload to understand its relationships with teleoperation tasks. With these improved systems, operators can perform their work more conveniently, faster, and accurately, increasing operational safety and reducing operational costs.


[1]        [1] Ó. Hernández-Ortiz and M. A. Arteaga-Pérez, “A simple approach for the force control of bilateral teleoperated manipulators with variable time delays,” Control Eng Pract, vol. 102, p. 104564, Sep. 2020, doi: 10.1016/j.conengprac.2020.104564.

[2]        [2] I. Tsitsimpelis, C. J. Taylor, B. Lennox, and M. J. Joyce, “A review of ground-based robotic systems for the characterization of nuclear environments,” Progress in Nuclear Energy, vol. 111, pp. 109–124, Mar. 2019, doi: 10.1016/j.pnucene.2018.10.023.

[3]        [3] S. Shao, Q. Zhou, and Z. Liu, “Study of mental workload imposed by different tasks based on teleoperation,” International Journal of Occupational Safety and Ergonomics, vol. 27, no. 4, pp. 979–989, Oct. 2021, doi: 10.1080/10803548.2019.1675259.

This author is supported by the Horizon Centre for Doctoral Training at the University of Nottingham (UKRI Grant No. EP/S023305/1).