Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

[EN] High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive in...

Full description

Bibliographic Details
Authors: Girbés-Juan, Vicent, Schettino, Vinicius, Demiris, Yiannis, Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286, Solanes, J. Ernesto|||0000-0001-5011-4872, Tornero Montserrat, Josep|||0000-0003-1571-0251
Format: article
Publication Date:2022
Country:España
Institution:Universitat Politècnica de València (UPV)
Repository:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Language:English
OAI Identifier:oai:riunet.upv.es:10251/200802
Online Access:https://riunet.upv.es/handle/10251/200802
Access Level:Open access
Keyword:Multimodal teleoperation
Haptic feedback
Motion capture
Dual-arm robotics
Collaborative robot
Surface conditioning
INGENIERIA DE SISTEMAS Y AUTOMATICA
Description
Summary:[EN] High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method.