Autonomous underwater vehicle control using reinforcement learning policy search methods

Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. T...

ver descrição completa

Detalhes bibliográficos
Autores: El-Fakdi Sencianes, Andrés, Carreras Pérez, Marc, Palomeras Rovira, Narcís, Ridao Rodríguez, Pere
Formato: artículo
Fecha de publicación:2005
País:España
Recursos:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10256/2220
Acesso em linha:http://hdl.handle.net/10256/2220
Access Level:acceso abierto
Palavra-chave:Aprenentatge per reforç
Robots autònoms -- Sistemes de control
Vehicles submergibles -- Sistemes de control
Autonomous robots -- Control systems
Reinforcement learning
Submersibles -- Control systems
Descrição
Resumo:Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an autonomous robot. The system is characterized by the use of reinforcement learning direct policy search methods (RLDPS) for learning the internal state/action mapping of some behaviors. We demonstrate its feasibility with simulated experiments using the model of our underwater robot URIS in a target following task