3D Human pose estimation from egocentric inputs

Egocentric pose estimation is essential for developing embodied AI systems capable of interacting naturally with humans and their environments. This thesis addresses the challenges of first-person pose estimation through a series of interconnected studies. The first study, BoDiffusion, presents a ge...

ver descrição completa

Detalhes bibliográficos
Autor: Escobar Palomeque, María Camila
Formato: tesis doctoral
Estado:Versión aceptada para publicación
Fecha de publicación:2024
País:Colombia
Recursos:Universidad de los Andes
Repositorio:Séneca: repositorio Uniandes
Idioma:inglés
OAI Identifier:oai:repositorio.uniandes.edu.co:1992/75400
Acesso em linha:https://hdl.handle.net/1992/75400
Access Level:acceso abierto
Palavra-chave:Egocentric vision
Pose estimation
Pose forecasting
Ingeniería
Descrição
Resumo:Egocentric pose estimation is essential for developing embodied AI systems capable of interacting naturally with humans and their environments. This thesis addresses the challenges of first-person pose estimation through a series of interconnected studies. The first study, BoDiffusion, presents a generative model that synthesizes full-body motion from sparse inputs. The second study, Ego-Exo4D, establishes a benchmark for pose estimation in real-life settings with diverse activities. The final study, EgoCast, focuses on current pose estimation and forecasting in the wild, integrating visual and proprioceptive inputs to handle dynamic and unscripted environments. Together, these contributions provide robust, temporally consistent methods for real-world 3D pose estimation.