Deep Learning Enhanced Multisensor Data Fusion for Building Assessment Using Multispectral Voxels and Self-Organizing Maps

Efforts in the domain of building studies involve the use of a diverse array of geomatic sensors, some providing invaluable information in the form of three-dimensional point clouds and associated registered properties. However, managing the vast amounts of data generated by these sensors presents s...

ver descrição completa

Detalhes bibliográficos
Autores: Raimundo Valdecantos, Antonio Javier, López-Cuervo Medina, Serafín, Aguirre de Mata, Julián, Herrero Tejedor, Tomás Ramón, Priego de los Santos, Enrique
Formato: artículo
Fecha de publicación:2024
País:España
Recursos:Consejo General de la Arquitectura Técnica de España (CGATE)
Repositorio:RIARTE
OAI Identifier:oai:www.riarte.es:20.500.12251/3810
Acesso em linha:http://hdl.handle.net/20.500.12251/3810
https://doi.org/10.3390/heritage7020051
Access Level:acceso abierto
Palavra-chave:Sensorización
Nube de puntos
Modelado tridimensional
Mantenimiento preventivo
Patrimonio histórico
Vóxel multiespectral
Patologías - Construcción
Patrimonio cultural
3310.04 Ingeniería de Mantenimiento
3311.02 Ingeniería de Control
3311.17 Equipos de Verificación
3305.26 Edificios Públicos
Descrição
Resumo:Efforts in the domain of building studies involve the use of a diverse array of geomatic sensors, some providing invaluable information in the form of three-dimensional point clouds and associated registered properties. However, managing the vast amounts of data generated by these sensors presents significant challenges. To ensure the effective use of multisensor data in the context of cultural heritage preservation, it is imperative that multisensor data fusion methods be designed in such a way as to facilitate informed decision-making by curators and stakeholders. We propose a novel approach to multisensor data fusion using multispectral voxels, which enable the application of deep learning algorithms as the self-organizing maps to identify and exploit the relationships between the different sensor data. Our results indicate that this approach provides a comprehensive view of the building structure and its potential pathologies, and holds great promise for revolutionizing the study of historical buildings and their potential applications in the field of cultural heritage preservation.