Learning non-linear patch embeddings with neural networks for label fusion

In brain structural segmentation, multi-atlas strategies are increasingly being used over single-atlas strategies because of their ability to fit a wider anatomical variability. Patch-based label fusion (PBLF) is a type of such multi-atlas approaches that labels each target point as a weighted combi...

ver descrição completa

Detalhes bibliográficos
Autores: Sanromà, Gerard, Benkarim, Oualid M., Piella Fenoy, Gemma, Camara, Oscar, Wu, Guorong, Shen, Dinggang, Gispert, Juan Domingo, Molinuevo, José Luis, González Ballester, Miguel Ángel, 1973-
Tipo de documento: artigo
Estado:Versión aceptada para publicación
Data de publicação:2018
País:España
Recursos:Universitat Pompeu Fabra
Repositório:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/35395
Acesso em linha:http://hdl.handle.net/10230/35395
http://dx.doi.org/10.1016/j.media.2017.11.013
Access Level:Acceso aberto
Palavra-chave:Patch-based label fusion
Multi-atlas segmentation
Neural networks
Embedding
Brain MRI
Hippocampus
Descrição
Resumo:In brain structural segmentation, multi-atlas strategies are increasingly being used over single-atlas strategies because of their ability to fit a wider anatomical variability. Patch-based label fusion (PBLF) is a type of such multi-atlas approaches that labels each target point as a weighted combination of neighboring atlas labels, where atlas points with higher local similarity to the target contribute more strongly to label fusion. PBLF can be potentially improved by increasing the discriminative capabilities of the local image similarity measurements. We propose a framework to compute patch embeddings using neural networks so as to increase discriminative abilities of similarity-based weighted voting in PBLF. As particular cases, our framework includes embeddings with different complexities, namely, a simple scaling, an affine transformation, and non-linear transformations. We compare our method with state-of-the-art alternatives in whole hippocampus and hippocampal subfields segmentation experiments using publicly available datasets. Results show that even the simplest versions of our method outperform standard PBLF, thus evidencing the benefits of discriminative learning. More complex transformation models tended to achieve better results than simpler ones, obtaining a considerable increase in average Dice score compared to standard PBLF.