The University of Southampton
University of Southampton Institutional Repository

Cross-modality multi-atlas segmentation using deep neural networks

Cross-modality multi-atlas segmentation using deep neural networks
Cross-modality multi-atlas segmentation using deep neural networks

Both image registration and label fusion in the multi-atlas segmentation (MAS) rely on the intensity similarity between target and atlas images. However, such similarity can be problematic when target and atlas images are acquired using different imaging protocols. High-level structure information can provide reliable similarity measurement for cross-modality images when cooperating with deep neural networks (DNNs). This work presents a new MAS framework for cross-modality images, where both image registration and label fusion are achieved by DNNs. For image registration, we propose a consistent registration network, which can jointly estimate forward and backward dense displacement fields (DDFs). Additionally, an invertible constraint is employed in the network to reduce the correspondence ambiguity of the estimated DDFs. For label fusion, we adapt a few-shot learning network to measure the similarity of atlas and target patches. Moreover, the network can be seamlessly integrated into the patch-based label fusion. The proposed framework is evaluated on the MM-WHS dataset of MICCAI 2017. Results show that the framework is effective in both cross-modality registration and segmentation.

Cross-modality, MAS, Similarity
0302-9743
233-242
Springer Cham
Ding, Wangbin
ce6c8e72-9208-49fc-b79d-780d4293bc15
Li, Lei
2da88502-0bd8-4e6b-8f7d-0c01a48b399e
Zhuang, Xiahai
c58e977b-e70e-4b37-9acd-b7f8070d98a8
Huang, Liqin
4565d61e-d3eb-4ffd-97af-731ae41e5335
Martel, Anne L.
Abolmaesumi, Purang
Stoyanov, Danail
Mateus, Diana
Zuluaga, Maria A.
Zhou, S. Kevin
Racoceanu, Daniel
Joskowicz, Leo
Ding, Wangbin
ce6c8e72-9208-49fc-b79d-780d4293bc15
Li, Lei
2da88502-0bd8-4e6b-8f7d-0c01a48b399e
Zhuang, Xiahai
c58e977b-e70e-4b37-9acd-b7f8070d98a8
Huang, Liqin
4565d61e-d3eb-4ffd-97af-731ae41e5335
Martel, Anne L.
Abolmaesumi, Purang
Stoyanov, Danail
Mateus, Diana
Zuluaga, Maria A.
Zhou, S. Kevin
Racoceanu, Daniel
Joskowicz, Leo

Ding, Wangbin, Li, Lei, Zhuang, Xiahai and Huang, Liqin (2020) Cross-modality multi-atlas segmentation using deep neural networks. Martel, Anne L., Abolmaesumi, Purang, Stoyanov, Danail, Mateus, Diana, Zuluaga, Maria A., Zhou, S. Kevin, Racoceanu, Daniel and Joskowicz, Leo (eds.) In Medical Image Computing and Computer Assisted Intervention – MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part III. vol. 12263, Springer Cham. pp. 233-242 . (doi:10.1007/978-3-030-59716-0_23).

Record type: Conference or Workshop Item (Paper)

Abstract

Both image registration and label fusion in the multi-atlas segmentation (MAS) rely on the intensity similarity between target and atlas images. However, such similarity can be problematic when target and atlas images are acquired using different imaging protocols. High-level structure information can provide reliable similarity measurement for cross-modality images when cooperating with deep neural networks (DNNs). This work presents a new MAS framework for cross-modality images, where both image registration and label fusion are achieved by DNNs. For image registration, we propose a consistent registration network, which can jointly estimate forward and backward dense displacement fields (DDFs). Additionally, an invertible constraint is employed in the network to reduce the correspondence ambiguity of the estimated DDFs. For label fusion, we adapt a few-shot learning network to measure the similarity of atlas and target patches. Moreover, the network can be seamlessly integrated into the patch-based label fusion. The proposed framework is evaluated on the MM-WHS dataset of MICCAI 2017. Results show that the framework is effective in both cross-modality registration and segmentation.

This record has no associated files available for download.

More information

e-pub ahead of print date: 29 September 2020
Published date: 3 October 2020
Venue - Dates: 23rd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2020, , Lima, Peru, 2020-10-04 - 2020-10-08
Keywords: Cross-modality, MAS, Similarity

Identifiers

Local EPrints ID: 488980
URI: http://eprints.soton.ac.uk/id/eprint/488980
ISSN: 0302-9743
PURE UUID: 5749daf3-f880-4003-bb35-704ff661722e
ORCID for Lei Li: ORCID iD orcid.org/0000-0003-1281-6472

Catalogue record

Date deposited: 10 Apr 2024 16:36
Last modified: 11 Apr 2024 02:08

Export record

Altmetrics

Contributors

Author: Wangbin Ding
Author: Lei Li ORCID iD
Author: Xiahai Zhuang
Author: Liqin Huang
Editor: Anne L. Martel
Editor: Purang Abolmaesumi
Editor: Danail Stoyanov
Editor: Diana Mateus
Editor: Maria A. Zuluaga
Editor: S. Kevin Zhou
Editor: Daniel Racoceanu
Editor: Leo Joskowicz

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×