The University of Southampton
University of Southampton Institutional Repository

Brain tumor segmentation network using attention-based fusion and spatial relationship constraint

Brain tumor segmentation network using attention-based fusion and spatial relationship constraint
Brain tumor segmentation network using attention-based fusion and spatial relationship constraint

Delineating the brain tumor from magnetic resonance (MR) images is critical for the treatment of gliomas. However, automatic delineation is challenging due to the complex appearance and ambiguous outlines of tumors. Considering that multi-modal MR images can reflect different tumor biological properties, we develop a novel multi-modal tumor segmentation network (MMTSN) to robustly segment brain tumors based on multi-modal MR images. The MMTSN is composed of three sub-branches and a main branch. Specifically, the sub-branches are used to capture different tumor features from multi-modal images, while in the main branch, we design a spatial-channel fusion block (SCFB) to effectively aggregate multi-modal features. Additionally, inspired by the fact that the spatial relationship between sub-regions of the tumor is relatively fixed, e.g., the enhancing tumor is always in the tumor core, we propose a spatial loss to constrain the relationship between different sub-regions of tumor. We evaluate our method on the test set of multi-modal brain tumor segmentation challenge 2020 (BraTs2020). The method achieves 0.8764, 0.8243 and 0.773 Dice score for the whole tumor, tumor core and enhancing tumor, respectively.

Brain tumor, Multi-modal MRI, Segmentation
0302-9743
219-229
Springer Cham
Liu, Chenyu
1856feeb-66b8-4af5-b264-89112828d8e1
Ding, Wangbin
ce6c8e72-9208-49fc-b79d-780d4293bc15
Li, Lei
2da88502-0bd8-4e6b-8f7d-0c01a48b399e
Zhang, Zhen
9bc6bc9d-b93a-45e0-ab57-c7a050d96b9a
Pei, Chenhao
c585383e-d483-4500-8e19-dfc874a09474
Huang, Liqin
4565d61e-d3eb-4ffd-97af-731ae41e5335
Zhuang, Xiahai
c58e977b-e70e-4b37-9acd-b7f8070d98a8
Crimi, Alessandro
Bakas, Spyridon
et al.
Liu, Chenyu
1856feeb-66b8-4af5-b264-89112828d8e1
Ding, Wangbin
ce6c8e72-9208-49fc-b79d-780d4293bc15
Li, Lei
2da88502-0bd8-4e6b-8f7d-0c01a48b399e
Zhang, Zhen
9bc6bc9d-b93a-45e0-ab57-c7a050d96b9a
Pei, Chenhao
c585383e-d483-4500-8e19-dfc874a09474
Huang, Liqin
4565d61e-d3eb-4ffd-97af-731ae41e5335
Zhuang, Xiahai
c58e977b-e70e-4b37-9acd-b7f8070d98a8
Crimi, Alessandro
Bakas, Spyridon

Liu, Chenyu, Ding, Wangbin and Li, Lei , et al. (2021) Brain tumor segmentation network using attention-based fusion and spatial relationship constraint. Crimi, Alessandro and Bakas, Spyridon (eds.) In Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: 6th International Workshop, BrainLes 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 4, 2020, Revised Selected Papers, Part I. vol. 12658, Springer Cham. pp. 219-229 . (doi:10.1007/978-3-030-72084-1_20).

Record type: Conference or Workshop Item (Paper)

Abstract

Delineating the brain tumor from magnetic resonance (MR) images is critical for the treatment of gliomas. However, automatic delineation is challenging due to the complex appearance and ambiguous outlines of tumors. Considering that multi-modal MR images can reflect different tumor biological properties, we develop a novel multi-modal tumor segmentation network (MMTSN) to robustly segment brain tumors based on multi-modal MR images. The MMTSN is composed of three sub-branches and a main branch. Specifically, the sub-branches are used to capture different tumor features from multi-modal images, while in the main branch, we design a spatial-channel fusion block (SCFB) to effectively aggregate multi-modal features. Additionally, inspired by the fact that the spatial relationship between sub-regions of the tumor is relatively fixed, e.g., the enhancing tumor is always in the tumor core, we propose a spatial loss to constrain the relationship between different sub-regions of tumor. We evaluate our method on the test set of multi-modal brain tumor segmentation challenge 2020 (BraTs2020). The method achieves 0.8764, 0.8243 and 0.773 Dice score for the whole tumor, tumor core and enhancing tumor, respectively.

This record has no associated files available for download.

More information

e-pub ahead of print date: 26 March 2021
Published date: 27 March 2021
Venue - Dates: 6th International MICCAI Brainlesion Workshop, BrainLes 2020 Held in Conjunction with 23rd Medical Image Computing for Computer Assisted Intervention Conference, MICCAI 2020, , Virtual, Online, 2020-10-04 - 2020-10-04
Keywords: Brain tumor, Multi-modal MRI, Segmentation

Identifiers

Local EPrints ID: 488983
URI: http://eprints.soton.ac.uk/id/eprint/488983
ISSN: 0302-9743
PURE UUID: 6069ded7-e0bc-4699-91e8-74bd6c954ae5
ORCID for Lei Li: ORCID iD orcid.org/0000-0003-1281-6472

Catalogue record

Date deposited: 10 Apr 2024 16:37
Last modified: 11 Apr 2024 02:08

Export record

Altmetrics

Contributors

Author: Chenyu Liu
Author: Wangbin Ding
Author: Lei Li ORCID iD
Author: Zhen Zhang
Author: Chenhao Pei
Author: Liqin Huang
Author: Xiahai Zhuang
Editor: Alessandro Crimi
Editor: Spyridon Bakas
Corporate Author: et al.

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×