The University of Southampton
University of Southampton Institutional Repository

MyoPS-Net: myocardial pathology segmentation with flexible combination of multi-sequence CMR images

MyoPS-Net: myocardial pathology segmentation with flexible combination of multi-sequence CMR images
MyoPS-Net: myocardial pathology segmentation with flexible combination of multi-sequence CMR images

Myocardial pathology segmentation (MyoPS) can be a prerequisite for the accurate diagnosis and treatment planning of myocardial infarction. However, achieving this segmentation is challenging, mainly due to the inadequate and indistinct information from an image. In this work, we develop an end-to-end deep neural network, referred to as MyoPS-Net, to flexibly combine five-sequence cardiac magnetic resonance (CMR) images for MyoPS. To extract precise and adequate information, we design an effective yet flexible architecture to extract and fuse cross-modal features. This architecture can tackle different numbers of CMR images and complex combinations of modalities, with output branches targeting specific pathologies. To impose anatomical knowledge on the segmentation results, we first propose a module to regularize myocardium consistency and localize the pathologies, and then introduce an inclusiveness loss to utilize relations between myocardial scars and edema. We evaluated the proposed MyoPS-Net on two datasets, i.e., a private one consisting of 50 paired multi-sequence CMR images and a public one from MICCAI2020 MyoPS Challenge. Experimental results showed that MyoPS-Net could achieve state-of-the-art performance in various scenarios. Note that in practical clinics, the subjects may not have full sequences, such as missing LGE CMR or mapping CMR scans. We therefore conducted extensive experiments to investigate the performance of the proposed method in dealing with such complex combinations of different CMR sequences. Results proved the superiority and generalizability of MyoPS-Net, and more importantly, indicated a practical clinical application. The code has been released via https://github.com/QJYBall/MyoPS-Net.

Missing modality, Multi-sequence CMR, Myocardial pathology segmentation, Practical clinics
1361-8415
Qiu, Junyi
ebd2dcf4-1c11-4fe1-b0e3-e31087d3e93a
Li, Lei
2da88502-0bd8-4e6b-8f7d-0c01a48b399e
Wang, Sihan
fd4f700b-a400-40c0-b34a-00d275fdd84d
Zhang, Ke
b60d7ac2-a6a0-4b56-b18a-5c66024ad11f
Chen, Yinyin
b83e0c07-20b8-4531-915e-5ef8d3852460
Yang, Shan
b48b3d3d-b1f7-47ea-9bac-df4aea3a8c63
Zhuang, Xiahai
c58e977b-e70e-4b37-9acd-b7f8070d98a8
et al.
Qiu, Junyi
ebd2dcf4-1c11-4fe1-b0e3-e31087d3e93a
Li, Lei
2da88502-0bd8-4e6b-8f7d-0c01a48b399e
Wang, Sihan
fd4f700b-a400-40c0-b34a-00d275fdd84d
Zhang, Ke
b60d7ac2-a6a0-4b56-b18a-5c66024ad11f
Chen, Yinyin
b83e0c07-20b8-4531-915e-5ef8d3852460
Yang, Shan
b48b3d3d-b1f7-47ea-9bac-df4aea3a8c63
Zhuang, Xiahai
c58e977b-e70e-4b37-9acd-b7f8070d98a8

Qiu, Junyi, Li, Lei and Wang, Sihan , et al. (2022) MyoPS-Net: myocardial pathology segmentation with flexible combination of multi-sequence CMR images. Medical Image Analysis, 84, [102694]. (doi:10.1016/j.media.2022.102694).

Record type: Article

Abstract

Myocardial pathology segmentation (MyoPS) can be a prerequisite for the accurate diagnosis and treatment planning of myocardial infarction. However, achieving this segmentation is challenging, mainly due to the inadequate and indistinct information from an image. In this work, we develop an end-to-end deep neural network, referred to as MyoPS-Net, to flexibly combine five-sequence cardiac magnetic resonance (CMR) images for MyoPS. To extract precise and adequate information, we design an effective yet flexible architecture to extract and fuse cross-modal features. This architecture can tackle different numbers of CMR images and complex combinations of modalities, with output branches targeting specific pathologies. To impose anatomical knowledge on the segmentation results, we first propose a module to regularize myocardium consistency and localize the pathologies, and then introduce an inclusiveness loss to utilize relations between myocardial scars and edema. We evaluated the proposed MyoPS-Net on two datasets, i.e., a private one consisting of 50 paired multi-sequence CMR images and a public one from MICCAI2020 MyoPS Challenge. Experimental results showed that MyoPS-Net could achieve state-of-the-art performance in various scenarios. Note that in practical clinics, the subjects may not have full sequences, such as missing LGE CMR or mapping CMR scans. We therefore conducted extensive experiments to investigate the performance of the proposed method in dealing with such complex combinations of different CMR sequences. Results proved the superiority and generalizability of MyoPS-Net, and more importantly, indicated a practical clinical application. The code has been released via https://github.com/QJYBall/MyoPS-Net.

This record has no associated files available for download.

More information

Accepted/In Press date: 16 November 2022
e-pub ahead of print date: 28 November 2022
Published date: 7 December 2022
Keywords: Missing modality, Multi-sequence CMR, Myocardial pathology segmentation, Practical clinics

Identifiers

Local EPrints ID: 488810
URI: http://eprints.soton.ac.uk/id/eprint/488810
ISSN: 1361-8415
PURE UUID: e7295501-351c-4c1e-956b-f67f33d05709
ORCID for Lei Li: ORCID iD orcid.org/0000-0003-1281-6472

Catalogue record

Date deposited: 05 Apr 2024 16:45
Last modified: 10 Apr 2024 02:14

Export record

Altmetrics

Contributors

Author: Junyi Qiu
Author: Lei Li ORCID iD
Author: Sihan Wang
Author: Ke Zhang
Author: Yinyin Chen
Author: Shan Yang
Author: Xiahai Zhuang
Corporate Author: et al.

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×