Random style transfer based domain generalization networks integrating shape and spatial information

Li, Lei, Zimmer, Veronika A., Ding, Wangbin, Wu, Fuping, Huang, Liqin, Schnabel, Julia A. and Zhuang, Xiahai (2021) Random style transfer based domain generalization networks integrating shape and spatial information. Puyol Anton, Esther, Pop, Mihaela, Sermesant, Maxime, Campello, Victor, Lalande, Alain, Lekadir, Karim, Suinesiaputra, Avan, Camara, Oscar and Young, Alistair (eds.) In Statistical Atlases and Computational Models of the Heart. MandMs and EMIDEC Challenges - 11th International Workshop, STACOM 2020, Held in Conjunction with MICCAI 2020, Revised Selected Papers. vol. 12592 LNCS, Springer Cham. pp. 208-218 . (doi:10.1007/978-3-030-68107-4_21).

Abstract

Deep learning (DL)-based models have demonstrated good performance in medical image segmentation. However, the models trained on a known dataset often fail when performed on an unseen dataset collected from different centers, vendors and disease populations. In this work, we present a random style transfer network to tackle the domain generalization problem for multi-vendor and center cardiac image segmentation. Style transfer is used to generate training data with a wider distribution/heterogeneity, namely domain augmentation. As the target domain could be unknown, we randomly generate a modality vector for the target modality in the style transfer stage, to simulate the domain shift for unknown domains. The model can be trained in a semi-supervised manner by simultaneously optimizing a supervised segmentation and a unsupervised style translation objective. Besides, the framework incorporates the spatial information and shape prior of the target by introducing two regularization terms. We evaluated the proposed framework on 40 subjects from the M&Ms challenge2020, and obtained promising performance in the segmentation for data from unknown vendors and centers.

This record has no associated files available for download.

Contributors

Author: Lei Li

Download statistics