Minimal-Supervised Medical Image Segmentation via Vector Quantization Memory

Minimal-Supervised Medical Image Segmentation via Vector Quantization Memory

Lecture Notes in Computer Science

10.1007/978-3-031-43898-1_60

http://dx.doi.org/10.1007/978-3-031-43898-1_60

Yanyu Xu, Menghan Zhou, Yangqin Feng, Xinxing Xu, Huazhu Fu, Rick Siow Mong Goh, Yong Liu

30 September 2023

Xu, Y., Zhou, M., Feng, Y., Xu, X., Fu, H., Goh, R. S. M., & Liu, Y. (2023). Minimal-Supervised Medical Image Segmentation via Vector Quantization Memory. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 (pp. 625–636). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-43898-1_60

Medical image segmentation is a critical key task for computer-assisted diagnosis and disease monitoring. However, collecting a large-scale medical dataset with well-annotation is time-consuming and requires domain knowledge. Reducing the number of annotations poses two challenges: obtaining sufficient supervision and generating high-quality pseudo labels. To address these, we propose a universal framework for annotation-efficient medical segmentation, which is capable of handling both scribble-supervised and point-supervised segmentation. Our approach includes an auxiliary reconstruction branch that provides more supervision and backward sufficient gradients for learning visual representations. Besides, a novel pseudo label generation branch utilizes the VQ bank to store texture-oriented and global features for generating pseudo labels. To boost the model training, we generate high-quality pseudo labels by mixing the segmentation prediction and pseudo labels from the VQ bank. The experiments on the ACDC MRI segmentation dataset demonstrate the effectiveness of our proposed method. We obtain a comparable performance (0.86 vs. 0.87 DSC score).

Publisher Copyright

This research / project is supported by the National Research Foundation - AI Singapore Programme
Grant Reference no. : AISG2-TC-2021-003

This research / project is supported by the A*STAR - AME Programmatic Funding
Grant Reference no. : A20H4b0141

This research / project is supported by the A*STAR - Central Research Fund
Grant Reference no. : N.A

This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: http://dx.doi.org/10.1007/978-3-031-43898-1_60

https://oar.a-star.edu.sg/communities-collections/articles/19799

9783031438981

9783031438974

Institute of High Performance Computing