IDEAL: Improved DEnse locAL Contrastive Learning for Semi-Supervised Medical Image Segmentation

Hritam Basak*1 Soumitri Chattopadhyay*2 Rohit Kundu*3 Sayan Nag*4 Rammohan Mallipeddi5

1Stony Brook University

2Jadavpur University

3University of California, Riverside

4University of Toronto

5Kyungpook National University

Published at the 48th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023)

Overview

An overview of the proposed IDEAL (Improved DEnse locAL Contrastive Learning for Semi-Supervised Medical Image Segmentation) framework: (a) Pre-training- xq and xk are the query and key images, E and G represent the encoder and projection head, respectively. The projection head employs a 1x1 convolution layer instead of a traditional MLP for dense feature extraction, resulting in better local clustering of features. (b) Fine-tuning- Two perturbed branches with the same input are employed. E(θ) is the shared encoder initialized similarly for both streams, D(θ1) and D(θ2) represent two different decoder architectures; p1 and p2 are the predicted output segmentation maps which are thresholded to obtain y1 and y2 respectively. y1 backpropagates through the second stream and y2 backpropagates through the first stream enforcing cross-consistency in segmentation.

Main Results

Results obtained by the IDEAL framework with varying amounts of labeled data on the ACDC and MMWHS datasets. ‘L’ represents the amount of labeled data used.
Performance Comparison (DSC scores) of the proposed IDEAL framework with SoTA methods in the literature on the ACDC and MMWHS datasets.
Visual comparison of our results with SoTA methods and ground truth, thus qualitatively validating the superiority of IDEAL in terms of segmentation performance.

People


Hritam Basak

Soumitri Chattopadhyay

Rohit Kundu

Sayan Nag

Rammohan Mallipeddi

Acknowledgement

This work was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2021R1I1A3049810).

Paper

Hritam Basak*, Soumitri Chattopadhyay*, Rohit Kundu*, Sayan Nag*, Rammohan Mallipeddi
IDEAL: Improved DEnse locAL Contrastive Learning for Semi-Supervised Medical Image Segmentation
Paper
[arXiv] [code] [bibtex]