MSD-EMA: Multiscale Decoupled Expectation–Maximization Attention for Polyp Segmentation

Abstract

Automatic polyp segmentation is a crucial technique of computer-aided clinical diagnosis. However, some current polyp segmentation methods cannot accurately extract polyps from colonoscopy images due to the diversity of polyp shapes and sizes, as well as the blurry boundaries caused by the adhesion between polyps and surrounding tissues. To address this issue, we propose a multiscale decoupled expectation-maximization (EM) attention, namely MSD-EMA. There are two advantages of MSD-EMA. First, we design the decoupled EM attention, which decouples attention weights into the sum of pairwise term representing interregional features and unary term representing salient boundary features, thereby extracting boundary features between polyps and surrounding tissues while reducing computational complexity. Second, we propose the parallel collaborative strategy (PCS), which enables MSD-EMA to simultaneously extract sparse and dense feature maps using lower computational complexity. Sparse features are suitable for segmenting small polyps due to filtering out noise interference. Dense features are suitable for capturing large polyps that contain more location information. Comparative experiments are conducted with currently excellent polyp segmentation networks on five publicly available datasets, and the experimental results demonstrate that MSD-EMA can effectively improve polyp segmentation performance. Moreover, MSD-EMA is a plug-and-play module that can be applied to other types of segmentation tasks. The source code is available at https://github.com/EmarkZOU/MSD-EMA.