AICurious Logo

What is: Effective Squeeze-and-Excitation Block?

SourceCenterMask : Real-Time Anchor-Free Instance Segmentation
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Effective Squeeze-and-Excitation Block is an image model block based on squeeze-and-excitation, the difference being that one less FC layer is used. The authors note the SE module has a limitation: channel information loss due to dimension reduction. For avoiding high model complexity burden, two FC layers of the SE module need to reduce channel dimension. Specifically, while the first FC layer reduces input feature channels CC to C/rC/r using reduction ratio rr, the second FC layer expands the reduced channels to original channel size CC. As a result, this channel dimension reduction causes channel information loss. Therefore, effective SE (eSE) uses only one FC layer with CC channels instead of two FCs without channel dimension reduction, which maintains channel information.