Deep Learning, Artificial Intelligence, Image Classification, Attention Mechanism, Senet.
of various channel attention modules using ResNet-50 as backbone model on ImageNet. 1.1. SENet Channel attention of SE block in SENet is: where σ is sigmoid. W is learnable weights/layers, and y=g(X) which is global average pooling (GAP): In SENet, 2 FC layers with dimension reduction and expansion