Deep Learning, Artificial Intelligence, Medical Imaging, Image Segmentation, Transformers.
feature maps should depend on all positions of the input feature maps. In fact, a fully-connected layer has this global property. However, it is prone to over-fitting and does not work well in practice. In this paper, self-attention, used in Transformer, is used. This is also used in non-local