Machine Learning, Artificial Intelligence, Deep Learning, Data Science.
local spatial information first before refining it with self-attention. Loss function SAGAN uses hinge loss to train the network: Implementation Self-attention does not apply to the generator only. Both the generator and the discriminator use the self-attention mechanism. To improve the training,