Self Attention, Deep Learning, Transformers, Bert, Ml So Good.
for something more structured like Fourier transform. After applying Fourier transform, the embedding gets converted into the frequency domain. Each output from Fourier transform has a component of each of the input embedding. Thus facilitating the information across all embeddings. So the Fourier