Deep Learning, Attention, Transformers, Optical Computing, AI.
use FTs as a way of mixing information so that every element of an input influences every other element, thus achieving the same kind of global interaction that the more expensive (see next section) attention mechanism provides. Fourier Transforms as a replacement for attention FTs and attention