Deep Learning, Attention, Transformers, Optical Computing, AI.
FT as non-parameterised token mixing. It is token mixing because all elements in the input function contribute to each element in the output function. It is not parameterised because the output only depends on the input, there are no other parameters such as the matrices used in attention. FNets