Deep Learning, Attention, Transformers, Optical Computing, AI.
the Fourier transform (FT). Google AI researchers Lee-Thorpe et al. claim that FNet can be trained up to 80% faster than analogous BERT models, while only sacrificing 3–8% in accuracy measured on the GLUE benchmark. This work is of particular interest to us at Optalysys because we are currently