Deep Learning, Attention, Transformers, Optical Computing, AI.
approach is two orders of magnitude better. We ran some experiments on the Huggingface implementation of FNet and found that on an Nvidia Quadro P6000 GPU, the FT was responsible for up to 30% of the inference time on the FNet architecture. Taking this into account, any GPU that integrates optical