Hi @ttj
Very interesting idea. I am planning to implement the FNet in PyTorch. I made a PR a few days back and I’m yet to update here: [WIP] FNet by gchhablani · Pull Request #12335 · huggingface/transformers · GitHub 4. Not sure if Flax would be easier.