Language Model, Transformers, Deep Learning, Artificial Intelligence, Machine Learning.
better value in terms of both complexity and performance. Attention Free Transformer Time: AFT-simple O(Td), AFT-full O(T^2d) Space: O(Td) 📎 Paper 👩‍💻 Code (unofficial) Attention Free Transformer (AFT) eliminates the need for dot product self-attention, making it scalable with long inputs and large