preprint arXiv:2309.06979 (2023)

[68] Poli, M., Massaroli, S., Nguyen, E., Fu, D.Y., Dao, T., Baccus, S., Bengio,
Y., Ermon, S., R´e, C.: Hyena hierarchy: Towards larger convolutional language
models. arXiv preprint arXiv:2302.10866 (2023)

[69] Fu, D.Y., Arora, S., Grogan, J., Johnson, I., Eyuboglu, S., Thomas, A.W., Spec-
tor, B.F., Poli, M., Rudra, A., Re, C.: Monarch mixer: A simple sub-quadratic
gemm-based architecture. In: Thirty-seventh Conference on Neural Information
Processing Systems (2023)

[70] Gu, A., Dao, T.: Mamba: Linear-time sequence modeling with selective state

spaces. arXiv preprint arXiv:2312.00752 (2023)

[71] Baines, M., Bhosale, S., Caggiano, V., Goyal, N., Goyal, S., Ott, M., Lefaudeux,
B., Liptchinsky, V., Rabbat, M., Sheiﬀer, S., et al.: Fairscale: A general purpose
modular pytorch library for high performance and large scale training (2021)
Beyond Efficiency