[196] Huang, Z., Hou, L., Shang, L., Jiang, X., Chen, X., Liu, Q.: Ghostbert: Gen-
erate more features with cheap operations for bert. In: Proceedings of the 59th
Annual Meeting of the Association for Computational Linguistics and the 11th
International Joint Conference on Natural Language Processing (Volume 1: Long
Papers), pp. 6512–6523 (2021)

56

[197] Iandola, F., Shaw, A., Krishna, R., Keutzer, K.: Squeezebert: What can com-
puter vision teach nlp about eﬃcient neural networks? In: Proceedings of
SustaiNLP: Workshop on Simple and Eﬃcient Natural Language Processing,
pp. 124–135 (2020)

[198] Wu, Z., Liu, Z., Lin, J., Lin, Y., Han, S.: Lite transformer with long-short range

attention. arXiv preprint arXiv:2004.11886 (2020)

[199] Wang, Y., Chen, K., Tan, H., Guo, K.: Tabi: An eﬃcient multi-level inference
system for large language models. In: Proceedings of the Eighteenth European
Conference on Computer Systems, pp. 233–248 (2023)
Beyond Efficiency